-- Logs begin at Tue 2022-06-14 18:39:02 UTC, end at Tue 2022-06-14 20:02:39 UTC. -- Jun 14 19:27:38.541763 dv-cinder-845806-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 14 19:27:38.549005 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 14 19:27:38.551011 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 14 19:27:38 2022] *** Jun 14 19:27:38.551011 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 14 19:27:38.551011 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 14 19:27:38.551011 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: nodename: dv-cinder-845806-1-iscsi Jun 14 19:27:38.551011 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: machine: x86_64 Jun 14 19:27:38.551011 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: clock source: unix Jun 14 19:27:38.551011 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: pcre jit disabled Jun 14 19:27:38.551443 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: detected number of CPU cores: 4 Jun 14 19:27:38.551443 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: current working directory: / Jun 14 19:27:38.551443 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: detected binary path: /usr/bin/uwsgi-core Jun 14 19:27:38.551443 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: your processes number limit is 47680 Jun 14 19:27:38.551443 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: your memory page size is 4096 bytes Jun 14 19:27:38.551443 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: detected max file descriptor number: 2048 Jun 14 19:27:38.551443 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: lock engine: pthread robust mutexes Jun 14 19:27:38.551443 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: thunder lock: enabled Jun 14 19:27:38.551443 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 14 19:27:38.551443 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 14 19:27:38.598165 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: Python main interpreter initialized at 0x55c756f539c0 Jun 14 19:27:38.598165 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: python threads support enabled Jun 14 19:27:38.598165 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: your server socket listen backlog is limited to 100 connections Jun 14 19:27:38.598165 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: your mercy for graceful operations on workers is 90 seconds Jun 14 19:27:38.598564 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: mapped 403077 bytes (393 KB) for 2 cores Jun 14 19:27:38.598647 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: *** Operational MODE: preforking *** Jun 14 19:27:38.598893 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: *** uWSGI is running in multiple interpreter mode *** Jun 14 19:27:38.598893 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: spawned uWSGI master process (pid: 80334) Jun 14 19:27:38.599097 dv-cinder-845806-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 14 19:27:38.605408 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: spawned uWSGI worker 1 (pid: 80346, cores: 1) Jun 14 19:27:38.605408 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: spawned uWSGI worker 2 (pid: 80347, cores: 1) Jun 14 19:27:38.605408 dv-cinder-845806-1-iscsi devstack@keystone.service[80334]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 14 19:27:44.123984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 19:27:44.123984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: from cryptography.utils import int_from_bytes Jun 14 19:27:44.124749 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 19:27:44.124749 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: from cryptography.utils import int_from_bytes Jun 14 19:27:44.124973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 19:27:44.124973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: from cryptography.utils import int_from_bytes Jun 14 19:27:44.125452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 14 19:27:44.125452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: from cryptography.utils import int_from_bytes Jun 14 19:27:44.174273 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 14 19:27:44.174469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 14 19:27:44.174667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] command line args: [] {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 14 19:27:44.174898 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 14 19:27:44.174987 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 14 19:27:44.175097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 14 19:27:44.175184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ================================================================================ {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 14 19:27:44.175295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] command line args: [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 14 19:27:44.175381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] admin_token = **** {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.175566 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 14 19:27:44.175652 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] config_dir = [] {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.175734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ================================================================================ {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 14 19:27:44.175812 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.175942 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] config_source = [] {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.176018 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] admin_token = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.176125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] debug = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.176216 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] config_dir = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.176326 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.176591 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.176591 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] config_source = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.176698 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.176763 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] debug = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.176906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.176990 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.177107 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.177179 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.177319 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.177422 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.177601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] list_limit = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.177690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.177796 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] log_config_append = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.177877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.177949 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.178071 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] list_limit = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.178150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] log_dir = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.178769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] log_config_append = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.178857 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] log_file = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.178961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.179048 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.179163 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] log_dir = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.179311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.179491 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] log_file = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.179636 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.179738 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.179863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.179943 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.180057 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.180139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.180210 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.180274 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.180353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.180432 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.180581 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.180663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.180819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.180905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.181057 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.181137 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.181293 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.181399 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.181553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.181690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.181773 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.181843 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.182015 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.182143 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.182273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.182363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.182523 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.182789 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.182868 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.182995 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] publish_errors = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.183205 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.183283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.183441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.183571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] publish_errors = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.183647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.183761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.183862 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.183946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.184055 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.184154 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.184304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.184386 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] standard_threads = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.184542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.184728 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.184812 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] standard_threads = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.184889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.184966 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.185040 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.185111 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] use_journal = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.185228 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.185314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] use_json = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.185431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.185511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] use_stderr = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.185612 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] use_journal = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.185690 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] use_syslog = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.185792 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] use_json = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.185873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.185969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] use_stderr = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.186103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.186182 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] use_syslog = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.186344 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.186432 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 14 19:27:44.186606 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.186728 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.186845 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.186929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.187094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.187179 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.187335 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.187418 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.187583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.187669 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.187822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.187907 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.188071 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.188156 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.188310 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.188387 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.188558 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.188646 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.188795 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.188873 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.189041 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.189118 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.189279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.189364 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.189554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.189636 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.189790 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.189869 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.190031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.190184 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.190280 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.190367 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.190521 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.190599 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.190768 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.190854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.191007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.191085 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.191255 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.191332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.191495 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.191581 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.191750 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.191829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.191999 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.192081 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.192232 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.192321 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.192465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.192543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.192698 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.192781 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.192931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.193015 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.193164 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.193242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.193421 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.193513 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.193666 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.193750 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.193969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.194585 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.194763 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.194842 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.195015 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.195095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.195258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.195335 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.195507 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.195582 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.195740 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.195818 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.195977 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.196053 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.196209 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.196285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.196432 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.196504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.196660 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.196738 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.196892 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.197016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.197124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.197205 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.197365 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.197486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.197636 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.197723 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.197875 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.197997 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.198118 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.198256 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.198346 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.198524 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.198611 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.198789 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.198897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.199036 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.199139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.199268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.199381 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.199508 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.199621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.199747 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.199872 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.199982 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.200108 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.200210 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.200354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.200436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.200595 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.200677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.200833 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.200916 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.201072 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.201153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.201312 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.201542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.201662 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.201749 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.201831 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.201910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.202038 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.202148 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.202263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.202380 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.202494 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.202581 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.202755 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.202841 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.202994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.203080 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.203227 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.203306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.203465 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.203549 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.203702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.203798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.203971 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.204051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.204211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.204296 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.204445 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.204530 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.204691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.204769 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.204926 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.205004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.205163 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.205255 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.205421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.205549 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.205665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.205744 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.205906 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.205997 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.206140 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.206218 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.206378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.206457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.206615 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.206701 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.206854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.206933 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.207092 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.207171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.207331 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.207417 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.207568 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.207646 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.207812 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.207899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.208052 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.208209 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.208291 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.208364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.208516 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.208594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.208746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.208834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.208977 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.209068 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.209210 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.209289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.209469 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.209587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.209738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.209832 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.209969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.210048 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.210203 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.210439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.210671 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.210913 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.211778 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.212059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.212323 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.212601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.212881 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.212961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.213141 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.213219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.213404 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] auth.external = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.213497 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.213651 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.213753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.213958 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.214044 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.214205 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.214284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.214447 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] auth.password = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.214555 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] auth.external = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.214686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] auth.token = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.214778 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.214934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.215020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.215178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.215257 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.215433 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.215514 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] auth.password = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.215676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.215756 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] auth.token = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.215928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.216009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.216172 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.216257 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.216407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.216486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.216649 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] credential.caching = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.216730 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.216901 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.216981 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.217153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.217231 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.217397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.217487 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.217655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] credential.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.217737 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.217904 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.217983 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.218147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.218226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.218399 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.218481 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.218643 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.218722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.218892 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.218970 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.219129 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.219214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.219405 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.219485 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.219663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.219741 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.219906 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.219988 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.220163 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.220240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.220424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.220503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.220665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] federation.caching = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.220746 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.220908 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.220986 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.221158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.221236 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.221428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.221515 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.221670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.221794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.221910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.222001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.222151 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.222231 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.222407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.222487 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.222644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.222723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.222895 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.222977 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.223136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.223214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.223390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.223469 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.223630 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.223710 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] identity.caching = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.223880 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.223958 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.224120 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.224274 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.224350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.224420 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.224590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.224670 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.224856 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.224988 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.225067 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.225137 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.225352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.225487 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.225726 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.225823 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.225980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.226059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.226216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.226293 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.226452 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.226538 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.226687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.226768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.226936 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.227015 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.227170 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.227258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.227407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.227487 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.227641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.227720 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.227890 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.227978 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.228140 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.228219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.228390 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.228468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.228630 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.228715 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.228867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.228948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.229110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.229189 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.229345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.229445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.229609 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.229689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.229849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.229927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.230090 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.230178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.230324 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.230405 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.230561 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.230639 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.230800 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.230887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.231043 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.231123 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.231280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.231358 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.231516 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.231603 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.231764 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.231842 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.231998 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.232077 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.232240 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.232332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.232474 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.232553 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.232716 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.232795 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.232948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.233034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.233190 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.233270 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.233446 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.233543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.233689 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.233777 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.233928 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.234006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.234172 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.234252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.234404 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.234491 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.234636 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.234716 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.234884 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.234962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.235132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.235219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.235363 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.235441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.235595 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.235674 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.235832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.235918 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.236064 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.user = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.236150 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.236305 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.236385 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.236541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.236627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.236779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.236858 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.237012 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.237091 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.237253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.237334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.237521 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.237601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.237761 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.237840 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.237995 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.238077 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.238235 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.238316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.238475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.238554 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.238711 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.238791 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.238941 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.239019 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.239179 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.239257 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.239418 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.239499 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.239659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.239738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.239891 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.239970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.240140 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.240219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.240375 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.240454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.240621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.240699 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.241430 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.241517 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.241669 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.241748 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.241906 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.242066 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.242160 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.242316 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.242395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.242570 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.242648 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.242825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.242912 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.243069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.243148 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.243316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.243394 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.243552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.243638 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.243793 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.243871 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.244034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.244111 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.244269 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.244354 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.244509 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.244588 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.244746 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.244824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.244985 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.245072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.245219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.245297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.245483 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.245565 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.245727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.245818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] resource.caching = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.245963 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.246042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.246202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.246281 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.246445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.246533 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.246699 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.246779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.246947 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.247026 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.247187 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.247273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.247437 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.247518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.247679 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.247765 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.247921 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.248075 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.248151 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] role.caching = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.248221 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.248395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.248473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] role.driver = sql {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.248626 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.248712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.248862 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] role.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.248940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.249111 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] role.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.249189 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.249345 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.249494 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.249621 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.249700 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.249869 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.249947 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.250116 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.250195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.250361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.250439 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.250609 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.250686 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.250846 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.250928 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.251091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.251169 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.251338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.251416 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.251572 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.251658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.251822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.251901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.252071 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.252226 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.252313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.252464 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.252544 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.252715 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.252947 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.253027 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.253187 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.253267 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.253466 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.253550 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.253704 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.253782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.253957 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.254038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.254209 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.254288 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.254446 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.254571 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.254679 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.254760 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.254914 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.254994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.255149 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.255236 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.255395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.255474 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.255629 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.255708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.255863 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.255950 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.256119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.256199 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.256356 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.257063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.257201 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.257291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.257511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] token.caching = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.257595 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.257701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.257782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.257934 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.258026 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.258178 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] token.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.258266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.258418 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.258498 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.258669 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.258756 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.258908 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.258987 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.259153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.259250 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.259402 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.259527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.259636 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.259740 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.259875 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.259987 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.260103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.260227 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.260346 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.260458 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.260567 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.260674 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.260809 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.260933 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.261046 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.261153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.261257 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.261361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.261544 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.261671 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.261781 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.261886 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] database.connection = **** {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.262002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.262118 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.262290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.262403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.262535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.262655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.connection = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.262775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.262894 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.263002 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.263120 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.263264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.263409 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.263569 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.263702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.263825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.263951 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.264078 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.264207 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.264349 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.264481 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.264601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.264681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.264754 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.264819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.264899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.264973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.265072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.265154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.265306 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.265406 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.265574 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.265656 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.265817 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.265956 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.266086 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.266198 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.266337 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 14 19:27:44.266471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.266606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.266733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 14 19:27:44.266894 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 14 19:27:44.382768 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.382955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.383040 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.383119 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.383236 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.383472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.391603 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.391849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.420149 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.420385 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.420862 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.421101 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.476405 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.477699 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.526010 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.526247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.527933 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.528172 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.592918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.593146 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.593369 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.593582 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.593669 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.593817 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.593899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.594032 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.594115 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.594254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.594474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.594690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.616720 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.617015 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.617249 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.617503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.617634 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.617738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.617839 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.617954 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.618058 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.618158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.618257 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.618466 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.618688 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.618910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.629007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.630188 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.642209 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.642391 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.642572 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.642657 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.642807 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.642890 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.643028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.643119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.643243 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.643325 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.643456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.643539 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.643668 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.643883 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 14 19:27:44.660947 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.661156 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 14 19:27:44.661530 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.661629 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.661721 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 14 19:27:44.661830 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 14 19:27:44.662160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.662261 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.662366 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 14 19:27:44.662479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.662701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.662842 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.663111 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.663200 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.663378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.663639 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.674250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.674525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.674795 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.675074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.675171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.675401 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.675674 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.675957 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.683292 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.684130 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.686687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.686964 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.687243 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.687521 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.687603 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.687805 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.687888 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.688061 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.688143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.688325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.688416 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.688594 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.688677 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.688861 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.688942 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.689128 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.689218 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.689404 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.689487 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.689687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.689962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.690232 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.717301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.718285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.718937 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.719212 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.719935 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.720216 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.724447 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.724721 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.724998 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.725844 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.726130 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.726436 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.732409 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.732687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.734309 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.734590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.737146 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.737455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.737734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.738009 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.738280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.738555 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.738823 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.739086 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.739168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.739393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.739681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.739963 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.740238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.740511 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.740816 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.741297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.758668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.758940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.761171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.761478 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.763487 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.766005 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.767131 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.767424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.769666 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.769965 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.773044 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.775849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.776651 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.779467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.781154 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.781475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.781759 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.782042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.782318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.782592 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.783224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.783525 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.783810 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.784097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.784379 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.784671 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.801895 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.802175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.802439 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.802699 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.804265 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.804547 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.804840 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.805108 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.812174 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.812367 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.812645 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.813055 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.814800 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.815080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.815689 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.815975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.819886 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.819886 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.819886 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.820135 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.820135 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.820998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.821332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.821683 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.832006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.832284 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.832570 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.832848 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.833123 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.833422 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.833699 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.835798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.836076 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.836368 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.836652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.836940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.837217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.837517 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.852119 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.855396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.855632 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.858703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.858943 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.860294 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.862089 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.862288 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.862373 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.862632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.863899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.866211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.866505 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.866793 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.870398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.872001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.874181 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.875249 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.875537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.875801 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.875885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.876079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.879082 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.879377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.879686 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.879969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.886033 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.886319 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.886597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.891577 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.891873 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.892155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.900682 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.900897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 14 19:27:44.900998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.901177 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.901274 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.901493 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.901610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.901771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.901863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.902046 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.902130 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.902407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.902530 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.902813 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.903239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.903618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.903897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.904180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.904451 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.904714 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.907616 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.907930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.908644 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.909040 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.909327 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.909651 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.909928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.910198 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 14 19:27:44.943716 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c756f539c0 pid: 80347 (default app) Jun 14 19:27:44.947856 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9859b-b252-4d5a-a7a1-477bc0472cbb None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:27:44.948152 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9859b-b252-4d5a-a7a1-477bc0472cbb None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:27:44.948434 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9859b-b252-4d5a-a7a1-477bc0472cbb None None] PATH_INFO: `/v3` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:27:44.948878 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c756f539c0 pid: 80346 (default app) Jun 14 19:27:44.952677 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 791 bytes} [Tue Jun 14 19:27:44 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:27:52.812263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441da16-49ec-4d21-a794-14b9c0b09366 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:27:52.812825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441da16-49ec-4d21-a794-14b9c0b09366 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:27:52.812825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441da16-49ec-4d21-a794-14b9c0b09366 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:27:52.817169 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1/2] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:27:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:27:52.822596 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0574fa-65cd-4265-aeff-cf0235c3b6b5 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:27:52.823039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0574fa-65cd-4265-aeff-cf0235c3b6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:27:52.823134 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0574fa-65cd-4265-aeff-cf0235c3b6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:27:52.892000 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: INFO dbcounter [None req-1d0574fa-65cd-4265-aeff-cf0235c3b6b5 None None] Registered counter for database keystone Jun 14 19:27:52.913142 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG oslo_db.sqlalchemy.engines [None req-1d0574fa-65cd-4265-aeff-cf0235c3b6b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 19:27:52.919580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writer thread running {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 19:27:53.098187 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG passlib.handlers.bcrypt [None req-1d0574fa-65cd-4265-aeff-cf0235c3b6b5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80347) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 14 19:27:53.098531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG passlib.handlers.bcrypt [None req-1d0574fa-65cd-4265-aeff-cf0235c3b6b5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80347) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 14 19:27:53.153291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1d0574fa-65cd-4265-aeff-cf0235c3b6b5 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:27:53.154920 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1d0574fa-65cd-4265-aeff-cf0235c3b6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:27:53.277401 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 2/3] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:27:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 14 19:27:53.427924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441da16-49ec-4d21-a794-14b9c0b09366 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:27:53.498256 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: INFO dbcounter [None req-0441da16-49ec-4d21-a794-14b9c0b09366 None None] Registered counter for database keystone Jun 14 19:27:53.518141 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG oslo_db.sqlalchemy.engines [None req-0441da16-49ec-4d21-a794-14b9c0b09366 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80346) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 14 19:27:53.524953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writer thread running {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 14 19:27:53.644013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441da16-49ec-4d21-a794-14b9c0b09366 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:27:53.648356 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5e5fc-7eda-4d8d-9c89-5fb10f5934f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:27:53.649019 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5e5fc-7eda-4d8d-9c89-5fb10f5934f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:27:53.649310 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5e5fc-7eda-4d8d-9c89-5fb10f5934f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:27:53.649622 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5e5fc-7eda-4d8d-9c89-5fb10f5934f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:27:53.657833 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5e5fc-7eda-4d8d-9c89-5fb10f5934f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:27:53.711976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: WARNING keystone.common.rbac_enforcer.enforcer [None req-02d5e5fc-7eda-4d8d-9c89-5fb10f5934f4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 14 19:27:53.712259 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5e5fc-7eda-4d8d-9c89-5fb10f5934f4 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:27:53.721694 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 2/4] 10.222.0.44 () {58 vars in 1324 bytes} [Tue Jun 14 19:27:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 19:27:53.728063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0574fa-65cd-4265-aeff-cf0235c3b6b5 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:27:53.745362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0574fa-65cd-4265-aeff-cf0235c3b6b5 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:27:53.749752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c298aef-adbd-4f09-9a5a-d7e3144b272d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:27:53.750847 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c298aef-adbd-4f09-9a5a-d7e3144b272d admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:27:53.751131 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c298aef-adbd-4f09-9a5a-d7e3144b272d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:27:53.751406 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c298aef-adbd-4f09-9a5a-d7e3144b272d admin admin] PATH_INFO: `/v3/projects/782dbf52581f4a55b95487f939e373c1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:27:53.752898 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c298aef-adbd-4f09-9a5a-d7e3144b272d admin admin] RBAC: Authorizing `identity:get_project(project_id=782dbf52581f4a55b95487f939e373c1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:27:53.804136 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0c298aef-adbd-4f09-9a5a-d7e3144b272d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 14 19:27:53.804477 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c298aef-adbd-4f09-9a5a-d7e3144b272d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:27:53.810141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 3/5] 10.222.0.44 () {56 vars in 1207 bytes} [Tue Jun 14 19:27:53 2022] GET /identity/v3/projects/782dbf52581f4a55b95487f939e373c1 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:27:55.901387 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730210b4-cad8-491f-b919-86c8afcbb040 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:27:55.901895 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730210b4-cad8-491f-b919-86c8afcbb040 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:27:55.901997 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730210b4-cad8-491f-b919-86c8afcbb040 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:27:55.906077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 3/6] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:27:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:27:55.911551 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758e025-dfa0-4271-98af-fc62093cb663 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:27:55.911972 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758e025-dfa0-4271-98af-fc62093cb663 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:27:55.912116 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5758e025-dfa0-4271-98af-fc62093cb663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:27:55.932971 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-5758e025-dfa0-4271-98af-fc62093cb663 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:27:55.934510 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5758e025-dfa0-4271-98af-fc62093cb663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:27:55.942201 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 4/7] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:27:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 14 19:27:55.964800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730210b4-cad8-491f-b919-86c8afcbb040 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:27:55.977465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730210b4-cad8-491f-b919-86c8afcbb040 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:27:55.981651 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1ad6b-f280-447c-93b0-9b5025342708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:27:55.982282 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1ad6b-f280-447c-93b0-9b5025342708 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:27:55.982572 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1ad6b-f280-447c-93b0-9b5025342708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:27:55.982857 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1ad6b-f280-447c-93b0-9b5025342708 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:27:55.991150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1ad6b-f280-447c-93b0-9b5025342708 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:27:55.992923 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1ad6b-f280-447c-93b0-9b5025342708 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:27:56.001753 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 4/8] 10.222.0.44 () {58 vars in 1324 bytes} [Tue Jun 14 19:27:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 19:27:56.006782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758e025-dfa0-4271-98af-fc62093cb663 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:27:56.015572 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5758e025-dfa0-4271-98af-fc62093cb663 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:27:56.019847 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762182f8-f852-4e93-bb7f-5a28cfe19bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:27:56.020699 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762182f8-f852-4e93-bb7f-5a28cfe19bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:27:56.020984 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762182f8-f852-4e93-bb7f-5a28cfe19bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:27:56.021263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762182f8-f852-4e93-bb7f-5a28cfe19bd8 admin admin] PATH_INFO: `/v3/users/13cde894f1744031872e9c62485bd552` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:27:56.022892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762182f8-f852-4e93-bb7f-5a28cfe19bd8 admin admin] RBAC: Authorizing `identity:get_user(user_id=13cde894f1744031872e9c62485bd552)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:27:56.024696 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762182f8-f852-4e93-bb7f-5a28cfe19bd8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:27:56.026271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 5/9] 10.222.0.44 () {56 vars in 1198 bytes} [Tue Jun 14 19:27:56 2022] GET /identity/v3/users/13cde894f1744031872e9c62485bd552 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:27:58.192397 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732b8f2-9397-449a-8a33-47a6277936cc None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:27:58.192901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732b8f2-9397-449a-8a33-47a6277936cc None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:27:58.192901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732b8f2-9397-449a-8a33-47a6277936cc None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:27:58.194333 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 5/10] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:27:58.200181 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336766ab-f23d-4b55-9f34-6e515ede622d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:27:58.200714 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336766ab-f23d-4b55-9f34-6e515ede622d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:27:58.200829 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336766ab-f23d-4b55-9f34-6e515ede622d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:27:58.218456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-336766ab-f23d-4b55-9f34-6e515ede622d None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:27:58.219632 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-336766ab-f23d-4b55-9f34-6e515ede622d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:27:58.249030 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed6578-c10d-4352-a784-b5e36752126e None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:27:58.249323 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed6578-c10d-4352-a784-b5e36752126e None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:27:58.249655 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed6578-c10d-4352-a784-b5e36752126e None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:27:58.251022 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 6/11] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:27:58.256175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db267d2-40f6-4767-9511-87e91f9d11bb None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:27:58.256468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db267d2-40f6-4767-9511-87e91f9d11bb None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:27:58.256852 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db267d2-40f6-4767-9511-87e91f9d11bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:27:58.297734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG passlib.handlers.bcrypt [None req-1db267d2-40f6-4767-9511-87e91f9d11bb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80346) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 14 19:27:58.298162 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG passlib.handlers.bcrypt [None req-1db267d2-40f6-4767-9511-87e91f9d11bb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80346) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 14 19:27:58.304829 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 6/12] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:27:58.327187 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336766ab-f23d-4b55-9f34-6e515ede622d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:27:58.343689 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-1db267d2-40f6-4767-9511-87e91f9d11bb None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:27:58.345286 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-1db267d2-40f6-4767-9511-87e91f9d11bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:27:58.351740 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:27:58.441350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336766ab-f23d-4b55-9f34-6e515ede622d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:27:58.451222 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 7/13] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:27:58.473478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db267d2-40f6-4767-9511-87e91f9d11bb None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:27:58.478041 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7b359-0f76-48b3-94a1-9538410a069b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:27:58.478842 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7b359-0f76-48b3-94a1-9538410a069b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:27:58.479128 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7b359-0f76-48b3-94a1-9538410a069b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:27:58.479407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7b359-0f76-48b3-94a1-9538410a069b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:27:58.491389 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7b359-0f76-48b3-94a1-9538410a069b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:27:58.502599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-1aa7b359-0f76-48b3-94a1-9538410a069b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:27:58.502599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:27:58.502599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:27:58.502599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:27:58.502599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:27:58.502599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:27:58.502599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:27:58.502599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:27:58.502599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:27:58.502599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:27:58.502599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:27:58.502599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:27:58.502599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:27:58.502599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:27:58.502599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:27:58.502599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:27:58.503590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:27:58.503590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:27:58.503590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:27:58.503590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:27:58.503590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:27:58.503590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:27:58.503590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:27:58.503590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:27:58.503590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:27:58.503590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:27:58.503590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:27:58.503590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:27:58.503590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:27:58.503590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:27:58.503590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:27:58.503590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:27:58.504561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:27:58.504561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:27:58.504561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:27:58.504561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:27:58.504561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:27:58.504561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:27:58.504561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:27:58.504561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:27:58.504561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:27:58.504561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:27:58.504561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:27:58.504561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:27:58.504561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 7/14] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:27:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:27:58.510360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7b359-0f76-48b3-94a1-9538410a069b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:27:58.579450 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db267d2-40f6-4767-9511-87e91f9d11bb None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:27:58.582225 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:27:58.592884 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:27:58.611653 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7b359-0f76-48b3-94a1-9538410a069b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:27:58.622307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a36c0d-3f85-499c-831c-3f1914e69557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:27:58.623195 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a36c0d-3f85-499c-831c-3f1914e69557 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:27:58.623485 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a36c0d-3f85-499c-831c-3f1914e69557 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:27:58.623766 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a36c0d-3f85-499c-831c-3f1914e69557 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:27:58.646765 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24571d3-dd3c-43b1-a587-eca839555e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:27:58.647510 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24571d3-dd3c-43b1-a587-eca839555e35 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:27:58.647800 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24571d3-dd3c-43b1-a587-eca839555e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:27:58.648081 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24571d3-dd3c-43b1-a587-eca839555e35 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:27:58.648845 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24571d3-dd3c-43b1-a587-eca839555e35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:27:58.649153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24571d3-dd3c-43b1-a587-eca839555e35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:27:58.650612 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24571d3-dd3c-43b1-a587-eca839555e35 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:27:58.662311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 8/15] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:27:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:27:58.667958 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24571d3-dd3c-43b1-a587-eca839555e35 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:27:58.696520 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a36c0d-3f85-499c-831c-3f1914e69557 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:27:58.698095 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a36c0d-3f85-499c-831c-3f1914e69557 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:27:58.768803 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24571d3-dd3c-43b1-a587-eca839555e35 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:27:58.801495 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 8/16] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:27:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 14 19:27:58.806539 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e33ef-faa6-4cca-9a58-750246f28f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:27:58.807127 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a36c0d-3f85-499c-831c-3f1914e69557 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:27:58.807415 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e33ef-faa6-4cca-9a58-750246f28f84 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:27:58.807699 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e33ef-faa6-4cca-9a58-750246f28f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:27:58.807971 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e33ef-faa6-4cca-9a58-750246f28f84 None admin] PATH_INFO: `/v3/users/13cde894f1744031872e9c62485bd552` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:27:58.809177 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e33ef-faa6-4cca-9a58-750246f28f84 None admin] RBAC: Authorizing `identity:get_user(user_id=13cde894f1744031872e9c62485bd552)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:27:58.809877 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:27:58.810672 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e33ef-faa6-4cca-9a58-750246f28f84 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:27:58.812685 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 9/17] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:27:58 2022] GET /identity/v3/users/13cde894f1744031872e9c62485bd552 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:27:58.817807 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e33ef-faa6-4cca-9a58-750246f28f84 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:27:58.833866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:27:58.913195 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a36c0d-3f85-499c-831c-3f1914e69557 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:27:58.921210 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e33ef-faa6-4cca-9a58-750246f28f84 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:27:58.947951 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2e1aa-0064-4a67-89d1-bbee42301ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:27:58.948744 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2e1aa-0064-4a67-89d1-bbee42301ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:27:58.949036 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2e1aa-0064-4a67-89d1-bbee42301ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:27:58.949343 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2e1aa-0064-4a67-89d1-bbee42301ee1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:27:58.954607 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffd627-2d27-4822-a658-cafec80ecf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:27:58.955400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffd627-2d27-4822-a658-cafec80ecf26 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:27:58.955733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffd627-2d27-4822-a658-cafec80ecf26 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:27:58.956017 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffd627-2d27-4822-a658-cafec80ecf26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:27:58.957280 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffd627-2d27-4822-a658-cafec80ecf26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:27:58.963403 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ffd627-2d27-4822-a658-cafec80ecf26 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:27:58.966361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 10/18] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:27:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:27:58.976515 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffd627-2d27-4822-a658-cafec80ecf26 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:27:58.981903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2e1aa-0064-4a67-89d1-bbee42301ee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:27:58.983484 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2e1aa-0064-4a67-89d1-bbee42301ee1 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:27:59.007290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-0ec2e1aa-0064-4a67-89d1-bbee42301ee1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:27:59.007290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:27:59.007290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:27:59.007290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:27:59.007290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:27:59.007290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:27:59.007290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:27:59.007290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:27:59.007290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:27:59.007290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:27:59.007290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:27:59.007290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:27:59.007290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:27:59.007290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:27:59.007290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:27:59.008157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:27:59.008157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:27:59.008157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:27:59.008157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:27:59.008157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:27:59.008157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:27:59.008157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:27:59.008157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:27:59.008157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:27:59.008157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:27:59.008157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:27:59.008157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:27:59.008157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:27:59.008157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:27:59.008157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:27:59.008157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:27:59.008157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:27:59.008933 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:27:59.008933 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:27:59.008933 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:27:59.008933 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:27:59.008933 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 9/19] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:27:59.014398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2e1aa-0064-4a67-89d1-bbee42301ee1 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:27:59.061573 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:27:59.073435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:27:59.081159 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffd627-2d27-4822-a658-cafec80ecf26 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:27:59.118038 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5814f-9fd4-4cdb-a6f4-a0634a30b581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:27:59.118241 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2e1aa-0064-4a67-89d1-bbee42301ee1 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:27:59.118687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5814f-9fd4-4cdb-a6f4-a0634a30b581 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:27:59.118970 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5814f-9fd4-4cdb-a6f4-a0634a30b581 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:27:59.119247 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5814f-9fd4-4cdb-a6f4-a0634a30b581 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:27:59.120075 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5814f-9fd4-4cdb-a6f4-a0634a30b581 None admin] RBAC: Adding query filter params (role.id=1e2bb0d759694428ada2b52285de933b, scope.domain.id=default, user.id=13cde894f1744031872e9c62485bd552) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:27:59.120998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5814f-9fd4-4cdb-a6f4-a0634a30b581 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:27:59.121862 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5814f-9fd4-4cdb-a6f4-a0634a30b581 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:27:59.128598 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 11/20] 10.222.0.44 () {56 vars in 1322 bytes} [Tue Jun 14 19:27:58 2022] GET /identity/v3/role_assignments?user.id=13cde894f1744031872e9c62485bd552&scope.domain.id=default&role.id=1e2bb0d759694428ada2b52285de933b => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:27:59.153746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710b1bc-ac33-4656-8661-7e6c6ab17903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:27:59.154436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710b1bc-ac33-4656-8661-7e6c6ab17903 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:27:59.154728 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710b1bc-ac33-4656-8661-7e6c6ab17903 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:27:59.155014 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710b1bc-ac33-4656-8661-7e6c6ab17903 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:27:59.155785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710b1bc-ac33-4656-8661-7e6c6ab17903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:27:59.156100 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710b1bc-ac33-4656-8661-7e6c6ab17903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:27:59.157581 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710b1bc-ac33-4656-8661-7e6c6ab17903 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:27:59.177742 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 10/21] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:01.703448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d71a6-6a05-48f1-892d-a8024600f4ad None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:01.704491 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d71a6-6a05-48f1-892d-a8024600f4ad None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:01.705063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709d71a6-6a05-48f1-892d-a8024600f4ad None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:01.706675 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 12/22] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:01.712802 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6279f5-7375-408e-999a-9ef27d10dc23 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:01.713691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6279f5-7375-408e-999a-9ef27d10dc23 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:01.714175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6279f5-7375-408e-999a-9ef27d10dc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:01.745728 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-1d6279f5-7375-408e-999a-9ef27d10dc23 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:01.747380 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-1d6279f5-7375-408e-999a-9ef27d10dc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:01.855032 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 11/23] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:01.898112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d71a6-6a05-48f1-892d-a8024600f4ad None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:01.922817 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cfe73-3e93-4452-b8c6-8dabc2f01e21 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:01.923450 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cfe73-3e93-4452-b8c6-8dabc2f01e21 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:01.923957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60cfe73-3e93-4452-b8c6-8dabc2f01e21 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:01.925572 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 12/24] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:28:01.930846 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1671e-b58c-4c3c-8a03-aaf20fc080b1 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:01.931400 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1671e-b58c-4c3c-8a03-aaf20fc080b1 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:01.931899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1671e-b58c-4c3c-8a03-aaf20fc080b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:01.955241 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-0cd1671e-b58c-4c3c-8a03-aaf20fc080b1 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:01.957544 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-0cd1671e-b58c-4c3c-8a03-aaf20fc080b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:02.061801 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:02.078212 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 13/25] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:02.091086 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709d71a6-6a05-48f1-892d-a8024600f4ad None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:02.128139 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1671e-b58c-4c3c-8a03-aaf20fc080b1 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:02.163852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00355f0-7cc1-4644-a8a6-55487eaef16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:02.164672 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00355f0-7cc1-4644-a8a6-55487eaef16b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:02.164965 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00355f0-7cc1-4644-a8a6-55487eaef16b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:02.165251 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00355f0-7cc1-4644-a8a6-55487eaef16b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:02.189344 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00355f0-7cc1-4644-a8a6-55487eaef16b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:02.198200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-c00355f0-7cc1-4644-a8a6-55487eaef16b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:28:02.198200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:02.198200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:02.198200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:02.198200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:02.198200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:02.198200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:02.198200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:02.198200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:02.198200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:02.198200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:02.198200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:02.198200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:02.198200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:02.198200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:02.198200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:02.199063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:02.199063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:02.199063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:02.199063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:02.199063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:02.199063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:02.199063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:02.199063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:02.199063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:02.199063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:02.199063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:02.199063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:02.199063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:02.199063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:02.199063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:02.199063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:02.199775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:02.199775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:02.199775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:02.199775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:02.199775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:02.199775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:02.199775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:02.199775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:02.199775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:02.199775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:02.199775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:28:02.199775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:02.211227 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 13/26] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:28:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:02.214732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5601a63-1f77-4d30-9cda-ad2027673107 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:02.216385 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5601a63-1f77-4d30-9cda-ad2027673107 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:02.216931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5601a63-1f77-4d30-9cda-ad2027673107 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:02.219636 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 14/27] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:02.226483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5601a63-1f77-4d30-9cda-ad2027673107 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:02.235724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:02.313512 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1671e-b58c-4c3c-8a03-aaf20fc080b1 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:02.360413 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9256a-e6cb-4ba5-bc03-7e1b2aae4b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:02.361503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9256a-e6cb-4ba5-bc03-7e1b2aae4b59 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:02.361957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9256a-e6cb-4ba5-bc03-7e1b2aae4b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:02.362406 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9256a-e6cb-4ba5-bc03-7e1b2aae4b59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:02.374360 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9256a-e6cb-4ba5-bc03-7e1b2aae4b59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:02.376083 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9256a-e6cb-4ba5-bc03-7e1b2aae4b59 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:02.408489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-4fd9256a-e6cb-4ba5-bc03-7e1b2aae4b59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:28:02.408489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:02.408489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:02.408489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:02.408489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:02.408489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:02.408489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:02.408489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:02.408489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:02.408489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:02.408489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:02.408489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:02.408489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:28:02.408489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:28:02.408489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:28:02.409537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:28:02.409537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:02.409537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:02.409537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:02.409537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:02.409537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:02.409537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:02.409537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:02.409537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:02.409537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:02.409537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:02.409537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:02.409537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:02.409537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:02.409537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:02.409537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:02.409537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:02.410319 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:28:02.410319 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:28:02.410319 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:28:02.410319 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:02.412826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 14/28] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:28:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:28:02.418775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2e503-9e19-4df8-9016-d9951ddef854 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:02.419327 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2e503-9e19-4df8-9016-d9951ddef854 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:02.419826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2e503-9e19-4df8-9016-d9951ddef854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:02.426039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5601a63-1f77-4d30-9cda-ad2027673107 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:02.439290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-20f2e503-9e19-4df8-9016-d9951ddef854 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:02.440757 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-20f2e503-9e19-4df8-9016-d9951ddef854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:02.476786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:02.484143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918882c-9eb3-4551-8fec-1e3688d3b96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:02.484819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918882c-9eb3-4551-8fec-1e3688d3b96f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:02.485106 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918882c-9eb3-4551-8fec-1e3688d3b96f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:02.485404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6918882c-9eb3-4551-8fec-1e3688d3b96f None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:02.486464 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918882c-9eb3-4551-8fec-1e3688d3b96f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:02.486773 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918882c-9eb3-4551-8fec-1e3688d3b96f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:02.488187 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6918882c-9eb3-4551-8fec-1e3688d3b96f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:02.508253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 15/29] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:02.510284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918882c-9eb3-4551-8fec-1e3688d3b96f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:02.585779 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 15/30] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:02.586698 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2e503-9e19-4df8-9016-d9951ddef854 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:02.597814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:02.633368 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6918882c-9eb3-4551-8fec-1e3688d3b96f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:02.672128 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a48a2-7d34-4dd6-8e8f-2eb9831ab2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:02.672797 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a48a2-7d34-4dd6-8e8f-2eb9831ab2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:02.673084 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a48a2-7d34-4dd6-8e8f-2eb9831ab2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:02.673365 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a48a2-7d34-4dd6-8e8f-2eb9831ab2b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:02.674117 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a48a2-7d34-4dd6-8e8f-2eb9831ab2b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:02.674426 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a48a2-7d34-4dd6-8e8f-2eb9831ab2b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:02.675945 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a48a2-7d34-4dd6-8e8f-2eb9831ab2b2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:02.695847 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 16/31] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:02.696964 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a48a2-7d34-4dd6-8e8f-2eb9831ab2b2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:02.745627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2e503-9e19-4df8-9016-d9951ddef854 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:02.786579 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c678c3-27be-415a-b3bc-840402044b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:02.788129 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c678c3-27be-415a-b3bc-840402044b6d None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:02.788476 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c678c3-27be-415a-b3bc-840402044b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:02.788755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c678c3-27be-415a-b3bc-840402044b6d None admin] PATH_INFO: `/v3/users/13cde894f1744031872e9c62485bd552` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:02.790512 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c678c3-27be-415a-b3bc-840402044b6d None admin] RBAC: Authorizing `identity:get_user(user_id=13cde894f1744031872e9c62485bd552)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:02.792330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c678c3-27be-415a-b3bc-840402044b6d None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:02.794171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 16/32] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:02 2022] GET /identity/v3/users/13cde894f1744031872e9c62485bd552 => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:02.795333 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7798ba-8195-4335-82bd-a03813510dff None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:02.795628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7798ba-8195-4335-82bd-a03813510dff None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:02.795907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7798ba-8195-4335-82bd-a03813510dff None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:02.797126 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 17/33] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:02.797896 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7798ba-8195-4335-82bd-a03813510dff None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:02.833923 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:02.852272 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a48a2-7d34-4dd6-8e8f-2eb9831ab2b2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:02.880634 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:02.890626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e14fc2-b297-4a43-8f20-7f26367eccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:02.891294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e14fc2-b297-4a43-8f20-7f26367eccf3 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:02.891581 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e14fc2-b297-4a43-8f20-7f26367eccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:02.891861 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e14fc2-b297-4a43-8f20-7f26367eccf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:02.892616 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e14fc2-b297-4a43-8f20-7f26367eccf3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:02.894067 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e14fc2-b297-4a43-8f20-7f26367eccf3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:02.917864 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7798ba-8195-4335-82bd-a03813510dff None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:02.957069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723cdc0-ad43-44b8-acca-b3205d339bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:02.958169 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723cdc0-ad43-44b8-acca-b3205d339bc6 None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:02.958660 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723cdc0-ad43-44b8-acca-b3205d339bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:02.959194 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f723cdc0-ad43-44b8-acca-b3205d339bc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:02.960827 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723cdc0-ad43-44b8-acca-b3205d339bc6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:02.962640 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f723cdc0-ad43-44b8-acca-b3205d339bc6 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:03.111898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 18/34] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jun 14 19:28:02 2022] POST /identity/v3/projects => generated 301 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:28:03.113120 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723cdc0-ad43-44b8-acca-b3205d339bc6 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:03.122868 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 17/35] 10.222.0.44 () {60 vars in 1131 bytes} [Tue Jun 14 19:28:02 2022] POST /identity/v3/roles => generated 219 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:28:03.124407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b4006-361c-4279-87a3-a6f173ae10f8 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:03.124704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b4006-361c-4279-87a3-a6f173ae10f8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:03.124987 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b4006-361c-4279-87a3-a6f173ae10f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:03.144390 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-bc2b4006-361c-4279-87a3-a6f173ae10f8 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:03.146136 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bc2b4006-361c-4279-87a3-a6f173ae10f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:03.219270 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:03.236599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 18/36] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:03.238112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206165b-50a7-4e54-b9af-ba8d792d03e1 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:03.245474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206165b-50a7-4e54-b9af-ba8d792d03e1 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:03.245474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c206165b-50a7-4e54-b9af-ba8d792d03e1 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:03.245474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 19/37] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:03.246578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64954485-00b5-433e-801b-909635d9dddb None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:03.246880 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64954485-00b5-433e-801b-909635d9dddb None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:03.247169 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64954485-00b5-433e-801b-909635d9dddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:03.265952 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f723cdc0-ad43-44b8-acca-b3205d339bc6 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:03.274972 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-64954485-00b5-433e-801b-909635d9dddb None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:03.278418 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-64954485-00b5-433e-801b-909635d9dddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:03.315727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eaaecb-a811-44de-8559-65d5b066c223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:03.317024 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaaecb-a811-44de-8559-65d5b066c223 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:03.317024 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaaecb-a811-44de-8559-65d5b066c223 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:03.317297 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eaaecb-a811-44de-8559-65d5b066c223 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:03.318850 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eaaecb-a811-44de-8559-65d5b066c223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:03.320755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eaaecb-a811-44de-8559-65d5b066c223 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:03.322656 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 19/38] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:28:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:03.323422 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eaaecb-a811-44de-8559-65d5b066c223 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:03.381634 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 20/39] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:03.383112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64954485-00b5-433e-801b-909635d9dddb None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:03.447367 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:03.519181 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64954485-00b5-433e-801b-909635d9dddb None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:03.560505 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93150ac3-8008-4c05-880a-ce3d5fdef98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:03.561418 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93150ac3-8008-4c05-880a-ce3d5fdef98d None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:03.561712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93150ac3-8008-4c05-880a-ce3d5fdef98d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:03.561994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93150ac3-8008-4c05-880a-ce3d5fdef98d None admin] PATH_INFO: `/v3/domains/default/users/13cde894f1744031872e9c62485bd552/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:03.564012 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93150ac3-8008-4c05-880a-ce3d5fdef98d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=13cde894f1744031872e9c62485bd552, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:03.565638 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93150ac3-8008-4c05-880a-ce3d5fdef98d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:03.579936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 21/40] 10.222.0.44 () {58 vars in 1361 bytes} [Tue Jun 14 19:28:03 2022] PUT /identity/v3/domains/default/users/13cde894f1744031872e9c62485bd552/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:28:03.580806 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93150ac3-8008-4c05-880a-ce3d5fdef98d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:03.586708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eaaecb-a811-44de-8559-65d5b066c223 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:03.626298 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa343198-3836-485c-b951-f0b6d6d198cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:03.628097 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa343198-3836-485c-b951-f0b6d6d198cf None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:03.628552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa343198-3836-485c-b951-f0b6d6d198cf None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:03.628873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa343198-3836-485c-b951-f0b6d6d198cf None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:03.629717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa343198-3836-485c-b951-f0b6d6d198cf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:03.631225 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa343198-3836-485c-b951-f0b6d6d198cf None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:03.648760 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1131 bytes} [Tue Jun 14 19:28:03 2022] POST /identity/v3/roles => generated 225 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:28:03.650166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c1e41-1661-43cf-b278-6f71e6688c78 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:03.650466 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c1e41-1661-43cf-b278-6f71e6688c78 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:03.650758 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c1e41-1661-43cf-b278-6f71e6688c78 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:03.652409 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 21/42] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:03.658363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4393e98-699e-4852-8477-76dcaed7d0ae None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:03.658663 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4393e98-699e-4852-8477-76dcaed7d0ae None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:03.658960 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4393e98-699e-4852-8477-76dcaed7d0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:03.676567 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:03.683240 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-c4393e98-699e-4852-8477-76dcaed7d0ae None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:03.684482 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c4393e98-699e-4852-8477-76dcaed7d0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:03.719924 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93150ac3-8008-4c05-880a-ce3d5fdef98d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:03.731272 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:03.773114 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25740b57-196e-43f3-b368-e041d02bcb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:03.773852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25740b57-196e-43f3-b368-e041d02bcb01 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:03.774140 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25740b57-196e-43f3-b368-e041d02bcb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:03.774424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25740b57-196e-43f3-b368-e041d02bcb01 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:03.775205 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25740b57-196e-43f3-b368-e041d02bcb01 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:03.776717 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25740b57-196e-43f3-b368-e041d02bcb01 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:03.795945 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 22/43] 10.222.0.44 () {60 vars in 1131 bytes} [Tue Jun 14 19:28:03 2022] POST /identity/v3/roles => generated 223 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:28:03.796659 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 22/44] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:03.826829 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25740b57-196e-43f3-b368-e041d02bcb01 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:03.951450 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25740b57-196e-43f3-b368-e041d02bcb01 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:03.990936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc12fcb-0997-474e-a2f3-22944b45b35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:03.991752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc12fcb-0997-474e-a2f3-22944b45b35f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:03.992048 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc12fcb-0997-474e-a2f3-22944b45b35f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:03.992334 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc12fcb-0997-474e-a2f3-22944b45b35f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:03.993590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc12fcb-0997-474e-a2f3-22944b45b35f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:03.995079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc12fcb-0997-474e-a2f3-22944b45b35f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:03.996888 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 23/45] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:28:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:04.002295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4393e98-699e-4852-8477-76dcaed7d0ae None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:04.107578 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4393e98-699e-4852-8477-76dcaed7d0ae None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:04.142179 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d90277-6264-401e-bdac-e4d3a32bb6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:04.142851 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d90277-6264-401e-bdac-e4d3a32bb6a3 None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:04.143141 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d90277-6264-401e-bdac-e4d3a32bb6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:04.143428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d90277-6264-401e-bdac-e4d3a32bb6a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:04.144158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d90277-6264-401e-bdac-e4d3a32bb6a3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:04.145643 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d90277-6264-401e-bdac-e4d3a32bb6a3 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:04.150721 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:04.171903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 23/46] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jun 14 19:28:04 2022] POST /identity/v3/projects => generated 312 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:28:05.782953 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fd0d9-1c32-4dce-9acc-2e59d8f4d18c None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:05.783473 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fd0d9-1c32-4dce-9acc-2e59d8f4d18c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:05.783575 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fd0d9-1c32-4dce-9acc-2e59d8f4d18c None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:05.784887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 24/47] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:05.790275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf692dc7-9278-4af5-b853-777550615111 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:05.790652 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf692dc7-9278-4af5-b853-777550615111 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:05.790852 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf692dc7-9278-4af5-b853-777550615111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:05.807618 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-cf692dc7-9278-4af5-b853-777550615111 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:05.808827 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-cf692dc7-9278-4af5-b853-777550615111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:05.877813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 24/48] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:05.901430 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fd0d9-1c32-4dce-9acc-2e59d8f4d18c None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:05.936826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:06.004300 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fd0d9-1c32-4dce-9acc-2e59d8f4d18c None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:06.038398 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d16df7-cdd7-4932-a7ac-b57fbebcdb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:06.039170 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d16df7-cdd7-4932-a7ac-b57fbebcdb2d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:06.039460 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d16df7-cdd7-4932-a7ac-b57fbebcdb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:06.039743 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d16df7-cdd7-4932-a7ac-b57fbebcdb2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:06.049795 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d16df7-cdd7-4932-a7ac-b57fbebcdb2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:06.058109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-09d16df7-cdd7-4932-a7ac-b57fbebcdb2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:28:06.058109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:06.058109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:06.058109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:06.058109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:06.058109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:06.058109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:06.058109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:06.058109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:06.058109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:06.058109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:06.058109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:06.058109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:06.058109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:06.058109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:06.058109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:06.059087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:06.059087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:06.059087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:06.059087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:06.059087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:06.059087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:06.059087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:06.059087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:06.059087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:06.059087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:06.059087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:06.059087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:06.059087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:06.059087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:06.059087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:06.059087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:06.059852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:06.059852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:06.059852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:06.059852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:06.059852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:06.059852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:06.059852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:06.059852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:06.059852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:06.059852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:06.059852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:28:06.059852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:06.059852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 25/49] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:28:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:06.065057 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf692dc7-9278-4af5-b853-777550615111 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:06.163879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf692dc7-9278-4af5-b853-777550615111 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:06.181061 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:06.198783 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc3255-5479-4826-8c15-53d1e5eff828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:06.199458 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc3255-5479-4826-8c15-53d1e5eff828 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:06.199749 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc3255-5479-4826-8c15-53d1e5eff828 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:06.200036 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc3255-5479-4826-8c15-53d1e5eff828 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:06.200789 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc3255-5479-4826-8c15-53d1e5eff828 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:06.201102 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc3255-5479-4826-8c15-53d1e5eff828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:06.202526 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc3255-5479-4826-8c15-53d1e5eff828 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:06.215792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 25/50] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:06.221637 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d16df7-cdd7-4932-a7ac-b57fbebcdb2d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:06.288917 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70feec-b2cb-4595-9ca6-d0fef2bb481b None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:06.289133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70feec-b2cb-4595-9ca6-d0fef2bb481b None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:06.289465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70feec-b2cb-4595-9ca6-d0fef2bb481b None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:06.290851 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 26/51] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:28:06.295777 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767d086-91d3-448a-b8e5-d77bc9024a14 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:06.296074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767d086-91d3-448a-b8e5-d77bc9024a14 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:06.296366 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767d086-91d3-448a-b8e5-d77bc9024a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:06.312464 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-e767d086-91d3-448a-b8e5-d77bc9024a14 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:06.313693 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e767d086-91d3-448a-b8e5-d77bc9024a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:06.319029 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:06.326131 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d16df7-cdd7-4932-a7ac-b57fbebcdb2d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:06.359430 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f6591-880d-4777-ae0d-ca73a6c53808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:06.360300 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f6591-880d-4777-ae0d-ca73a6c53808 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:06.360590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f6591-880d-4777-ae0d-ca73a6c53808 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:06.360874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f6591-880d-4777-ae0d-ca73a6c53808 None admin] PATH_INFO: `/v3/users/13cde894f1744031872e9c62485bd552` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:06.362076 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f6591-880d-4777-ae0d-ca73a6c53808 None admin] RBAC: Authorizing `identity:get_user(user_id=13cde894f1744031872e9c62485bd552)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:06.363540 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021f6591-880d-4777-ae0d-ca73a6c53808 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:06.365443 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 26/52] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:06 2022] GET /identity/v3/users/13cde894f1744031872e9c62485bd552 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:06.370710 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f6591-880d-4777-ae0d-ca73a6c53808 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:06.382424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 27/53] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:06.404788 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767d086-91d3-448a-b8e5-d77bc9024a14 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:06.470581 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f6591-880d-4777-ae0d-ca73a6c53808 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:06.502577 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767d086-91d3-448a-b8e5-d77bc9024a14 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:06.503194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3bbf3-c8e8-4480-ac88-8eb79fa92dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:06.503984 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3bbf3-c8e8-4480-ac88-8eb79fa92dcb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:06.504281 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3bbf3-c8e8-4480-ac88-8eb79fa92dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:06.504567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af3bbf3-c8e8-4480-ac88-8eb79fa92dcb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:06.506301 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3bbf3-c8e8-4480-ac88-8eb79fa92dcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:06.507748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af3bbf3-c8e8-4480-ac88-8eb79fa92dcb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:06.509388 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 27/54] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:28:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:06.514126 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:06.515232 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3bbf3-c8e8-4480-ac88-8eb79fa92dcb None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:06.542862 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcfe79-a6e9-4579-93df-09958ca9df70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:06.543629 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcfe79-a6e9-4579-93df-09958ca9df70 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:06.543927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcfe79-a6e9-4579-93df-09958ca9df70 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:06.544212 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcfe79-a6e9-4579-93df-09958ca9df70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:06.545641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcfe79-a6e9-4579-93df-09958ca9df70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:06.547104 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcfe79-a6e9-4579-93df-09958ca9df70 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:06.548735 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 28/55] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:28:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:06.549253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:06.555042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcfe79-a6e9-4579-93df-09958ca9df70 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:06.619162 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af3bbf3-c8e8-4480-ac88-8eb79fa92dcb None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:06.651524 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcfe79-a6e9-4579-93df-09958ca9df70 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:06.654159 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f654af9-8414-4571-9c5c-4debd4573e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:06.654807 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f654af9-8414-4571-9c5c-4debd4573e29 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:06.655099 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f654af9-8414-4571-9c5c-4debd4573e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:06.655382 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f654af9-8414-4571-9c5c-4debd4573e29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:06.656212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f654af9-8414-4571-9c5c-4debd4573e29 None admin] RBAC: Adding query filter params (role.id=1e2bb0d759694428ada2b52285de933b, scope.domain.id=default, user.id=13cde894f1744031872e9c62485bd552) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:06.656529 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f654af9-8414-4571-9c5c-4debd4573e29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:06.658013 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f654af9-8414-4571-9c5c-4debd4573e29 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:06.664684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 28/56] 10.222.0.44 () {56 vars in 1322 bytes} [Tue Jun 14 19:28:06 2022] GET /identity/v3/role_assignments?user.id=13cde894f1744031872e9c62485bd552&scope.domain.id=default&role.id=1e2bb0d759694428ada2b52285de933b => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:06.687044 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878830d-a5b4-4cbe-870d-bd463404ef01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:06.687728 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878830d-a5b4-4cbe-870d-bd463404ef01 None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:06.688019 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878830d-a5b4-4cbe-870d-bd463404ef01 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:06.688304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878830d-a5b4-4cbe-870d-bd463404ef01 None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:06.689042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878830d-a5b4-4cbe-870d-bd463404ef01 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:06.690569 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878830d-a5b4-4cbe-870d-bd463404ef01 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:06.717523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 29/57] 10.222.0.44 () {60 vars in 1140 bytes} [Tue Jun 14 19:28:06 2022] POST /identity/v3/projects => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:28:08.841283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e2031-2b71-4be9-986b-93fd15a77725 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:08.841756 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e2031-2b71-4be9-986b-93fd15a77725 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:08.841887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e2031-2b71-4be9-986b-93fd15a77725 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:08.843263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 29/58] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:08.848238 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d5271-c75c-461d-a11f-95eb0e675e94 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:08.848648 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d5271-c75c-461d-a11f-95eb0e675e94 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:08.848805 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d5271-c75c-461d-a11f-95eb0e675e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:08.866397 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-8c7d5271-c75c-461d-a11f-95eb0e675e94 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:08.867585 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-8c7d5271-c75c-461d-a11f-95eb0e675e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:08.890108 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:08.932833 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 30/59] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:08.956428 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e2031-2b71-4be9-986b-93fd15a77725 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:09.053425 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:09.061179 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e2031-2b71-4be9-986b-93fd15a77725 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:09.093682 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f70ee-8664-4cb2-abb0-cb429c66df80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:09.094412 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f70ee-8664-4cb2-abb0-cb429c66df80 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:09.094701 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f70ee-8664-4cb2-abb0-cb429c66df80 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:09.094984 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f70ee-8664-4cb2-abb0-cb429c66df80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:09.096144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f70ee-8664-4cb2-abb0-cb429c66df80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:09.097706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f70ee-8664-4cb2-abb0-cb429c66df80 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:09.099310 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 30/60] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:28:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:09.105368 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d5271-c75c-461d-a11f-95eb0e675e94 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:09.201629 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d5271-c75c-461d-a11f-95eb0e675e94 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:09.234422 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4db252-5cd8-4f05-ac40-d0e545cb533d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:09.235074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4db252-5cd8-4f05-ac40-d0e545cb533d None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:09.235359 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4db252-5cd8-4f05-ac40-d0e545cb533d None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:09.235636 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4db252-5cd8-4f05-ac40-d0e545cb533d None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:09.236344 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4db252-5cd8-4f05-ac40-d0e545cb533d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:09.237805 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4db252-5cd8-4f05-ac40-d0e545cb533d None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:09.262496 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 31/61] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jun 14 19:28:09 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:28:12.487557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d4148-19c0-4849-b069-2891333a9e48 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:12.488607 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d4148-19c0-4849-b069-2891333a9e48 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:12.489095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d4148-19c0-4849-b069-2891333a9e48 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:12.490749 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 31/62] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:12.506560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5822e-b1fe-4665-8ab4-9b3bdce3b09e None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:12.507106 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5822e-b1fe-4665-8ab4-9b3bdce3b09e None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:12.507106 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5822e-b1fe-4665-8ab4-9b3bdce3b09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:12.527844 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-92c5822e-b1fe-4665-8ab4-9b3bdce3b09e None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:12.529072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-92c5822e-b1fe-4665-8ab4-9b3bdce3b09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:12.544787 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:12.613231 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64564203-3149-4d9d-8157-8a950fb61d37 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:12.613592 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64564203-3149-4d9d-8157-8a950fb61d37 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:12.613835 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64564203-3149-4d9d-8157-8a950fb61d37 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:12.615963 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 32/63] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:12.621344 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3e55f-20cb-479f-be05-f29fd87deaff None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:12.621920 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3e55f-20cb-479f-be05-f29fd87deaff None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:12.622414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f3e55f-20cb-479f-be05-f29fd87deaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:12.625882 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 32/64] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:12.651258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-14f3e55f-20cb-479f-be05-f29fd87deaff None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:12.652464 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-14f3e55f-20cb-479f-be05-f29fd87deaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:12.658694 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5822e-b1fe-4665-8ab4-9b3bdce3b09e None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:12.756737 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 33/65] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:12.783753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3e55f-20cb-479f-be05-f29fd87deaff None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:12.820281 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5822e-b1fe-4665-8ab4-9b3bdce3b09e None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:12.867071 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7988e-22bb-45f5-a1c8-e4077f577e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:12.868161 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7988e-22bb-45f5-a1c8-e4077f577e47 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:12.870186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7988e-22bb-45f5-a1c8-e4077f577e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:12.870612 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7988e-22bb-45f5-a1c8-e4077f577e47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:12.897936 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7988e-22bb-45f5-a1c8-e4077f577e47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:12.912785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-5fe7988e-22bb-45f5-a1c8-e4077f577e47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:28:12.912785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:12.912785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:12.912785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:12.912785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:12.912785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:12.912785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:12.912785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:12.912785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:12.912785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:12.912785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:12.912785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:12.912785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:12.912785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:12.912785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:12.912785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:12.913898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:12.913898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:12.913898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:12.913898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:12.913898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:12.913898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:12.913898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:12.913898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:12.913898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:12.913898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:12.913898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:12.913898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:12.913898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:12.913898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:12.913898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:12.913898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:12.914828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:12.914828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:12.914828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:12.914828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:12.914828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:12.914828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:12.914828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:12.914828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:12.914828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:12.914828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:12.914828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:28:12.914828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:12.918064 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 33/66] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:28:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:28:12.919790 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcfb03-5f4d-46a3-b708-e3b81dd62c26 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:12.920227 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcfb03-5f4d-46a3-b708-e3b81dd62c26 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:12.921009 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edcfb03-5f4d-46a3-b708-e3b81dd62c26 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:12.922750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 34/67] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:12.923574 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edcfb03-5f4d-46a3-b708-e3b81dd62c26 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:12.934743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:12.965789 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:12.977105 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f3e55f-20cb-479f-be05-f29fd87deaff None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:13.023925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a0048-5dd2-416a-89a3-c3ce90912f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:13.025084 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a0048-5dd2-416a-89a3-c3ce90912f67 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:13.025609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a0048-5dd2-416a-89a3-c3ce90912f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:13.026113 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a0048-5dd2-416a-89a3-c3ce90912f67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:13.039267 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a0048-5dd2-416a-89a3-c3ce90912f67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:13.048769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-151a0048-5dd2-416a-89a3-c3ce90912f67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:13.048769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:13.048769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:13.048769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:13.048769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:13.048769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:13.048769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:13.048769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:13.048769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:13.048769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:13.048769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:13.048769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:13.048769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:13.048769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:13.048769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:13.048769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:13.049641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:13.049641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:13.049641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:13.049641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:13.049641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:13.049641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:13.049641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:13.049641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:13.049641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:13.049641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:13.049641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:13.049641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:13.049641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:13.049641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:13.049641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:13.049641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:13.050378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:13.050378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:13.050378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:13.050378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:13.050378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:13.050378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:13.050378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:13.050378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:13.050378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:13.050378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:13.050378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:13.050378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:13.052774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 34/68] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:13.054393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932bf50-9470-4ab0-b71e-a92943d84dc9 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:13.055035 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932bf50-9470-4ab0-b71e-a92943d84dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:13.055532 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932bf50-9470-4ab0-b71e-a92943d84dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:13.062103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edcfb03-5f4d-46a3-b708-e3b81dd62c26 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:13.078857 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-2932bf50-9470-4ab0-b71e-a92943d84dc9 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:13.080527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2932bf50-9470-4ab0-b71e-a92943d84dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:13.103115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b7905-d886-410c-a2e5-3d4e12f227c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:13.103805 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b7905-d886-410c-a2e5-3d4e12f227c1 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:13.104092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b7905-d886-410c-a2e5-3d4e12f227c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:13.104369 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b7905-d886-410c-a2e5-3d4e12f227c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:13.105534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b7905-d886-410c-a2e5-3d4e12f227c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:13.105638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b7905-d886-410c-a2e5-3d4e12f227c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:13.107009 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b7905-d886-410c-a2e5-3d4e12f227c1 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:13.122476 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 35/69] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:13.123284 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b7905-d886-410c-a2e5-3d4e12f227c1 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:13.161291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 35/70] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:13.161291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924642d8-2e2f-48cf-9368-7e88e270ff1b None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:13.161291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924642d8-2e2f-48cf-9368-7e88e270ff1b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:13.161291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924642d8-2e2f-48cf-9368-7e88e270ff1b None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:13.161291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 36/71] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:13.161291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924642d8-2e2f-48cf-9368-7e88e270ff1b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:13.200963 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:13.235303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b7905-d886-410c-a2e5-3d4e12f227c1 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:13.247876 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:13.267710 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924642d8-2e2f-48cf-9368-7e88e270ff1b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:13.269953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d048a-7a9f-4294-80ef-9c902fe7c71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:13.270624 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d048a-7a9f-4294-80ef-9c902fe7c71b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:13.270915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d048a-7a9f-4294-80ef-9c902fe7c71b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:13.271209 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d048a-7a9f-4294-80ef-9c902fe7c71b None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:13.271943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d048a-7a9f-4294-80ef-9c902fe7c71b None admin] RBAC: Adding query filter params (name=member) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:13.272253 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d048a-7a9f-4294-80ef-9c902fe7c71b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:13.273677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d048a-7a9f-4294-80ef-9c902fe7c71b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:13.281717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 36/72] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:13.282868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd70ce-0899-4e32-b2ca-80a0370bffff None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:13.283165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd70ce-0899-4e32-b2ca-80a0370bffff None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:13.283445 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd70ce-0899-4e32-b2ca-80a0370bffff None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:13.284693 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 37/73] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:13.285784 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d82bc1-aaf5-4cf7-a108-5741e43c6054 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:13.286038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d82bc1-aaf5-4cf7-a108-5741e43c6054 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:13.286322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d82bc1-aaf5-4cf7-a108-5741e43c6054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:13.303795 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-84d82bc1-aaf5-4cf7-a108-5741e43c6054 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:13.303948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24885030-5566-4f44-980c-05922c25ea17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:13.304824 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24885030-5566-4f44-980c-05922c25ea17 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:13.304994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-84d82bc1-aaf5-4cf7-a108-5741e43c6054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:13.305111 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24885030-5566-4f44-980c-05922c25ea17 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:13.305417 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24885030-5566-4f44-980c-05922c25ea17 None admin] PATH_INFO: `/v3/users/13cde894f1744031872e9c62485bd552` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:13.306614 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24885030-5566-4f44-980c-05922c25ea17 None admin] RBAC: Authorizing `identity:get_user(user_id=13cde894f1744031872e9c62485bd552)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:13.308075 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24885030-5566-4f44-980c-05922c25ea17 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:13.309739 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 37/74] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:13 2022] GET /identity/v3/users/13cde894f1744031872e9c62485bd552 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:13.311605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24885030-5566-4f44-980c-05922c25ea17 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:13.371353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 38/75] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:13.372801 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d82bc1-aaf5-4cf7-a108-5741e43c6054 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:13.420785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24885030-5566-4f44-980c-05922c25ea17 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:13.434172 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:13.455978 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9d411-9796-4a29-b8ee-89df1f3db3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:13.456779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9d411-9796-4a29-b8ee-89df1f3db3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:13.457063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9d411-9796-4a29-b8ee-89df1f3db3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:13.457342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9d411-9796-4a29-b8ee-89df1f3db3e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:13.467141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9d411-9796-4a29-b8ee-89df1f3db3e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:13.475313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-5bb9d411-9796-4a29-b8ee-89df1f3db3e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:13.475313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:13.475313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:13.475313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:13.475313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:13.475313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:13.475313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:13.475313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:13.475313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:13.475313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:13.475313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:13.475313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:13.475313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:13.475313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:13.475313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:13.475313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:13.476144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:13.476144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:13.476144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:13.476144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:13.476144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:13.476144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:13.476144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:13.476144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:13.476144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:13.476144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:13.476144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:13.476144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:13.476144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:13.476144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:13.476144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:13.476144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:13.477034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:13.477034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:13.477034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:13.477034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:13.477034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:13.477034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:13.477034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:13.477034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:13.477034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:13.477034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:13.477034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:13.477034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:13.477924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d82bc1-aaf5-4cf7-a108-5741e43c6054 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:13.477993 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 38/76] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:28:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:13.479856 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7363a-09bb-44ca-b9a7-24c6203958bd None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:13.480160 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7363a-09bb-44ca-b9a7-24c6203958bd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:13.480450 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7363a-09bb-44ca-b9a7-24c6203958bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:13.498033 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0be7363a-09bb-44ca-b9a7-24c6203958bd None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:13.499183 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0be7363a-09bb-44ca-b9a7-24c6203958bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:13.501860 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:13.511758 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbae70-9742-4c12-9414-c876c41a67e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:13.512638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbae70-9742-4c12-9414-c876c41a67e8 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:13.512914 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbae70-9742-4c12-9414-c876c41a67e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:13.513197 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbae70-9742-4c12-9414-c876c41a67e8 None admin] PATH_INFO: `/v3/users/8949be5666f94730b962f3ed654313b6` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:13.528569 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbae70-9742-4c12-9414-c876c41a67e8 None admin] RBAC: Authorizing `identity:get_user(user_id=8949be5666f94730b962f3ed654313b6)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:13.530069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbae70-9742-4c12-9414-c876c41a67e8 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:13.531837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 39/77] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:13 2022] GET /identity/v3/users/8949be5666f94730b962f3ed654313b6 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:13.532544 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbae70-9742-4c12-9414-c876c41a67e8 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:13.570914 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 39/78] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:13.571749 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7363a-09bb-44ca-b9a7-24c6203958bd None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:13.633471 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbae70-9742-4c12-9414-c876c41a67e8 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:13.650048 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:13.667587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935865f-eb5c-41fb-8c22-2e06f75c5f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:13.668255 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935865f-eb5c-41fb-8c22-2e06f75c5f93 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:13.668548 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935865f-eb5c-41fb-8c22-2e06f75c5f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:13.668837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935865f-eb5c-41fb-8c22-2e06f75c5f93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:13.681923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7363a-09bb-44ca-b9a7-24c6203958bd None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:13.714968 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7c16f-1da2-4063-b2a4-63af834796ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:13.715758 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7c16f-1da2-4063-b2a4-63af834796ec None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:13.716047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7c16f-1da2-4063-b2a4-63af834796ec None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:13.716329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc7c16f-1da2-4063-b2a4-63af834796ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:13.723709 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:13.727835 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc7c16f-1da2-4063-b2a4-63af834796ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:13.735627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-fcc7c16f-1da2-4063-b2a4-63af834796ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:13.735627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:13.735627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:13.735627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:13.735627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:13.735627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:13.735627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:13.735627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:13.735627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:13.735627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:13.735627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:13.735627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:13.735627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:13.735627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:13.735627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:13.735627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:13.736534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:13.736534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:13.736534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:13.736534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:13.736534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:13.736534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:13.736534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:13.736534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:13.736534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:13.736534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:13.736534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:13.736534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:13.736534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:13.736534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:13.736534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:13.736534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:13.743571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:13.743571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:13.743571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:13.743571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:13.743571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:13.743571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:13.743571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:13.743571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:13.743571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:13.743571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:13.743571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:13.743571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:13.743571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 40/79] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:13.743571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7c16f-1da2-4063-b2a4-63af834796ec None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:13.744241 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935865f-eb5c-41fb-8c22-2e06f75c5f93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:13.744241 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935865f-eb5c-41fb-8c22-2e06f75c5f93 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:13.843044 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 40/80] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:28:13.843569 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc7c16f-1da2-4063-b2a4-63af834796ec None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:13.843888 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935865f-eb5c-41fb-8c22-2e06f75c5f93 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:13.862616 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:13.878548 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1630055-28ce-41a7-a39f-245943a12690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:13.879219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1630055-28ce-41a7-a39f-245943a12690 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:13.879508 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1630055-28ce-41a7-a39f-245943a12690 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:13.879791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1630055-28ce-41a7-a39f-245943a12690 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:13.880543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1630055-28ce-41a7-a39f-245943a12690 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:13.880854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1630055-28ce-41a7-a39f-245943a12690 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:13.882301 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1630055-28ce-41a7-a39f-245943a12690 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:13.894980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 41/81] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:28:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:13.894980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1630055-28ce-41a7-a39f-245943a12690 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:13.950113 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935865f-eb5c-41fb-8c22-2e06f75c5f93 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:13.950268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:13.983775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5b28a-3dc0-43ec-9bb9-ce3a7434d9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:13.984424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5b28a-3dc0-43ec-9bb9-ce3a7434d9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:13.984714 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5b28a-3dc0-43ec-9bb9-ce3a7434d9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:13.984993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5b28a-3dc0-43ec-9bb9-ce3a7434d9c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:13.988335 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1630055-28ce-41a7-a39f-245943a12690 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:14.021328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22734c99-c458-4254-9c46-b2796c5f2e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:14.022213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22734c99-c458-4254-9c46-b2796c5f2e1e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:14.022498 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22734c99-c458-4254-9c46-b2796c5f2e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:14.022781 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22734c99-c458-4254-9c46-b2796c5f2e1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:14.023967 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22734c99-c458-4254-9c46-b2796c5f2e1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:14.025445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22734c99-c458-4254-9c46-b2796c5f2e1e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:14.027049 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 42/82] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:28:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:14.027812 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22734c99-c458-4254-9c46-b2796c5f2e1e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:14.059455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5b28a-3dc0-43ec-9bb9-ce3a7434d9c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:14.060938 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5b28a-3dc0-43ec-9bb9-ce3a7434d9c7 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:14.078841 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:14.126157 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22734c99-c458-4254-9c46-b2796c5f2e1e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:14.154111 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:14.159071 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 41/83] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:28:14.159902 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5b28a-3dc0-43ec-9bb9-ce3a7434d9c7 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:14.160106 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028b775-2b0c-4473-9f31-64c2073dbaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:14.160774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028b775-2b0c-4473-9f31-64c2073dbaee None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:14.161065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028b775-2b0c-4473-9f31-64c2073dbaee None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:14.161349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028b775-2b0c-4473-9f31-64c2073dbaee None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:14.162679 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028b775-2b0c-4473-9f31-64c2073dbaee None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:14.162994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028b775-2b0c-4473-9f31-64c2073dbaee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:14.164382 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028b775-2b0c-4473-9f31-64c2073dbaee None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:14.172916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 43/84] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:14.173898 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028b775-2b0c-4473-9f31-64c2073dbaee None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:14.259307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5b28a-3dc0-43ec-9bb9-ce3a7434d9c7 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:14.271812 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028b775-2b0c-4473-9f31-64c2073dbaee None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:14.276370 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:14.294096 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bc704-b0ef-40cb-a7cf-2da31de802bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:14.294991 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bc704-b0ef-40cb-a7cf-2da31de802bf None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:14.295282 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bc704-b0ef-40cb-a7cf-2da31de802bf None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:14.295558 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bc704-b0ef-40cb-a7cf-2da31de802bf None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:14.296729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bc704-b0ef-40cb-a7cf-2da31de802bf None admin] RBAC: Authorizing `identity:get_project(project_id=2a169bbfc64d4c459ba54854d70678e7)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:14.298200 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bc704-b0ef-40cb-a7cf-2da31de802bf None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:14.300060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 42/85] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:14 2022] GET /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:14.300608 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bc704-b0ef-40cb-a7cf-2da31de802bf None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:14.311177 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc04b75-970e-45fe-8073-85747d4028a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:14.312054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc04b75-970e-45fe-8073-85747d4028a1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:14.312341 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc04b75-970e-45fe-8073-85747d4028a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:14.312621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc04b75-970e-45fe-8073-85747d4028a1 None admin] PATH_INFO: `/v3/users/8949be5666f94730b962f3ed654313b6` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:14.313834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc04b75-970e-45fe-8073-85747d4028a1 None admin] RBAC: Authorizing `identity:get_user(user_id=8949be5666f94730b962f3ed654313b6)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:14.315292 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc04b75-970e-45fe-8073-85747d4028a1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:14.316920 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 44/86] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:14 2022] GET /identity/v3/users/8949be5666f94730b962f3ed654313b6 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:14.322111 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc04b75-970e-45fe-8073-85747d4028a1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:14.379818 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:14.398695 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bc704-b0ef-40cb-a7cf-2da31de802bf None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:14.421630 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc04b75-970e-45fe-8073-85747d4028a1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:14.433160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319a188-ca1f-4f27-ac74-bb881fbef4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:14.433861 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319a188-ca1f-4f27-ac74-bb881fbef4de None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:14.434158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319a188-ca1f-4f27-ac74-bb881fbef4de None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:14.434438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319a188-ca1f-4f27-ac74-bb881fbef4de None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:14.435152 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319a188-ca1f-4f27-ac74-bb881fbef4de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:14.436607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319a188-ca1f-4f27-ac74-bb881fbef4de None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:14.455785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0e5c1-6ba7-489a-8e71-b39f776f3a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:14.455968 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 43/87] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jun 14 19:28:14 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:28:14.456643 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0e5c1-6ba7-489a-8e71-b39f776f3a0d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:14.456739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319a188-ca1f-4f27-ac74-bb881fbef4de None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:14.456932 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0e5c1-6ba7-489a-8e71-b39f776f3a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:14.457289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0e5c1-6ba7-489a-8e71-b39f776f3a0d None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:14.458642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0e5c1-6ba7-489a-8e71-b39f776f3a0d None admin] RBAC: Authorizing `identity:get_project(project_id=2a169bbfc64d4c459ba54854d70678e7)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:14.460121 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0e5c1-6ba7-489a-8e71-b39f776f3a0d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:14.468198 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 45/88] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:14 2022] GET /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:14.468198 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0e5c1-6ba7-489a-8e71-b39f776f3a0d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:14.508077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:14.584761 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319a188-ca1f-4f27-ac74-bb881fbef4de None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:14.596685 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0e5c1-6ba7-489a-8e71-b39f776f3a0d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:14.626027 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518807e-fd50-4059-afc5-df7a96cb88c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:14.626745 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:14.627325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518807e-fd50-4059-afc5-df7a96cb88c7 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:14.627638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518807e-fd50-4059-afc5-df7a96cb88c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:14.627825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518807e-fd50-4059-afc5-df7a96cb88c7 None admin] PATH_INFO: `/v3/users/8949be5666f94730b962f3ed654313b6` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:14.629466 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518807e-fd50-4059-afc5-df7a96cb88c7 None admin] RBAC: Authorizing `identity:get_user(user_id=8949be5666f94730b962f3ed654313b6)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:14.631674 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518807e-fd50-4059-afc5-df7a96cb88c7 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:14.632792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 44/89] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:14 2022] GET /identity/v3/users/8949be5666f94730b962f3ed654313b6 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:14.633633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518807e-fd50-4059-afc5-df7a96cb88c7 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:14.643113 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb453289-65c5-4905-b9bc-9e9536f96ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:14.643783 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb453289-65c5-4905-b9bc-9e9536f96ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:14.644096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb453289-65c5-4905-b9bc-9e9536f96ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:14.644375 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb453289-65c5-4905-b9bc-9e9536f96ff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:14.645215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb453289-65c5-4905-b9bc-9e9536f96ff4 None admin] RBAC: Adding query filter params (role.id=1e2bb0d759694428ada2b52285de933b, scope.project.id=2a169bbfc64d4c459ba54854d70678e7, user.id=13cde894f1744031872e9c62485bd552) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:14.645565 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb453289-65c5-4905-b9bc-9e9536f96ff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:14.647293 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb453289-65c5-4905-b9bc-9e9536f96ff4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:14.653356 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 46/90] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:28:14 2022] GET /identity/v3/role_assignments?user.id=13cde894f1744031872e9c62485bd552&scope.project.id=2a169bbfc64d4c459ba54854d70678e7&role.id=1e2bb0d759694428ada2b52285de933b => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:14.654227 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb453289-65c5-4905-b9bc-9e9536f96ff4 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:14.781332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518807e-fd50-4059-afc5-df7a96cb88c7 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:14.794447 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:14.801001 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb453289-65c5-4905-b9bc-9e9536f96ff4 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:14.833117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b91c41-2383-4f34-ba1d-6ed058e12248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:14.833858 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b91c41-2383-4f34-ba1d-6ed058e12248 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:14.834151 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b91c41-2383-4f34-ba1d-6ed058e12248 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:14.834439 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b91c41-2383-4f34-ba1d-6ed058e12248 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:14.849683 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961c85b-57c7-4768-82c9-17e16c015342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:14.850419 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961c85b-57c7-4768-82c9-17e16c015342 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:14.850811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961c85b-57c7-4768-82c9-17e16c015342 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:14.851082 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a961c85b-57c7-4768-82c9-17e16c015342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:14.852085 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961c85b-57c7-4768-82c9-17e16c015342 None admin] RBAC: Adding query filter params (role.id=bf1733d36314409c80cd50b2268834b1, scope.project.id=2a169bbfc64d4c459ba54854d70678e7, user.id=8949be5666f94730b962f3ed654313b6) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:14.852455 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961c85b-57c7-4768-82c9-17e16c015342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:14.855233 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a961c85b-57c7-4768-82c9-17e16c015342 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:14.861700 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 47/91] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:28:14 2022] GET /identity/v3/role_assignments?user.id=8949be5666f94730b962f3ed654313b6&scope.project.id=2a169bbfc64d4c459ba54854d70678e7&role.id=bf1733d36314409c80cd50b2268834b1 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:14.862354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961c85b-57c7-4768-82c9-17e16c015342 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:14.925888 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b91c41-2383-4f34-ba1d-6ed058e12248 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:14.928112 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b91c41-2383-4f34-ba1d-6ed058e12248 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:14.935254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:14.992366 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a961c85b-57c7-4768-82c9-17e16c015342 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:15.032909 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee19f89-fa46-4a4a-ac0d-197472bae3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:15.033662 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee19f89-fa46-4a4a-ac0d-197472bae3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:15.033952 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee19f89-fa46-4a4a-ac0d-197472bae3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:15.034288 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee19f89-fa46-4a4a-ac0d-197472bae3d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:15.094460 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 45/92] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:28:15.101893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b91c41-2383-4f34-ba1d-6ed058e12248 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:15.117737 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:15.119547 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee19f89-fa46-4a4a-ac0d-197472bae3d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:15.121145 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee19f89-fa46-4a4a-ac0d-197472bae3d9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:15.233843 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:15.234214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 48/93] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:28:15.242543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee19f89-fa46-4a4a-ac0d-197472bae3d9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:15.303392 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b91c41-2383-4f34-ba1d-6ed058e12248 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:15.362148 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee19f89-fa46-4a4a-ac0d-197472bae3d9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:15.399686 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4edebc-9ebe-4997-adcd-d3200c4da3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:15.400569 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4edebc-9ebe-4997-adcd-d3200c4da3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:15.400860 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4edebc-9ebe-4997-adcd-d3200c4da3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:15.401139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4edebc-9ebe-4997-adcd-d3200c4da3f3 None admin] PATH_INFO: `/v3/projects/e6ac8f5603484012a5ae8a6f3edd4a52` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:15.402438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4edebc-9ebe-4997-adcd-d3200c4da3f3 None admin] RBAC: Authorizing `identity:get_project(project_id=e6ac8f5603484012a5ae8a6f3edd4a52)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:15.403922 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4edebc-9ebe-4997-adcd-d3200c4da3f3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:15.405884 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 49/94] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:15 2022] GET /identity/v3/projects/e6ac8f5603484012a5ae8a6f3edd4a52 => generated 312 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:15.412098 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545972e-f93f-4b15-8646-dad4f588d54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:15.412991 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545972e-f93f-4b15-8646-dad4f588d54a None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:15.413284 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545972e-f93f-4b15-8646-dad4f588d54a None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:15.413602 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545972e-f93f-4b15-8646-dad4f588d54a None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:15.414309 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4edebc-9ebe-4997-adcd-d3200c4da3f3 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:15.414927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545972e-f93f-4b15-8646-dad4f588d54a None admin] RBAC: Authorizing `identity:get_project(project_id=2a169bbfc64d4c459ba54854d70678e7)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:15.416659 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e545972e-f93f-4b15-8646-dad4f588d54a None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:15.418597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 46/95] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:15 2022] GET /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7 => generated 298 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:15.424614 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545972e-f93f-4b15-8646-dad4f588d54a None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:15.460490 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:15.577211 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:15.608206 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4edebc-9ebe-4997-adcd-d3200c4da3f3 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:15.637294 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545972e-f93f-4b15-8646-dad4f588d54a None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:15.671369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735b196-a3a4-4423-8fb4-10fbdcd176a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:15.672705 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735b196-a3a4-4423-8fb4-10fbdcd176a9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:15.673220 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735b196-a3a4-4423-8fb4-10fbdcd176a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:15.673725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735b196-a3a4-4423-8fb4-10fbdcd176a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:15.674771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735b196-a3a4-4423-8fb4-10fbdcd176a9 None admin] RBAC: Adding query filter params (role.id=bf1733d36314409c80cd50b2268834b1, scope.project.id=e6ac8f5603484012a5ae8a6f3edd4a52, user.id=8949be5666f94730b962f3ed654313b6) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:15.675289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735b196-a3a4-4423-8fb4-10fbdcd176a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:15.676950 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735b196-a3a4-4423-8fb4-10fbdcd176a9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:15.684219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 50/96] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:28:15 2022] GET /identity/v3/role_assignments?user.id=8949be5666f94730b962f3ed654313b6&scope.project.id=e6ac8f5603484012a5ae8a6f3edd4a52&role.id=bf1733d36314409c80cd50b2268834b1 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:15.719174 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d14b16-fcb9-461d-8c16-bd5c9e71b57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:15.719866 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d14b16-fcb9-461d-8c16-bd5c9e71b57f None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:15.720155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d14b16-fcb9-461d-8c16-bd5c9e71b57f None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:15.720437 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d14b16-fcb9-461d-8c16-bd5c9e71b57f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:15.721295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d14b16-fcb9-461d-8c16-bd5c9e71b57f None admin] RBAC: Adding query filter params (role.id=1302d95e46b4422d84f581f8838d5aac, scope.project.id=2a169bbfc64d4c459ba54854d70678e7, user.id=8949be5666f94730b962f3ed654313b6) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:15.721644 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d14b16-fcb9-461d-8c16-bd5c9e71b57f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:15.723113 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d14b16-fcb9-461d-8c16-bd5c9e71b57f None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:15.736827 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 47/97] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:28:15 2022] GET /identity/v3/role_assignments?user.id=8949be5666f94730b962f3ed654313b6&scope.project.id=2a169bbfc64d4c459ba54854d70678e7&role.id=1302d95e46b4422d84f581f8838d5aac => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:17.319906 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f5715-67e4-46c8-b77e-0b5676405f09 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:17.320425 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f5715-67e4-46c8-b77e-0b5676405f09 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:17.320498 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f5715-67e4-46c8-b77e-0b5676405f09 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:17.322167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 51/98] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:17.327808 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfc399-2849-44de-9e80-e082ccf689f1 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:17.328323 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfc399-2849-44de-9e80-e082ccf689f1 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:17.328399 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfc399-2849-44de-9e80-e082ccf689f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:17.347425 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-0bcfc399-2849-44de-9e80-e082ccf689f1 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:17.348662 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-0bcfc399-2849-44de-9e80-e082ccf689f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:17.448498 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 48/99] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:17.484571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f5715-67e4-46c8-b77e-0b5676405f09 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:17.598897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:17.613702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f5715-67e4-46c8-b77e-0b5676405f09 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:17.659355 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1453538-a294-43e2-95e3-e3068a569656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:17.660218 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1453538-a294-43e2-95e3-e3068a569656 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:17.660512 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1453538-a294-43e2-95e3-e3068a569656 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:17.660792 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1453538-a294-43e2-95e3-e3068a569656 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:17.674315 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1453538-a294-43e2-95e3-e3068a569656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:17.685650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-e1453538-a294-43e2-95e3-e3068a569656 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 19:28:17.685650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:17.685650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:17.685650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:17.685650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:17.685650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:17.685650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:17.685650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:17.685650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:17.685650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:17.685650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:17.685650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:17.685650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:17.685650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:17.685650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:17.685650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:17.686486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:17.686486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:17.686486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:17.686486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:17.686486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:17.686486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:17.686486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:17.686486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:17.686486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:17.686486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:17.686486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:17.686486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:17.686486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:17.686486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:17.686486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:17.686486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:17.687217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:17.687217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:17.687217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:17.687217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:17.687217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:17.687217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:17.687217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:17.687217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:17.687217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:17.687217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:17.687217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 19:28:17.687217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:17.687217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 52/100] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:17.694446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfc399-2849-44de-9e80-e082ccf689f1 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:17.785126 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:17.819836 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfc399-2849-44de-9e80-e082ccf689f1 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:17.858296 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9c182-6c6f-4dc0-88ca-bf230b95d57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:17.859245 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9c182-6c6f-4dc0-88ca-bf230b95d57e None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:17.859680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9c182-6c6f-4dc0-88ca-bf230b95d57e None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:17.860117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9c182-6c6f-4dc0-88ca-bf230b95d57e None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:17.861044 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9c182-6c6f-4dc0-88ca-bf230b95d57e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:17.861546 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9c182-6c6f-4dc0-88ca-bf230b95d57e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:17.863150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9c182-6c6f-4dc0-88ca-bf230b95d57e None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:17.873697 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 49/101] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:17.882783 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1453538-a294-43e2-95e3-e3068a569656 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:17.920398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9106392-fc6c-45d8-86af-672b7883312e None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:17.920910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9106392-fc6c-45d8-86af-672b7883312e None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:17.921361 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9106392-fc6c-45d8-86af-672b7883312e None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:17.922901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 50/102] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:28:17.928154 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee52050-a38a-4161-ae55-f0ddbd18254d None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:17.928611 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee52050-a38a-4161-ae55-f0ddbd18254d None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:17.929039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee52050-a38a-4161-ae55-f0ddbd18254d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:17.946030 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-1ee52050-a38a-4161-ae55-f0ddbd18254d None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:17.947428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-1ee52050-a38a-4161-ae55-f0ddbd18254d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:18.023097 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 51/103] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:18.042347 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1453538-a294-43e2-95e3-e3068a569656 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:18.046970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee52050-a38a-4161-ae55-f0ddbd18254d None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:18.112934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:18.113842 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec464180-5e34-4c43-908f-8bf7bfafac63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:18.115258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec464180-5e34-4c43-908f-8bf7bfafac63 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:18.115738 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec464180-5e34-4c43-908f-8bf7bfafac63 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:18.116168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec464180-5e34-4c43-908f-8bf7bfafac63 None admin] PATH_INFO: `/v3/users/f9b7faf2dac248948b5572aa33781ed1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:18.138130 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec464180-5e34-4c43-908f-8bf7bfafac63 None admin] RBAC: Authorizing `identity:get_user(user_id=f9b7faf2dac248948b5572aa33781ed1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:18.139636 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec464180-5e34-4c43-908f-8bf7bfafac63 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:18.141570 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 53/104] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:17 2022] GET /identity/v3/users/f9b7faf2dac248948b5572aa33781ed1 => generated 289 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:18.147333 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec464180-5e34-4c43-908f-8bf7bfafac63 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:18.154924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee52050-a38a-4161-ae55-f0ddbd18254d None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:18.162783 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:18.192872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6a4a-8473-4f92-9c54-eaf7345f7eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:18.193705 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6a4a-8473-4f92-9c54-eaf7345f7eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:18.193998 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6a4a-8473-4f92-9c54-eaf7345f7eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:18.194294 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6a4a-8473-4f92-9c54-eaf7345f7eb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:18.195465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e6a4a-8473-4f92-9c54-eaf7345f7eb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:18.196923 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e6a4a-8473-4f92-9c54-eaf7345f7eb8 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:18.203123 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 52/105] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:28:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:18.204355 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6a4a-8473-4f92-9c54-eaf7345f7eb8 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:18.310880 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6a4a-8473-4f92-9c54-eaf7345f7eb8 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:18.343077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:18.343737 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec464180-5e34-4c43-908f-8bf7bfafac63 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:18.358304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22927968-ec74-4fe1-8198-5b544d50ade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:18.359212 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22927968-ec74-4fe1-8198-5b544d50ade9 None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:18.359643 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22927968-ec74-4fe1-8198-5b544d50ade9 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:18.360089 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22927968-ec74-4fe1-8198-5b544d50ade9 None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:18.360977 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22927968-ec74-4fe1-8198-5b544d50ade9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:18.362487 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22927968-ec74-4fe1-8198-5b544d50ade9 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:18.382573 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977fefb-caf8-40bd-80f9-1e1e100f890e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:18.383587 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977fefb-caf8-40bd-80f9-1e1e100f890e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:18.384107 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977fefb-caf8-40bd-80f9-1e1e100f890e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:18.384648 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977fefb-caf8-40bd-80f9-1e1e100f890e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:18.420189 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 53/106] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jun 14 19:28:18 2022] POST /identity/v3/projects => generated 302 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:28:18.472694 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977fefb-caf8-40bd-80f9-1e1e100f890e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:18.475020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977fefb-caf8-40bd-80f9-1e1e100f890e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:18.484758 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:18.612614 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 54/107] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 14 19:28:18.617237 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c37be-f573-40b0-9cc3-9974411b5340 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:18.617590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94999e1a-b7c7-469a-bd90-4ff1c84dd8c1 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:18.617590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94999e1a-b7c7-469a-bd90-4ff1c84dd8c1 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:18.617839 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94999e1a-b7c7-469a-bd90-4ff1c84dd8c1 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:18.618430 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c37be-f573-40b0-9cc3-9974411b5340 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:18.618934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c37be-f573-40b0-9cc3-9974411b5340 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:18.619221 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 55/108] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:18.621495 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94999e1a-b7c7-469a-bd90-4ff1c84dd8c1 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:18.623303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 54/109] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:18.628777 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857fe45-6ff0-4d03-a76f-51798641578b None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:18.629365 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857fe45-6ff0-4d03-a76f-51798641578b None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:18.629877 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857fe45-6ff0-4d03-a76f-51798641578b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:18.655091 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-8857fe45-6ff0-4d03-a76f-51798641578b None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:18.656298 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-8857fe45-6ff0-4d03-a76f-51798641578b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:18.736222 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 55/110] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:18.738105 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812421e-3104-4470-8c9e-aff4cd168086 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:18.738616 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812421e-3104-4470-8c9e-aff4cd168086 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:18.739094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812421e-3104-4470-8c9e-aff4cd168086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:18.757169 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-0812421e-3104-4470-8c9e-aff4cd168086 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:18.760303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-0812421e-3104-4470-8c9e-aff4cd168086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:18.777423 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94999e1a-b7c7-469a-bd90-4ff1c84dd8c1 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:18.789802 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:18.839320 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 56/111] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:18.840171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812421e-3104-4470-8c9e-aff4cd168086 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:18.842079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55559d15-8728-4d9b-b6cd-36661e3ed3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:18.843424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55559d15-8728-4d9b-b6cd-36661e3ed3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:18.844844 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55559d15-8728-4d9b-b6cd-36661e3ed3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:18.845333 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55559d15-8728-4d9b-b6cd-36661e3ed3b0 None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:18.846692 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55559d15-8728-4d9b-b6cd-36661e3ed3b0 None admin] RBAC: Authorizing `identity:get_project(project_id=2a169bbfc64d4c459ba54854d70678e7)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:18.848304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55559d15-8728-4d9b-b6cd-36661e3ed3b0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:18.851273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 56/112] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:18 2022] GET /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:18.857591 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55559d15-8728-4d9b-b6cd-36661e3ed3b0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:18.904388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:18.980977 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812421e-3104-4470-8c9e-aff4cd168086 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:18.996697 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55559d15-8728-4d9b-b6cd-36661e3ed3b0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:19.027487 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cd546-7840-41f9-a123-531fd927f1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:19.028359 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cd546-7840-41f9-a123-531fd927f1ef None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:19.029168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cd546-7840-41f9-a123-531fd927f1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:19.029507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cd546-7840-41f9-a123-531fd927f1ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:19.049247 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604fc53-3d4b-4816-aa4e-574c2907727e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:19.049247 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604fc53-3d4b-4816-aa4e-574c2907727e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:19.049247 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604fc53-3d4b-4816-aa4e-574c2907727e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:19.049247 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604fc53-3d4b-4816-aa4e-574c2907727e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:19.049733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604fc53-3d4b-4816-aa4e-574c2907727e None admin] RBAC: Adding query filter params (role.id=04bbf2f8d56744159d8dac700dde4379, scope.project.id=2a169bbfc64d4c459ba54854d70678e7, user.id=f9b7faf2dac248948b5572aa33781ed1) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:19.049982 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604fc53-3d4b-4816-aa4e-574c2907727e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:19.051649 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604fc53-3d4b-4816-aa4e-574c2907727e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:19.054885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634cd546-7840-41f9-a123-531fd927f1ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:19.064335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-634cd546-7840-41f9-a123-531fd927f1ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:19.064335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:19.064335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:19.064335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:19.064335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:19.064335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:19.064335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:19.064335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:19.064335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:19.064335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:19.064335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:19.064335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:19.064335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:19.064335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:19.064335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:19.064335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:19.065287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:19.065287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:19.065287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:19.065287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:19.065287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:19.065287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:19.065287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:19.065287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:19.065287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:19.065287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:19.065287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:19.065287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:19.065287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:19.065287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:19.065287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:19.065287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:19.066073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:19.066073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:19.066073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:19.066073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:19.066073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:19.066073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:19.066073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:19.066073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:19.066073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:19.066073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:19.066073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:19.066073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:19.066680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 57/113] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:28:18 2022] GET /identity/v3/role_assignments?user.id=f9b7faf2dac248948b5572aa33781ed1&scope.project.id=2a169bbfc64d4c459ba54854d70678e7&role.id=04bbf2f8d56744159d8dac700dde4379 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:19.066680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604fc53-3d4b-4816-aa4e-574c2907727e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:19.069942 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 57/114] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:19.071655 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20837e57-5099-437f-a4b7-e88a86308d4d None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:19.072170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20837e57-5099-437f-a4b7-e88a86308d4d None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:19.072660 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20837e57-5099-437f-a4b7-e88a86308d4d None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:19.074442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 58/115] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:19.076469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20837e57-5099-437f-a4b7-e88a86308d4d None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:19.122881 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:19.203474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604fc53-3d4b-4816-aa4e-574c2907727e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:19.208475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20837e57-5099-437f-a4b7-e88a86308d4d None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:19.212440 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:19.246360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199e2a8-20e1-459e-826f-102c49a51489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:19.247188 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199e2a8-20e1-459e-826f-102c49a51489 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:19.247477 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199e2a8-20e1-459e-826f-102c49a51489 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:19.247755 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199e2a8-20e1-459e-826f-102c49a51489 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:19.250722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8e20ec-95b5-4ec1-a4fa-00d9f8bb9beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:19.251686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e20ec-95b5-4ec1-a4fa-00d9f8bb9beb None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:19.252189 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e20ec-95b5-4ec1-a4fa-00d9f8bb9beb None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:19.252688 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8e20ec-95b5-4ec1-a4fa-00d9f8bb9beb None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:19.253729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e20ec-95b5-4ec1-a4fa-00d9f8bb9beb None admin] RBAC: Adding query filter params (name=member) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:19.254260 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e20ec-95b5-4ec1-a4fa-00d9f8bb9beb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:19.256177 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8e20ec-95b5-4ec1-a4fa-00d9f8bb9beb None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:19.262483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199e2a8-20e1-459e-826f-102c49a51489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:19.266321 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 59/116] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:19.267821 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad6a8e-c876-4f84-8b2b-fd816199ebe7 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:19.268329 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad6a8e-c876-4f84-8b2b-fd816199ebe7 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:19.268813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad6a8e-c876-4f84-8b2b-fd816199ebe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:19.272402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-6199e2a8-20e1-459e-826f-102c49a51489 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:28:19.272402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:19.272402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:19.272402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:19.272402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:19.272402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:19.272402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:19.272402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:19.272402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:19.272402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:19.272402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:19.272402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:19.272402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:19.272402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:19.272402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:19.272402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:19.273259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:19.273259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:19.273259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:19.273259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:19.273259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:19.273259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:19.273259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:19.273259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:19.273259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:19.273259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:19.273259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:19.273259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:19.273259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:19.273259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:19.273259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:19.273259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:19.274329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:19.274329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:19.274329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:19.274329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:19.274329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:19.274329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:19.274329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:19.274329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:19.274329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:19.274329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:19.274329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:28:19.274329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:19.274329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 58/117] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:28:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:19.275172 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c4757-f2ed-453a-8cef-d87b7056e621 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:19.275410 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c4757-f2ed-453a-8cef-d87b7056e621 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:19.275748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c4757-f2ed-453a-8cef-d87b7056e621 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:19.277027 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 59/118] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:19.281802 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c4757-f2ed-453a-8cef-d87b7056e621 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:19.303088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-07ad6a8e-c876-4f84-8b2b-fd816199ebe7 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:19.305023 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-07ad6a8e-c876-4f84-8b2b-fd816199ebe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:19.385842 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 60/119] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:19.385842 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad6a8e-c876-4f84-8b2b-fd816199ebe7 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:19.421484 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:19.427022 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c4757-f2ed-453a-8cef-d87b7056e621 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:19.466720 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52557aa-6b4c-4f3a-af95-8c208f046cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:19.467849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52557aa-6b4c-4f3a-af95-8c208f046cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:19.468237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52557aa-6b4c-4f3a-af95-8c208f046cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:19.468648 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52557aa-6b4c-4f3a-af95-8c208f046cc5 None admin] PATH_INFO: `/v3/users/8949be5666f94730b962f3ed654313b6` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:19.470742 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52557aa-6b4c-4f3a-af95-8c208f046cc5 None admin] RBAC: Authorizing `identity:get_user(user_id=8949be5666f94730b962f3ed654313b6)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:19.472710 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52557aa-6b4c-4f3a-af95-8c208f046cc5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:19.475745 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 60/120] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:19 2022] GET /identity/v3/users/8949be5666f94730b962f3ed654313b6 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:19.481654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54c319-71d2-4c63-b8c9-7234a44973b0 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:19.481961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54c319-71d2-4c63-b8c9-7234a44973b0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:19.484409 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54c319-71d2-4c63-b8c9-7234a44973b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:19.505243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-da54c319-71d2-4c63-b8c9-7234a44973b0 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:19.506772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-da54c319-71d2-4c63-b8c9-7234a44973b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:19.519554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:19.528955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad6a8e-c876-4f84-8b2b-fd816199ebe7 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:19.573427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb69ab-9b0e-4777-94e8-8954e2ace728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:19.574432 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb69ab-9b0e-4777-94e8-8954e2ace728 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:19.575315 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb69ab-9b0e-4777-94e8-8954e2ace728 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:19.575781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb69ab-9b0e-4777-94e8-8954e2ace728 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:19.576992 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb69ab-9b0e-4777-94e8-8954e2ace728 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:19.577500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb69ab-9b0e-4777-94e8-8954e2ace728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:19.579789 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb69ab-9b0e-4777-94e8-8954e2ace728 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:19.590871 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 61/121] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:19.591624 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54c319-71d2-4c63-b8c9-7234a44973b0 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:19.596712 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 61/122] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:19.598690 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb69ab-9b0e-4777-94e8-8954e2ace728 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:19.710569 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:19.716819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54c319-71d2-4c63-b8c9-7234a44973b0 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:19.747765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb69ab-9b0e-4777-94e8-8954e2ace728 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:19.753983 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f1f6f-d979-4605-b7ce-cb28e82cf85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:19.755029 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f1f6f-d979-4605-b7ce-cb28e82cf85c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:19.756332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f1f6f-d979-4605-b7ce-cb28e82cf85c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:19.756819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f1f6f-d979-4605-b7ce-cb28e82cf85c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:19.768203 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f1f6f-d979-4605-b7ce-cb28e82cf85c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:19.777877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-fc0f1f6f-d979-4605-b7ce-cb28e82cf85c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:19.777877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:19.777877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:19.777877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:19.777877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:19.777877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:19.777877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:19.777877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:19.777877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:19.777877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:19.777877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:19.777877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:19.777877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:19.777877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:19.777877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:19.777877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:19.778752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:19.778752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:19.778752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:19.778752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:19.778752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:19.778752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:19.778752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:19.778752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:19.778752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:19.778752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:19.778752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:19.778752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:19.778752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:19.778752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:19.778752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:19.778752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:19.779483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:19.779483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:19.779483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:19.779483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:19.779483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:19.779483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:19.779483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:19.779483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:19.779483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:19.779483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:19.779483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:19.779483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:19.786581 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 62/123] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:19.786581 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f1f6f-d979-4605-b7ce-cb28e82cf85c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:19.792498 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd7b0b-d3a3-4eb6-8e22-0afff24a3f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:19.793739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd7b0b-d3a3-4eb6-8e22-0afff24a3f0a None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:19.794232 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd7b0b-d3a3-4eb6-8e22-0afff24a3f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:19.794762 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd7b0b-d3a3-4eb6-8e22-0afff24a3f0a None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:19.796202 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd7b0b-d3a3-4eb6-8e22-0afff24a3f0a None admin] RBAC: Authorizing `identity:get_project(project_id=2a169bbfc64d4c459ba54854d70678e7)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:19.798119 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd7b0b-d3a3-4eb6-8e22-0afff24a3f0a None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:19.800405 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 62/124] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:19 2022] GET /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:19.801477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd7b0b-d3a3-4eb6-8e22-0afff24a3f0a None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:19.837493 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:19.913086 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f1f6f-d979-4605-b7ce-cb28e82cf85c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:19.916539 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd7b0b-d3a3-4eb6-8e22-0afff24a3f0a None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:19.953521 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8577e98-bd49-4d1b-887a-64967cf74a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:19.954853 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8577e98-bd49-4d1b-887a-64967cf74a23 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:19.955458 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8577e98-bd49-4d1b-887a-64967cf74a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:19.956038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8577e98-bd49-4d1b-887a-64967cf74a23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:19.958237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adacdd5-ded2-48b2-9a97-ffb63be4d538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:19.960064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adacdd5-ded2-48b2-9a97-ffb63be4d538 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:19.960651 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adacdd5-ded2-48b2-9a97-ffb63be4d538 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:19.960945 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adacdd5-ded2-48b2-9a97-ffb63be4d538 None admin] PATH_INFO: `/v3/users/13cde894f1744031872e9c62485bd552` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:19.962213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adacdd5-ded2-48b2-9a97-ffb63be4d538 None admin] RBAC: Authorizing `identity:get_user(user_id=13cde894f1744031872e9c62485bd552)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:19.963983 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adacdd5-ded2-48b2-9a97-ffb63be4d538 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:19.965650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 63/125] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:19 2022] GET /identity/v3/users/13cde894f1744031872e9c62485bd552 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:19.970171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adacdd5-ded2-48b2-9a97-ffb63be4d538 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:19.975312 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8577e98-bd49-4d1b-887a-64967cf74a23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:19.984534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-a8577e98-bd49-4d1b-887a-64967cf74a23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:19.984534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:19.984534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:19.984534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:19.984534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:19.984534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:19.984534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:19.984534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:19.984534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:19.984534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:19.984534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:19.984534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:19.984534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:19.984534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:19.984534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:19.984534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:19.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:19.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:19.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:19.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:19.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:19.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:19.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:19.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:19.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:19.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:19.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:19.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:19.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:19.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:19.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:19.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:19.986150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:19.986150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:19.986150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:19.986150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:19.986150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:19.986150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:19.986150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:19.986150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:19.986150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:19.986150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:19.986150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:19.986150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:19.988708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 63/126] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:28:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:19.989832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8577e98-bd49-4d1b-887a-64967cf74a23 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:20.004520 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:20.082588 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adacdd5-ded2-48b2-9a97-ffb63be4d538 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:20.089851 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:20.109258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8577e98-bd49-4d1b-887a-64967cf74a23 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:20.118066 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e2a89-c697-4436-9b64-2a776f365d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:20.119083 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e2a89-c697-4436-9b64-2a776f365d31 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:20.119083 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e2a89-c697-4436-9b64-2a776f365d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:20.119343 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e2a89-c697-4436-9b64-2a776f365d31 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:20.120035 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e2a89-c697-4436-9b64-2a776f365d31 None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:20.120347 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e2a89-c697-4436-9b64-2a776f365d31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:20.122045 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e2a89-c697-4436-9b64-2a776f365d31 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:20.135338 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 64/127] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:20.135338 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e2a89-c697-4436-9b64-2a776f365d31 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:20.157429 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84773e56-d570-42bd-833a-21cff35ad4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:20.158761 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84773e56-d570-42bd-833a-21cff35ad4de None admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:20.159111 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84773e56-d570-42bd-833a-21cff35ad4de None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:20.159404 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84773e56-d570-42bd-833a-21cff35ad4de None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7/users/8949be5666f94730b962f3ed654313b6/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:20.161893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84773e56-d570-42bd-833a-21cff35ad4de None admin] RBAC: Authorizing `identity:create_grant(project_id=2a169bbfc64d4c459ba54854d70678e7, user_id=8949be5666f94730b962f3ed654313b6, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:20.163837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84773e56-d570-42bd-833a-21cff35ad4de None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:20.184265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 64/128] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:28:19 2022] PUT /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7/users/8949be5666f94730b962f3ed654313b6/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:28:20.184867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84773e56-d570-42bd-833a-21cff35ad4de None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:20.245075 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:20.264888 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e2a89-c697-4436-9b64-2a776f365d31 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:20.300339 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84773e56-d570-42bd-833a-21cff35ad4de None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:20.306628 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fb59f-4858-48e8-81b5-4661fba80ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:20.308042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fb59f-4858-48e8-81b5-4661fba80ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:20.308599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fb59f-4858-48e8-81b5-4661fba80ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:20.309069 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fb59f-4858-48e8-81b5-4661fba80ce8 None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:20.310610 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fb59f-4858-48e8-81b5-4661fba80ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=2a169bbfc64d4c459ba54854d70678e7)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:20.312395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fb59f-4858-48e8-81b5-4661fba80ce8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:20.314433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 65/129] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:20 2022] GET /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:20.315639 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fb59f-4858-48e8-81b5-4661fba80ce8 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:20.337334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93eccc-e686-40dc-995c-ba74b2a66b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:20.337963 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93eccc-e686-40dc-995c-ba74b2a66b4b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:20.338269 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93eccc-e686-40dc-995c-ba74b2a66b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:20.338536 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93eccc-e686-40dc-995c-ba74b2a66b4b None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:20.339295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93eccc-e686-40dc-995c-ba74b2a66b4b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:20.339609 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93eccc-e686-40dc-995c-ba74b2a66b4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:20.341038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93eccc-e686-40dc-995c-ba74b2a66b4b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:20.350619 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 65/130] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:28:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:20.351287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93eccc-e686-40dc-995c-ba74b2a66b4b None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:20.367899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:20.440412 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fb59f-4858-48e8-81b5-4661fba80ce8 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:20.464751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93eccc-e686-40dc-995c-ba74b2a66b4b None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:20.480843 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6661a-7377-41d2-b668-b189f81f336c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:20.482112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6661a-7377-41d2-b668-b189f81f336c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:20.482614 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6661a-7377-41d2-b668-b189f81f336c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:20.483131 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6661a-7377-41d2-b668-b189f81f336c None admin] PATH_INFO: `/v3/users/8949be5666f94730b962f3ed654313b6` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:20.484597 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6661a-7377-41d2-b668-b189f81f336c None admin] RBAC: Authorizing `identity:get_user(user_id=8949be5666f94730b962f3ed654313b6)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:20.486442 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6661a-7377-41d2-b668-b189f81f336c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:20.488375 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 66/131] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:20 2022] GET /identity/v3/users/8949be5666f94730b962f3ed654313b6 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:20.493583 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6661a-7377-41d2-b668-b189f81f336c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:20.504653 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474eb070-8c7d-4d88-9d90-4b9b503d0316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:20.506065 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474eb070-8c7d-4d88-9d90-4b9b503d0316 None admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:20.506357 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474eb070-8c7d-4d88-9d90-4b9b503d0316 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:20.506640 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474eb070-8c7d-4d88-9d90-4b9b503d0316 None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7/users/13cde894f1744031872e9c62485bd552/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:20.508832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474eb070-8c7d-4d88-9d90-4b9b503d0316 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a169bbfc64d4c459ba54854d70678e7, user_id=13cde894f1744031872e9c62485bd552, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:20.510461 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474eb070-8c7d-4d88-9d90-4b9b503d0316 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:20.526920 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 66/132] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:28:20 2022] PUT /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7/users/13cde894f1744031872e9c62485bd552/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:28:20.527652 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474eb070-8c7d-4d88-9d90-4b9b503d0316 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:20.530406 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:20.627531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:20.631378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6661a-7377-41d2-b668-b189f81f336c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:20.692677 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc08ccd-b8ca-4e55-83a3-e669ded1e0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:20.694314 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc08ccd-b8ca-4e55-83a3-e669ded1e0ed None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:20.694611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc08ccd-b8ca-4e55-83a3-e669ded1e0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:20.694891 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc08ccd-b8ca-4e55-83a3-e669ded1e0ed None admin] PATH_INFO: `/v3/users/8949be5666f94730b962f3ed654313b6` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:20.696343 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc08ccd-b8ca-4e55-83a3-e669ded1e0ed None admin] RBAC: Authorizing `identity:get_user(user_id=8949be5666f94730b962f3ed654313b6)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:20.697881 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc08ccd-b8ca-4e55-83a3-e669ded1e0ed None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:20.699579 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 67/133] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:20 2022] GET /identity/v3/users/8949be5666f94730b962f3ed654313b6 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:20.708087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc08ccd-b8ca-4e55-83a3-e669ded1e0ed None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:20.710727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474eb070-8c7d-4d88-9d90-4b9b503d0316 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:20.781258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7257e-d3c1-4669-9fe2-bc6388b53946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:20.782280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7257e-d3c1-4669-9fe2-bc6388b53946 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:20.782574 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7257e-d3c1-4669-9fe2-bc6388b53946 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:20.782856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e7257e-d3c1-4669-9fe2-bc6388b53946 None admin] PATH_INFO: `/v3/projects/e6ac8f5603484012a5ae8a6f3edd4a52` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:20.785840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7257e-d3c1-4669-9fe2-bc6388b53946 None admin] RBAC: Authorizing `identity:get_project(project_id=e6ac8f5603484012a5ae8a6f3edd4a52)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:20.788044 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e7257e-d3c1-4669-9fe2-bc6388b53946 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:20.790079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 67/134] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:20 2022] GET /identity/v3/projects/e6ac8f5603484012a5ae8a6f3edd4a52 => generated 312 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:20.815252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7257e-d3c1-4669-9fe2-bc6388b53946 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:20.838726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:20.849393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc08ccd-b8ca-4e55-83a3-e669ded1e0ed None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:20.886480 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1ed96-8dfb-479f-bacf-25032b4561a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:20.887672 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1ed96-8dfb-479f-bacf-25032b4561a7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:20.888148 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1ed96-8dfb-479f-bacf-25032b4561a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:20.888624 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1ed96-8dfb-479f-bacf-25032b4561a7 None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:20.890176 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1ed96-8dfb-479f-bacf-25032b4561a7 None admin] RBAC: Authorizing `identity:get_project(project_id=2a169bbfc64d4c459ba54854d70678e7)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:20.891896 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1ed96-8dfb-479f-bacf-25032b4561a7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:20.893850 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 68/135] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:20 2022] GET /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:20.901671 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1ed96-8dfb-479f-bacf-25032b4561a7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:21.016544 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e7257e-d3c1-4669-9fe2-bc6388b53946 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:21.077646 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1ed96-8dfb-479f-bacf-25032b4561a7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:21.097667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f43485-c133-44f8-9982-822d2d696345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:21.099640 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f43485-c133-44f8-9982-822d2d696345 None admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:21.100141 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f43485-c133-44f8-9982-822d2d696345 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:21.100612 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f43485-c133-44f8-9982-822d2d696345 None admin] PATH_INFO: `/v3/projects/e6ac8f5603484012a5ae8a6f3edd4a52/users/8949be5666f94730b962f3ed654313b6/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:21.104947 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f43485-c133-44f8-9982-822d2d696345 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6ac8f5603484012a5ae8a6f3edd4a52, user_id=8949be5666f94730b962f3ed654313b6, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:21.106682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f43485-c133-44f8-9982-822d2d696345 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:21.116697 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:21.133170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 68/136] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:28:20 2022] PUT /identity/v3/projects/e6ac8f5603484012a5ae8a6f3edd4a52/users/8949be5666f94730b962f3ed654313b6/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:28:21.152344 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df8873-d57d-45a9-bebf-3da792bac7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:21.153601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df8873-d57d-45a9-bebf-3da792bac7b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:21.154161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df8873-d57d-45a9-bebf-3da792bac7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:21.158251 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df8873-d57d-45a9-bebf-3da792bac7b1 None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7/users/8949be5666f94730b962f3ed654313b6/roles/1302d95e46b4422d84f581f8838d5aac` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:21.160991 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df8873-d57d-45a9-bebf-3da792bac7b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a169bbfc64d4c459ba54854d70678e7, user_id=8949be5666f94730b962f3ed654313b6, role_id=1302d95e46b4422d84f581f8838d5aac)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:21.163287 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df8873-d57d-45a9-bebf-3da792bac7b1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:21.182556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 69/137] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:28:20 2022] PUT /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7/users/8949be5666f94730b962f3ed654313b6/roles/1302d95e46b4422d84f581f8838d5aac => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:28:21.417405 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db93cf-2245-406d-a9ad-145a5b9fbfe0 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:21.418050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db93cf-2245-406d-a9ad-145a5b9fbfe0 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:21.418531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db93cf-2245-406d-a9ad-145a5b9fbfe0 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:21.420385 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 69/138] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:21.425614 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebeb84-c7e4-46f7-91e6-ab820c6a0751 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:21.426218 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebeb84-c7e4-46f7-91e6-ab820c6a0751 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:21.426725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebeb84-c7e4-46f7-91e6-ab820c6a0751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:21.448319 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-88ebeb84-c7e4-46f7-91e6-ab820c6a0751 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:21.450307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-88ebeb84-c7e4-46f7-91e6-ab820c6a0751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:21.471085 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:21.545521 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 70/139] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:21.585715 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db93cf-2245-406d-a9ad-145a5b9fbfe0 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:21.668626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58a066-bd9d-4fac-b23b-f60cc8cca7cf None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:21.668924 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58a066-bd9d-4fac-b23b-f60cc8cca7cf None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:21.669093 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58a066-bd9d-4fac-b23b-f60cc8cca7cf None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:21.671041 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 71/140] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:28:21.677957 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf48b3a-781a-482b-aa67-cd4491a3f79d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:21.678588 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf48b3a-781a-482b-aa67-cd4491a3f79d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:21.679200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf48b3a-781a-482b-aa67-cd4491a3f79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:21.711995 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db93cf-2245-406d-a9ad-145a5b9fbfe0 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:21.720917 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0bf48b3a-781a-482b-aa67-cd4491a3f79d None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:21.722137 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0bf48b3a-781a-482b-aa67-cd4491a3f79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:21.787212 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137345b8-9639-44b7-8fec-f5b110043d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:21.788198 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137345b8-9639-44b7-8fec-f5b110043d65 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:21.788484 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137345b8-9639-44b7-8fec-f5b110043d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:21.788760 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137345b8-9639-44b7-8fec-f5b110043d65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:21.792169 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137345b8-9639-44b7-8fec-f5b110043d65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:21.793650 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137345b8-9639-44b7-8fec-f5b110043d65 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:21.796402 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 70/141] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:28:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:21.804021 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137345b8-9639-44b7-8fec-f5b110043d65 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:21.877427 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 72/142] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:21.925600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:21.946220 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf48b3a-781a-482b-aa67-cd4491a3f79d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:22.006658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137345b8-9639-44b7-8fec-f5b110043d65 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:22.098764 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2072e22-d165-4399-8d16-e7015d2ee6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:22.099866 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2072e22-d165-4399-8d16-e7015d2ee6d7 None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:22.100355 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2072e22-d165-4399-8d16-e7015d2ee6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:22.101852 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2072e22-d165-4399-8d16-e7015d2ee6d7 None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:22.102797 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2072e22-d165-4399-8d16-e7015d2ee6d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:22.110926 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2072e22-d165-4399-8d16-e7015d2ee6d7 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:22.136380 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:22.164443 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 71/143] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jun 14 19:28:21 2022] POST /identity/v3/users => generated 283 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:28:22.189717 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf48b3a-781a-482b-aa67-cd4491a3f79d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:22.237107 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112152a6-7ff9-472e-b3ee-bceddd54dada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:22.238337 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112152a6-7ff9-472e-b3ee-bceddd54dada None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:22.238830 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112152a6-7ff9-472e-b3ee-bceddd54dada None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:22.239650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112152a6-7ff9-472e-b3ee-bceddd54dada None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:22.260619 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112152a6-7ff9-472e-b3ee-bceddd54dada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:22.269003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-112152a6-7ff9-472e-b3ee-bceddd54dada None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 19:28:22.269003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:22.269003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:22.269003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:22.269003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:22.269003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:22.269003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:22.269003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:22.269003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:22.269003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:22.269003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:22.269003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:22.269003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:22.269003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:22.269003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:22.269003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:22.269936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:22.269936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:22.269936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:22.269936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:22.269936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:22.269936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:22.269936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:22.269936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:22.269936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:22.269936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:22.269936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:22.269936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:22.269936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:22.269936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:22.269936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:22.269936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:22.271362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:22.271362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:22.271362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:22.271362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:22.271362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:22.271362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:22.271362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:22.271362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:22.271362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:22.271362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:22.271362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 19:28:22.271362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:22.273983 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 73/144] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:28:22.281126 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2072e22-d165-4399-8d16-e7015d2ee6d7 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:22.421843 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2072e22-d165-4399-8d16-e7015d2ee6d7 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:22.449896 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:22.470816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf16d4-21d2-43f0-be40-e9911c001584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:22.471850 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf16d4-21d2-43f0-be40-e9911c001584 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:22.472368 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf16d4-21d2-43f0-be40-e9911c001584 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:22.472851 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf16d4-21d2-43f0-be40-e9911c001584 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:22.473904 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf16d4-21d2-43f0-be40-e9911c001584 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:22.474942 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf16d4-21d2-43f0-be40-e9911c001584 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:22.476543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf16d4-21d2-43f0-be40-e9911c001584 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:22.493305 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 72/145] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:22.499680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112152a6-7ff9-472e-b3ee-bceddd54dada None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:22.635604 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112152a6-7ff9-472e-b3ee-bceddd54dada None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:22.677542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295817fd-88cd-403f-aada-d9d23c71430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:22.678783 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295817fd-88cd-403f-aada-d9d23c71430a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:22.679297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295817fd-88cd-403f-aada-d9d23c71430a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:22.679775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295817fd-88cd-403f-aada-d9d23c71430a None admin] PATH_INFO: `/v3/users/f9b7faf2dac248948b5572aa33781ed1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:22.682492 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295817fd-88cd-403f-aada-d9d23c71430a None admin] RBAC: Authorizing `identity:get_user(user_id=f9b7faf2dac248948b5572aa33781ed1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:22.684220 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295817fd-88cd-403f-aada-d9d23c71430a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:22.686138 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 74/146] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:22 2022] GET /identity/v3/users/f9b7faf2dac248948b5572aa33781ed1 => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:22.693366 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf16d4-21d2-43f0-be40-e9911c001584 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:22.830045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf16d4-21d2-43f0-be40-e9911c001584 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:22.887567 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d037ca9-2090-4098-a7b7-3da2abced66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:22.888449 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d037ca9-2090-4098-a7b7-3da2abced66e None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:22.888738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d037ca9-2090-4098-a7b7-3da2abced66e None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:22.889019 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d037ca9-2090-4098-a7b7-3da2abced66e None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:22.890238 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d037ca9-2090-4098-a7b7-3da2abced66e None admin] RBAC: Authorizing `identity:get_project(project_id=2a169bbfc64d4c459ba54854d70678e7)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:22.891989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d037ca9-2090-4098-a7b7-3da2abced66e None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:22.894247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 73/147] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:22 2022] GET /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:22.901538 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295817fd-88cd-403f-aada-d9d23c71430a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:22.915409 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:23.061356 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295817fd-88cd-403f-aada-d9d23c71430a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:23.104350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f46d67-bd4e-4f8c-8481-3dede9ddeaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:23.105177 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f46d67-bd4e-4f8c-8481-3dede9ddeaef None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:23.105487 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f46d67-bd4e-4f8c-8481-3dede9ddeaef None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:23.105766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f46d67-bd4e-4f8c-8481-3dede9ddeaef None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7/users/f9b7faf2dac248948b5572aa33781ed1/roles/04bbf2f8d56744159d8dac700dde4379` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:23.110697 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f46d67-bd4e-4f8c-8481-3dede9ddeaef None admin] RBAC: Authorizing `identity:create_grant(project_id=2a169bbfc64d4c459ba54854d70678e7, user_id=f9b7faf2dac248948b5572aa33781ed1, role_id=04bbf2f8d56744159d8dac700dde4379)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:23.112174 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f46d67-bd4e-4f8c-8481-3dede9ddeaef None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:23.137125 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 75/148] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:28:22 2022] PUT /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7/users/f9b7faf2dac248948b5572aa33781ed1/roles/04bbf2f8d56744159d8dac700dde4379 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:28:23.371386 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9259b-be14-48e4-b040-54b5381ef78d None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:23.371712 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9259b-be14-48e4-b040-54b5381ef78d None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:23.371918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9259b-be14-48e4-b040-54b5381ef78d None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:23.373638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 74/149] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:23.379336 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794655b-b4cd-4a3b-8072-4ee2dd9b1507 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:23.379631 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794655b-b4cd-4a3b-8072-4ee2dd9b1507 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:23.379915 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794655b-b4cd-4a3b-8072-4ee2dd9b1507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:23.401574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-5794655b-b4cd-4a3b-8072-4ee2dd9b1507 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:23.402777 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5794655b-b4cd-4a3b-8072-4ee2dd9b1507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:23.476551 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:23.483971 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 76/150] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:23.510546 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9259b-be14-48e4-b040-54b5381ef78d None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:23.569254 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:23.633460 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9259b-be14-48e4-b040-54b5381ef78d None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:23.681721 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488d568-133a-4418-aa33-b0270863e05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:23.682533 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488d568-133a-4418-aa33-b0270863e05f None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:23.682820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488d568-133a-4418-aa33-b0270863e05f None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:23.683097 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488d568-133a-4418-aa33-b0270863e05f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:23.698603 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488d568-133a-4418-aa33-b0270863e05f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:23.706477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-e488d568-133a-4418-aa33-b0270863e05f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:23.706477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:23.706477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:23.706477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:23.706477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:23.706477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:23.706477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:23.706477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:23.706477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:23.706477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:23.706477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:23.706477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:23.706477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:23.706477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:23.706477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:23.706477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:23.707307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:23.707307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:23.707307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:23.707307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:23.707307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:23.707307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:23.707307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:23.707307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:23.707307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:23.707307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:23.707307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:23.707307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:23.707307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:23.707307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:23.707307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:23.707307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:23.708042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:23.708042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:23.708042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:23.708042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:23.708042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:23.708042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:23.708042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:23.708042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:23.708042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:23.708042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:23.708042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:23.708042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:23.708042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 75/151] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:23.715437 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794655b-b4cd-4a3b-8072-4ee2dd9b1507 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:23.829182 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794655b-b4cd-4a3b-8072-4ee2dd9b1507 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:23.866797 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b38a4-d183-4482-b0c2-f6e2737d0705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:23.867471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b38a4-d183-4482-b0c2-f6e2737d0705 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:23.867759 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b38a4-d183-4482-b0c2-f6e2737d0705 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:23.868036 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b38a4-d183-4482-b0c2-f6e2737d0705 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:23.868864 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b38a4-d183-4482-b0c2-f6e2737d0705 None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:23.869171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b38a4-d183-4482-b0c2-f6e2737d0705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:23.870649 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b38a4-d183-4482-b0c2-f6e2737d0705 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:23.879902 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 77/152] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:23.886665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488d568-133a-4418-aa33-b0270863e05f None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:24.004412 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488d568-133a-4418-aa33-b0270863e05f None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:24.017900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:24.042961 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202cafe-6293-47ff-8a6d-3207cf2d27f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:24.043848 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202cafe-6293-47ff-8a6d-3207cf2d27f3 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:24.044132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202cafe-6293-47ff-8a6d-3207cf2d27f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:24.044409 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a202cafe-6293-47ff-8a6d-3207cf2d27f3 None admin] PATH_INFO: `/v3/users/8949be5666f94730b962f3ed654313b6` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:24.045668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202cafe-6293-47ff-8a6d-3207cf2d27f3 None admin] RBAC: Authorizing `identity:get_user(user_id=8949be5666f94730b962f3ed654313b6)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:24.047196 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a202cafe-6293-47ff-8a6d-3207cf2d27f3 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:24.049232 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 76/153] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:23 2022] GET /identity/v3/users/8949be5666f94730b962f3ed654313b6 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:24.055290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b38a4-d183-4482-b0c2-f6e2737d0705 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:24.136165 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:24.191510 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b38a4-d183-4482-b0c2-f6e2737d0705 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:24.233288 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c5fa2-9111-4a00-8a67-01f2d699d6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:24.233975 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c5fa2-9111-4a00-8a67-01f2d699d6fa None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:24.234264 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c5fa2-9111-4a00-8a67-01f2d699d6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:24.234546 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c5fa2-9111-4a00-8a67-01f2d699d6fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:24.325194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c5fa2-9111-4a00-8a67-01f2d699d6fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:24.326709 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c5fa2-9111-4a00-8a67-01f2d699d6fa None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:24.397225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:24.445753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 78/154] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:28:24.447408 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202cafe-6293-47ff-8a6d-3207cf2d27f3 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:24.563400 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a202cafe-6293-47ff-8a6d-3207cf2d27f3 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:24.604431 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5030df6c-c23f-4ec3-860c-3d8b3366f617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:24.605313 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030df6c-c23f-4ec3-860c-3d8b3366f617 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:24.605624 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030df6c-c23f-4ec3-860c-3d8b3366f617 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:24.605906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030df6c-c23f-4ec3-860c-3d8b3366f617 None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:24.607148 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030df6c-c23f-4ec3-860c-3d8b3366f617 None admin] RBAC: Authorizing `identity:get_project(project_id=2a169bbfc64d4c459ba54854d70678e7)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:24.608597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030df6c-c23f-4ec3-860c-3d8b3366f617 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:24.610508 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 77/155] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:24 2022] GET /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:24.617113 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c5fa2-9111-4a00-8a67-01f2d699d6fa None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:24.684603 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a6f78-8cfa-441a-a4d2-9f1dcb43d1e1 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:24.684930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a6f78-8cfa-441a-a4d2-9f1dcb43d1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:24.685164 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a6f78-8cfa-441a-a4d2-9f1dcb43d1e1 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:24.686748 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 78/156] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:28:24.694732 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841182b-7e46-42cd-b4c1-6279111007c9 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:24.695036 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841182b-7e46-42cd-b4c1-6279111007c9 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:24.695297 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841182b-7e46-42cd-b4c1-6279111007c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:24.722315 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-f841182b-7e46-42cd-b4c1-6279111007c9 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:24.723541 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-f841182b-7e46-42cd-b4c1-6279111007c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:24.765092 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c5fa2-9111-4a00-8a67-01f2d699d6fa None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:24.821401 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:24.839484 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbcb5d-12cf-405f-9a80-cfdab345c40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:24.840145 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbcb5d-12cf-405f-9a80-cfdab345c40f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:24.840487 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbcb5d-12cf-405f-9a80-cfdab345c40f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:24.840766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbcb5d-12cf-405f-9a80-cfdab345c40f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:24.842358 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbcb5d-12cf-405f-9a80-cfdab345c40f None admin] RBAC: Adding query filter params (role.id=bf1733d36314409c80cd50b2268834b1, scope.project.id=2a169bbfc64d4c459ba54854d70678e7, user.id=8949be5666f94730b962f3ed654313b6) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:24.842672 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbcb5d-12cf-405f-9a80-cfdab345c40f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:24.844134 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbcb5d-12cf-405f-9a80-cfdab345c40f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:24.856177 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 79/157] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:24.858648 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 79/158] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:28:24 2022] GET /identity/v3/role_assignments?user.id=8949be5666f94730b962f3ed654313b6&scope.project.id=2a169bbfc64d4c459ba54854d70678e7&role.id=bf1733d36314409c80cd50b2268834b1 => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:24.885970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd648f4-029f-4322-964a-93c5ce78074a None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:24.886314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd648f4-029f-4322-964a-93c5ce78074a None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:24.886543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd648f4-029f-4322-964a-93c5ce78074a None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:24.888268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 80/159] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:24.903052 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbcb5d-12cf-405f-9a80-cfdab345c40f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:24.907703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cffa0-f842-434b-b262-ed9d3de96833 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:24.907976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cffa0-f842-434b-b262-ed9d3de96833 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:24.908258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cffa0-f842-434b-b262-ed9d3de96833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:24.966278 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-c31cffa0-f842-434b-b262-ed9d3de96833 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:24.971083 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c31cffa0-f842-434b-b262-ed9d3de96833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:24.986089 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:25.123826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 81/160] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:25.133896 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbcb5d-12cf-405f-9a80-cfdab345c40f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:25.170271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c5629-39c5-4473-a84b-a183fdd9c5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:25.171144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c5629-39c5-4473-a84b-a183fdd9c5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:25.171430 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c5629-39c5-4473-a84b-a183fdd9c5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:25.171708 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495c5629-39c5-4473-a84b-a183fdd9c5a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:25.175040 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cffa0-f842-434b-b262-ed9d3de96833 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:25.202088 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495c5629-39c5-4473-a84b-a183fdd9c5a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:25.214929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-495c5629-39c5-4473-a84b-a183fdd9c5a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:28:25.214929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:25.214929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:25.214929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:25.214929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:25.214929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:25.214929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:25.214929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:25.214929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:25.214929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:25.214929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:25.214929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:25.214929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:25.214929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:25.214929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:25.214929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:25.215879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:25.215879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:25.215879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:25.215879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:25.215879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:25.215879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:25.215879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:25.215879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:25.215879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:25.215879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:25.215879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:25.215879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:25.215879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:25.215879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:25.215879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:25.215879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:25.216626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:25.216626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:25.216626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:25.216626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:25.216626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:25.216626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:25.216626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:25.216626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:25.216626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:25.216626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:25.216626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:28:25.216626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:25.219663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 80/161] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:28:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:25.227936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c5629-39c5-4473-a84b-a183fdd9c5a9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:25.331599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:25.353077 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495c5629-39c5-4473-a84b-a183fdd9c5a9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:25.372600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31cffa0-f842-434b-b262-ed9d3de96833 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:25.380542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:25.391700 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae7ee4-47f6-4977-b9ed-de460a02d9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:25.392472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae7ee4-47f6-4977-b9ed-de460a02d9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:25.392760 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae7ee4-47f6-4977-b9ed-de460a02d9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:25.393035 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae7ee4-47f6-4977-b9ed-de460a02d9e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:25.393827 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae7ee4-47f6-4977-b9ed-de460a02d9e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:25.394134 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae7ee4-47f6-4977-b9ed-de460a02d9e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:25.396408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae7ee4-47f6-4977-b9ed-de460a02d9e7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:25.408606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 81/162] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:25.417334 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b06a-a492-4d28-a6e3-8ff6b0e75122 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:25.417776 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b06a-a492-4d28-a6e3-8ff6b0e75122 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:25.418118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528b06a-a492-4d28-a6e3-8ff6b0e75122 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:25.419796 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 82/163] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:28:25.421597 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528b06a-a492-4d28-a6e3-8ff6b0e75122 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:25.457425 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a4c973-9e35-44d7-973b-9db500541187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:25.458947 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4c973-9e35-44d7-973b-9db500541187 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:25.459322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4c973-9e35-44d7-973b-9db500541187 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:25.459599 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4c973-9e35-44d7-973b-9db500541187 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:25.478668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a4c973-9e35-44d7-973b-9db500541187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:25.486872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-93a4c973-9e35-44d7-973b-9db500541187 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:25.486872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:25.486872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:25.486872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:25.486872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:25.486872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:25.486872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:25.486872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:25.486872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:25.486872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:25.486872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:25.486872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:25.486872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:25.486872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:25.486872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:25.486872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:25.488927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:25.488927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:25.488927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:25.488927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:25.488927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:25.488927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:25.488927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:25.488927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:25.488927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:25.488927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:25.488927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:25.488927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:25.488927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:25.488927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:25.488927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:25.488927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:25.490915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:25.490915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:25.490915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:25.490915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:25.490915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:25.490915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:25.490915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:25.490915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:25.490915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:25.490915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:25.490915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:25.490915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:25.490915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 82/164] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:28:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:25.496936 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62a5c4-09aa-4eee-8b8b-24f170abdae9 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:25.496936 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62a5c4-09aa-4eee-8b8b-24f170abdae9 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:25.496936 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62a5c4-09aa-4eee-8b8b-24f170abdae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:25.525889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-5c62a5c4-09aa-4eee-8b8b-24f170abdae9 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:25.527074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-5c62a5c4-09aa-4eee-8b8b-24f170abdae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:25.578960 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1528b06a-a492-4d28-a6e3-8ff6b0e75122 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:25.627735 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013e8f4-4cc0-484a-96fc-f3ca83a806a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:25.628533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013e8f4-4cc0-484a-96fc-f3ca83a806a6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:25.628816 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013e8f4-4cc0-484a-96fc-f3ca83a806a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:25.629091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013e8f4-4cc0-484a-96fc-f3ca83a806a6 None admin] PATH_INFO: `/v3/users/13cde894f1744031872e9c62485bd552` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:25.632742 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013e8f4-4cc0-484a-96fc-f3ca83a806a6 None admin] RBAC: Authorizing `identity:get_user(user_id=13cde894f1744031872e9c62485bd552)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:25.634237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013e8f4-4cc0-484a-96fc-f3ca83a806a6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:25.636060 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 83/165] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:25 2022] GET /identity/v3/users/13cde894f1744031872e9c62485bd552 => generated 247 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:25.636739 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013e8f4-4cc0-484a-96fc-f3ca83a806a6 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:25.670052 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:25.672338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 83/166] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:25.673118 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62a5c4-09aa-4eee-8b8b-24f170abdae9 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:25.764448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013e8f4-4cc0-484a-96fc-f3ca83a806a6 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:25.801326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fec3d-a5ef-4f05-a300-c145267a863c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:25.802189 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fec3d-a5ef-4f05-a300-c145267a863c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:25.802488 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fec3d-a5ef-4f05-a300-c145267a863c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:25.803252 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fec3d-a5ef-4f05-a300-c145267a863c None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:25.803634 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fec3d-a5ef-4f05-a300-c145267a863c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:25.803941 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fec3d-a5ef-4f05-a300-c145267a863c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:25.805470 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fec3d-a5ef-4f05-a300-c145267a863c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:25.816109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 84/167] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:28:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:25.816109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fec3d-a5ef-4f05-a300-c145267a863c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:25.822495 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:25.840360 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62a5c4-09aa-4eee-8b8b-24f170abdae9 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:25.898880 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:25.907059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487cf4c-a8cb-458c-b367-b906549d1c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:25.907818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487cf4c-a8cb-458c-b367-b906549d1c2e None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:25.908178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487cf4c-a8cb-458c-b367-b906549d1c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:25.908528 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487cf4c-a8cb-458c-b367-b906549d1c2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:25.925446 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fec3d-a5ef-4f05-a300-c145267a863c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:25.962522 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0a625-9617-4034-8ee5-73099d65f792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:25.963604 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0a625-9617-4034-8ee5-73099d65f792 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:25.964057 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0a625-9617-4034-8ee5-73099d65f792 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:25.964596 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0a625-9617-4034-8ee5-73099d65f792 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:25.975938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0a625-9617-4034-8ee5-73099d65f792 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:25.983998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-f6f0a625-9617-4034-8ee5-73099d65f792 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:25.983998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:25.983998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:25.983998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:25.983998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:25.983998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:25.983998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:25.983998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:25.983998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:25.983998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:25.983998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:25.983998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:25.983998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:25.983998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:25.983998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:25.983998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:25.984897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:25.984897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:25.984897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:25.984897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:25.984897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:25.984897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:25.984897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:25.984897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:25.984897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:25.984897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:25.984897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:25.984897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:25.984897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:25.984897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:25.984897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:25.984897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:25.985712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:25.985712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:25.985712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:25.985712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:25.985712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:25.985712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:25.985712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:25.985712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:25.985712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:25.985712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:25.985712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:25.985712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:25.988065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 85/168] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:25.989013 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0a625-9617-4034-8ee5-73099d65f792 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:26.026633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487cf4c-a8cb-458c-b367-b906549d1c2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:26.028331 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8487cf4c-a8cb-458c-b367-b906549d1c2e None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:26.095889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0a625-9617-4034-8ee5-73099d65f792 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:26.132135 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a336d-4362-463a-9abe-9a8c431c4185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:26.133318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a336d-4362-463a-9abe-9a8c431c4185 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:26.133824 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a336d-4362-463a-9abe-9a8c431c4185 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:26.134322 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a336d-4362-463a-9abe-9a8c431c4185 None admin] PATH_INFO: `/v3/users/8949be5666f94730b962f3ed654313b6` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:26.135905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a336d-4362-463a-9abe-9a8c431c4185 None admin] RBAC: Authorizing `identity:get_user(user_id=8949be5666f94730b962f3ed654313b6)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:26.137578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a336d-4362-463a-9abe-9a8c431c4185 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:26.139399 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 86/169] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:25 2022] GET /identity/v3/users/8949be5666f94730b962f3ed654313b6 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:26.140403 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a336d-4362-463a-9abe-9a8c431c4185 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:26.154483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:26.166916 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:26.181227 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 84/170] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:28:26.182115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487cf4c-a8cb-458c-b367-b906549d1c2e None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:26.301272 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a336d-4362-463a-9abe-9a8c431c4185 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:26.359174 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487cf4c-a8cb-458c-b367-b906549d1c2e None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:26.372807 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c86ee5-b9db-497a-ac8e-90819e4598c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:26.373504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c86ee5-b9db-497a-ac8e-90819e4598c0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:26.373792 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c86ee5-b9db-497a-ac8e-90819e4598c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:26.374068 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c86ee5-b9db-497a-ac8e-90819e4598c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:26.374814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c86ee5-b9db-497a-ac8e-90819e4598c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:26.375443 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c86ee5-b9db-497a-ac8e-90819e4598c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:26.377034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c86ee5-b9db-497a-ac8e-90819e4598c0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:26.395100 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 87/171] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:26.396631 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c86ee5-b9db-497a-ac8e-90819e4598c0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:26.429444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26c27a-53b5-4bbd-b97c-ade2cf993cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:26.430345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26c27a-53b5-4bbd-b97c-ade2cf993cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:26.431511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26c27a-53b5-4bbd-b97c-ade2cf993cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:26.431935 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26c27a-53b5-4bbd-b97c-ade2cf993cb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:26.528768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:26.558864 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:26.578296 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26c27a-53b5-4bbd-b97c-ade2cf993cb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:26.580171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26c27a-53b5-4bbd-b97c-ade2cf993cb9 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:26.595270 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c86ee5-b9db-497a-ac8e-90819e4598c0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:26.725346 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d703a2-1777-49a2-a59e-157a2be252fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:26.726252 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d703a2-1777-49a2-a59e-157a2be252fd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:26.727055 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d703a2-1777-49a2-a59e-157a2be252fd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:26.727356 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d703a2-1777-49a2-a59e-157a2be252fd None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:26.728721 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d703a2-1777-49a2-a59e-157a2be252fd None admin] RBAC: Authorizing `identity:get_project(project_id=2a169bbfc64d4c459ba54854d70678e7)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:26.738852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d703a2-1777-49a2-a59e-157a2be252fd None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:26.741072 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 88/172] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:26 2022] GET /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7 => generated 298 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:26.742076 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d703a2-1777-49a2-a59e-157a2be252fd None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:26.936205 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 85/173] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:28:26.937144 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26c27a-53b5-4bbd-b97c-ade2cf993cb9 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:26.963707 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d703a2-1777-49a2-a59e-157a2be252fd None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:27.017860 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:27.021268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96213e-8653-48c4-b0f6-453dc0de01ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:27.022396 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96213e-8653-48c4-b0f6-453dc0de01ba None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:27.022878 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96213e-8653-48c4-b0f6-453dc0de01ba None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:27.023355 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96213e-8653-48c4-b0f6-453dc0de01ba None admin] PATH_INFO: `/v3/users/8949be5666f94730b962f3ed654313b6` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:27.024811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96213e-8653-48c4-b0f6-453dc0de01ba None admin] RBAC: Authorizing `identity:get_user(user_id=8949be5666f94730b962f3ed654313b6)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:27.026511 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d96213e-8653-48c4-b0f6-453dc0de01ba None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:27.028338 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 89/174] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:26 2022] GET /identity/v3/users/8949be5666f94730b962f3ed654313b6 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:27.029462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96213e-8653-48c4-b0f6-453dc0de01ba None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:27.137748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96213e-8653-48c4-b0f6-453dc0de01ba None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:27.178395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814940f1-3ba5-4176-9455-d511eca8b553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:27.179678 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814940f1-3ba5-4176-9455-d511eca8b553 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:27.180159 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814940f1-3ba5-4176-9455-d511eca8b553 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:27.180628 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814940f1-3ba5-4176-9455-d511eca8b553 None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:27.182342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814940f1-3ba5-4176-9455-d511eca8b553 None admin] RBAC: Authorizing `identity:get_project(project_id=2a169bbfc64d4c459ba54854d70678e7)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:27.184077 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814940f1-3ba5-4176-9455-d511eca8b553 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:27.186460 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 90/175] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:27 2022] GET /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:27.188432 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814940f1-3ba5-4176-9455-d511eca8b553 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:27.206888 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:27.222729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26c27a-53b5-4bbd-b97c-ade2cf993cb9 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:27.289765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8f36b-7ff7-448f-ac6a-cf25936a9370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:27.290671 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8f36b-7ff7-448f-ac6a-cf25936a9370 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:27.291100 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8f36b-7ff7-448f-ac6a-cf25936a9370 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:27.291764 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8f36b-7ff7-448f-ac6a-cf25936a9370 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:27.292748 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8f36b-7ff7-448f-ac6a-cf25936a9370 None admin] RBAC: Adding query filter params (role.id=1e2bb0d759694428ada2b52285de933b, scope.project.id=2a169bbfc64d4c459ba54854d70678e7, user.id=13cde894f1744031872e9c62485bd552) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:27.293193 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8f36b-7ff7-448f-ac6a-cf25936a9370 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:27.294833 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8f36b-7ff7-448f-ac6a-cf25936a9370 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:27.301597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 86/176] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:28:26 2022] GET /identity/v3/role_assignments?user.id=13cde894f1744031872e9c62485bd552&scope.project.id=2a169bbfc64d4c459ba54854d70678e7&role.id=1e2bb0d759694428ada2b52285de933b => generated 608 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:27.302641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8f36b-7ff7-448f-ac6a-cf25936a9370 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:27.310937 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814940f1-3ba5-4176-9455-d511eca8b553 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:27.313984 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:27.352191 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94006a-4168-4daa-b38f-8a997bf97b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:27.352855 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94006a-4168-4daa-b38f-8a997bf97b3c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:27.353137 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94006a-4168-4daa-b38f-8a997bf97b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:27.353438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94006a-4168-4daa-b38f-8a997bf97b3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:27.413755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8f36b-7ff7-448f-ac6a-cf25936a9370 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:27.431701 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94006a-4168-4daa-b38f-8a997bf97b3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:27.433322 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94006a-4168-4daa-b38f-8a997bf97b3c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:27.453318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9ee62-23af-4d50-b892-076adf339d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:27.454413 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9ee62-23af-4d50-b892-076adf339d97 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:27.454915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9ee62-23af-4d50-b892-076adf339d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:27.455420 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9ee62-23af-4d50-b892-076adf339d97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:27.456536 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9ee62-23af-4d50-b892-076adf339d97 None admin] RBAC: Adding query filter params (role.id=1302d95e46b4422d84f581f8838d5aac, scope.project.id=2a169bbfc64d4c459ba54854d70678e7, user.id=8949be5666f94730b962f3ed654313b6) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:27.457118 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9ee62-23af-4d50-b892-076adf339d97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:27.459930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9ee62-23af-4d50-b892-076adf339d97 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:27.467028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 87/177] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:28:27 2022] GET /identity/v3/role_assignments?user.id=8949be5666f94730b962f3ed654313b6&scope.project.id=2a169bbfc64d4c459ba54854d70678e7&role.id=1302d95e46b4422d84f581f8838d5aac => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:27.468889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e2fa2-23b9-41d3-b978-4ae6cea92de3 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:27.469415 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e2fa2-23b9-41d3-b978-4ae6cea92de3 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:27.469894 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e2fa2-23b9-41d3-b978-4ae6cea92de3 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:27.471830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 88/178] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:27.478063 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687bda0-8900-4520-8b42-a7f45019ada5 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:27.478732 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687bda0-8900-4520-8b42-a7f45019ada5 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:27.479226 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687bda0-8900-4520-8b42-a7f45019ada5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:27.497710 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-5687bda0-8900-4520-8b42-a7f45019ada5 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:27.499360 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-5687bda0-8900-4520-8b42-a7f45019ada5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:27.520354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:27.521254 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:27.559922 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 91/179] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:28:27.566512 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94006a-4168-4daa-b38f-8a997bf97b3c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:27.579072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 89/180] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:27.615330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc42c73-7e32-4185-9732-fb7b2b0acd98 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:27.615980 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc42c73-7e32-4185-9732-fb7b2b0acd98 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:27.616458 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc42c73-7e32-4185-9732-fb7b2b0acd98 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:27.618263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 90/181] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:28:27.627074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81f46f-5c29-47e6-8260-2da817a31b14 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:27.627711 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81f46f-5c29-47e6-8260-2da817a31b14 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:27.628197 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81f46f-5c29-47e6-8260-2da817a31b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:27.654196 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-bd81f46f-5c29-47e6-8260-2da817a31b14 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:27.655906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-bd81f46f-5c29-47e6-8260-2da817a31b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:27.724574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94006a-4168-4daa-b38f-8a997bf97b3c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:27.760173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 91/182] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:27.761953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e3b35-3cd3-4f77-84d1-eb23b81b6744 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:27.762440 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e3b35-3cd3-4f77-84d1-eb23b81b6744 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:27.762932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e3b35-3cd3-4f77-84d1-eb23b81b6744 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:27.768321 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 92/183] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:27.769068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e3b35-3cd3-4f77-84d1-eb23b81b6744 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:27.783196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b42acde-3fb1-4021-97bf-fb1486ad38ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:27.784523 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42acde-3fb1-4021-97bf-fb1486ad38ff None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:27.785084 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42acde-3fb1-4021-97bf-fb1486ad38ff None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:27.785632 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42acde-3fb1-4021-97bf-fb1486ad38ff None admin] PATH_INFO: `/v3/projects/e6ac8f5603484012a5ae8a6f3edd4a52` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:27.788582 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42acde-3fb1-4021-97bf-fb1486ad38ff None admin] RBAC: Authorizing `identity:get_project(project_id=e6ac8f5603484012a5ae8a6f3edd4a52)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:27.791778 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b42acde-3fb1-4021-97bf-fb1486ad38ff None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:27.794508 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 92/184] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:27 2022] GET /identity/v3/projects/e6ac8f5603484012a5ae8a6f3edd4a52 => generated 312 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:27.796169 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70d2ae-f182-4989-b502-e7cb296b0707 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:27.796665 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70d2ae-f182-4989-b502-e7cb296b0707 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:27.797145 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba70d2ae-f182-4989-b502-e7cb296b0707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:27.820553 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ba70d2ae-f182-4989-b502-e7cb296b0707 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:27.821801 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ba70d2ae-f182-4989-b502-e7cb296b0707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:27.856554 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:27.899311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:27.905560 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 93/185] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:27.906624 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70d2ae-f182-4989-b502-e7cb296b0707 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:27.918157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e3b35-3cd3-4f77-84d1-eb23b81b6744 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:27.951944 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351858e4-b7d9-445f-ad6c-035a99340390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:27.952744 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351858e4-b7d9-445f-ad6c-035a99340390 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:27.953028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351858e4-b7d9-445f-ad6c-035a99340390 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:27.953305 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351858e4-b7d9-445f-ad6c-035a99340390 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:27.964125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351858e4-b7d9-445f-ad6c-035a99340390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:27.972042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-351858e4-b7d9-445f-ad6c-035a99340390 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 19:28:27.972042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:27.972042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:27.972042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:27.972042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:27.972042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:27.972042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:27.972042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:27.972042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:27.972042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:27.972042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:27.972042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:27.972042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:27.972042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:27.972042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:27.972042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:27.972889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:27.972889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:27.972889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:27.972889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:27.972889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:27.972889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:27.972889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:27.972889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:27.972889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:27.972889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:27.972889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:27.972889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:27.972889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:27.972889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:27.972889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:27.972889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:27.979166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:27.979166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:27.979166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:27.979166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:27.979166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:27.979166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:27.979166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:27.979166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:27.979166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:27.979166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:27.979166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 19:28:27.979166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:27.979166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 93/186] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:27.979166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351858e4-b7d9-445f-ad6c-035a99340390 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:28.004556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba70d2ae-f182-4989-b502-e7cb296b0707 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:28.038633 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee70f5b-9efa-43d5-8761-ae6ce406df35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:28.039414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee70f5b-9efa-43d5-8761-ae6ce406df35 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:28.039693 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee70f5b-9efa-43d5-8761-ae6ce406df35 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:28.039967 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee70f5b-9efa-43d5-8761-ae6ce406df35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:28.050088 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee70f5b-9efa-43d5-8761-ae6ce406df35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:28.057605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-5ee70f5b-9efa-43d5-8761-ae6ce406df35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:28:28.057605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:28.057605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:28.057605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:28.057605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:28.057605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:28.057605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:28.057605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:28.057605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:28.057605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:28.057605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:28.057605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:28.057605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:28.057605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:28.057605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:28.057605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:28.058578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:28.058578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:28.058578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:28.058578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:28.058578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:28.058578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:28.058578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:28.058578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:28.058578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:28.058578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:28.058578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:28.058578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:28.058578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:28.058578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:28.058578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:28.058578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:28.059438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:28.059438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:28.059438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:28.059438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:28.059438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:28.059438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:28.059438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:28.059438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:28.059438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:28.059438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:28.059438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:28:28.059438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:28.059438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 94/187] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:28:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:28.060080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f5e9a-5c31-4c12-b5ba-ec2f14b9a4e3 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:28.060202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f5e9a-5c31-4c12-b5ba-ec2f14b9a4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:28.060477 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87f5e9a-5c31-4c12-b5ba-ec2f14b9a4e3 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:28.061765 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 95/188] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:28.062443 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f5e9a-5c31-4c12-b5ba-ec2f14b9a4e3 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:28.081824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351858e4-b7d9-445f-ad6c-035a99340390 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:28.090351 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:28.116147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20add9ca-f4a2-456d-b7d9-79d3fb32eec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:28.116800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20add9ca-f4a2-456d-b7d9-79d3fb32eec0 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:28.117102 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20add9ca-f4a2-456d-b7d9-79d3fb32eec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:28.117382 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20add9ca-f4a2-456d-b7d9-79d3fb32eec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:28.118237 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20add9ca-f4a2-456d-b7d9-79d3fb32eec0 None admin] RBAC: Adding query filter params (role.id=bf1733d36314409c80cd50b2268834b1, scope.project.id=e6ac8f5603484012a5ae8a6f3edd4a52, user.id=8949be5666f94730b962f3ed654313b6) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:28.118557 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20add9ca-f4a2-456d-b7d9-79d3fb32eec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:28.120002 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20add9ca-f4a2-456d-b7d9-79d3fb32eec0 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:28.125721 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 94/189] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:28:27 2022] GET /identity/v3/role_assignments?user.id=8949be5666f94730b962f3ed654313b6&scope.project.id=e6ac8f5603484012a5ae8a6f3edd4a52&role.id=bf1733d36314409c80cd50b2268834b1 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:28.126489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20add9ca-f4a2-456d-b7d9-79d3fb32eec0 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:28.143950 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:28.177958 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87f5e9a-5c31-4c12-b5ba-ec2f14b9a4e3 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:28.220027 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e71889-d513-4202-9880-aa3a7ddca1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:28.220976 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e71889-d513-4202-9880-aa3a7ddca1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:28.221255 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e71889-d513-4202-9880-aa3a7ddca1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:28.221558 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e71889-d513-4202-9880-aa3a7ddca1e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:28.232901 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e71889-d513-4202-9880-aa3a7ddca1e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:28.241245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-e6e71889-d513-4202-9880-aa3a7ddca1e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:28.241245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:28.241245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:28.241245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:28.241245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:28.241245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:28.241245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:28.241245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:28.241245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:28.241245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:28.241245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:28.241245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:28.241245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:28.241245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:28.241245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:28.241245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:28.242424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:28.242424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:28.242424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:28.242424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:28.242424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:28.242424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:28.242424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:28.242424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:28.242424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:28.242424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:28.242424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:28.242424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:28.242424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:28.242424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:28.242424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:28.242424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:28.243393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:28.243393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:28.243393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:28.243393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:28.243393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:28.243393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:28.243393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:28.243393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:28.243393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:28.243393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:28.243393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:28.243393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:28.243393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 96/190] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:28:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:28.243393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e71889-d513-4202-9880-aa3a7ddca1e4 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:28.258433 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20add9ca-f4a2-456d-b7d9-79d3fb32eec0 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:28.305260 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7680ab-51e2-4496-b6af-4073b04307c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:28.305960 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7680ab-51e2-4496-b6af-4073b04307c8 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:28.306247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7680ab-51e2-4496-b6af-4073b04307c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:28.306523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7680ab-51e2-4496-b6af-4073b04307c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:28.307270 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7680ab-51e2-4496-b6af-4073b04307c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:28.307578 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7680ab-51e2-4496-b6af-4073b04307c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:28.308961 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7680ab-51e2-4496-b6af-4073b04307c8 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:28.318776 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 95/191] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:28.322730 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33025a79-4629-434b-964d-ff95034f9e4c None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:28.323025 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33025a79-4629-434b-964d-ff95034f9e4c None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:28.323308 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33025a79-4629-434b-964d-ff95034f9e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:28.341134 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-33025a79-4629-434b-964d-ff95034f9e4c None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:28.342584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-33025a79-4629-434b-964d-ff95034f9e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:28.346613 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:28.361354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e71889-d513-4202-9880-aa3a7ddca1e4 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:28.397982 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e53b0-200c-4de9-8f78-ae28171c69e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:28.398649 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e53b0-200c-4de9-8f78-ae28171c69e0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:28.398939 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e53b0-200c-4de9-8f78-ae28171c69e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:28.399220 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e53b0-200c-4de9-8f78-ae28171c69e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:28.399969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e53b0-200c-4de9-8f78-ae28171c69e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:28.400282 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e53b0-200c-4de9-8f78-ae28171c69e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:28.401711 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e53b0-200c-4de9-8f78-ae28171c69e0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:28.409977 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 97/192] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:28.410571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e53b0-200c-4de9-8f78-ae28171c69e0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:28.416443 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:28.421835 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 96/193] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:28.422935 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33025a79-4629-434b-964d-ff95034f9e4c None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:28.517839 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e53b0-200c-4de9-8f78-ae28171c69e0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:28.522864 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33025a79-4629-434b-964d-ff95034f9e4c None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:28.552984 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b272cc-8a97-482a-b782-fc85521dc2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:28.553677 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b272cc-8a97-482a-b782-fc85521dc2df None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:28.553963 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b272cc-8a97-482a-b782-fc85521dc2df None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:28.554243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b272cc-8a97-482a-b782-fc85521dc2df None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:28.555049 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b272cc-8a97-482a-b782-fc85521dc2df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:28.555361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b272cc-8a97-482a-b782-fc85521dc2df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:28.556746 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b272cc-8a97-482a-b782-fc85521dc2df None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:28.557303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aced723-a0aa-4604-b04b-02cbfbfcf665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:28.558197 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aced723-a0aa-4604-b04b-02cbfbfcf665 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:28.558478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aced723-a0aa-4604-b04b-02cbfbfcf665 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:28.558755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aced723-a0aa-4604-b04b-02cbfbfcf665 None admin] PATH_INFO: `/v3/users/f9b7faf2dac248948b5572aa33781ed1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:28.559930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aced723-a0aa-4604-b04b-02cbfbfcf665 None admin] RBAC: Authorizing `identity:get_user(user_id=f9b7faf2dac248948b5572aa33781ed1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:28.561340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aced723-a0aa-4604-b04b-02cbfbfcf665 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:28.562982 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 97/194] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:28 2022] GET /identity/v3/users/f9b7faf2dac248948b5572aa33781ed1 => generated 289 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:28.562982 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aced723-a0aa-4604-b04b-02cbfbfcf665 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:28.572149 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 98/195] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:28:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:28.572149 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b272cc-8a97-482a-b782-fc85521dc2df None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:28.579458 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:28.633651 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:28.668537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aced723-a0aa-4604-b04b-02cbfbfcf665 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:28.668786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b272cc-8a97-482a-b782-fc85521dc2df None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:28.701421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80c869-3f55-4e87-8fe2-14be4d8e2865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:28.701883 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad717741-0d9b-435d-8b9e-3a6889e5934a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:28.702284 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80c869-3f55-4e87-8fe2-14be4d8e2865 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:28.702565 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80c869-3f55-4e87-8fe2-14be4d8e2865 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:28.702654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad717741-0d9b-435d-8b9e-3a6889e5934a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:28.702839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80c869-3f55-4e87-8fe2-14be4d8e2865 None admin] PATH_INFO: `/v3/users/d9563e5282044deebdf7e84af709e6cb` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:28.702949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad717741-0d9b-435d-8b9e-3a6889e5934a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:28.703205 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad717741-0d9b-435d-8b9e-3a6889e5934a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:28.704372 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad717741-0d9b-435d-8b9e-3a6889e5934a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:28.705985 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad717741-0d9b-435d-8b9e-3a6889e5934a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:28.707602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 99/196] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:28:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:28.708894 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad717741-0d9b-435d-8b9e-3a6889e5934a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:28.717054 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80c869-3f55-4e87-8fe2-14be4d8e2865 None admin] RBAC: Authorizing `identity:get_user(user_id=d9563e5282044deebdf7e84af709e6cb)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:28.718525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80c869-3f55-4e87-8fe2-14be4d8e2865 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:28.720330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 98/197] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:28 2022] GET /identity/v3/users/d9563e5282044deebdf7e84af709e6cb => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:28.720933 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80c869-3f55-4e87-8fe2-14be4d8e2865 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:28.795059 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:28.820976 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad717741-0d9b-435d-8b9e-3a6889e5934a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:28.824340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80c869-3f55-4e87-8fe2-14be4d8e2865 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:28.850688 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:28.855770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16807bc6-44b5-4252-9a4d-24fa104a9c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:28.856639 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16807bc6-44b5-4252-9a4d-24fa104a9c0b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:28.856919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16807bc6-44b5-4252-9a4d-24fa104a9c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:28.857191 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16807bc6-44b5-4252-9a4d-24fa104a9c0b None admin] PATH_INFO: `/v3/users/d9563e5282044deebdf7e84af709e6cb` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:28.858382 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16807bc6-44b5-4252-9a4d-24fa104a9c0b None admin] RBAC: Authorizing `identity:get_user(user_id=d9563e5282044deebdf7e84af709e6cb)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:28.859849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16807bc6-44b5-4252-9a4d-24fa104a9c0b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:28.859998 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd62cc-3871-4fac-ab75-db2507d74ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:28.860633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd62cc-3871-4fac-ab75-db2507d74ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:28.860921 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd62cc-3871-4fac-ab75-db2507d74ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:28.861199 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd62cc-3871-4fac-ab75-db2507d74ba2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:28.861484 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 100/198] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:28 2022] GET /identity/v3/users/d9563e5282044deebdf7e84af709e6cb => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:28.862198 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16807bc6-44b5-4252-9a4d-24fa104a9c0b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:28.928525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd62cc-3871-4fac-ab75-db2507d74ba2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:28.929937 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd62cc-3871-4fac-ab75-db2507d74ba2 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:28.961253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16807bc6-44b5-4252-9a4d-24fa104a9c0b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:28.993119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed7a13-558b-41cc-8cdd-f7d6555e244a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:28.993807 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed7a13-558b-41cc-8cdd-f7d6555e244a None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:28.994097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed7a13-558b-41cc-8cdd-f7d6555e244a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:28.994375 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed7a13-558b-41cc-8cdd-f7d6555e244a None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:28.995104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed7a13-558b-41cc-8cdd-f7d6555e244a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:28.996535 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed7a13-558b-41cc-8cdd-f7d6555e244a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:29.025610 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 101/199] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jun 14 19:28:28 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:28:29.026518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed7a13-558b-41cc-8cdd-f7d6555e244a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:29.029098 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:29.035477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 99/200] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:28:29.042219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd62cc-3871-4fac-ab75-db2507d74ba2 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:29.072947 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:29.147085 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed7a13-558b-41cc-8cdd-f7d6555e244a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:29.159351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd62cc-3871-4fac-ab75-db2507d74ba2 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:29.187104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e28ca-25fa-42b7-8f30-d83dcaa80bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:29.188114 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e28ca-25fa-42b7-8f30-d83dcaa80bba None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:29.188770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e28ca-25fa-42b7-8f30-d83dcaa80bba None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:29.189198 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e28ca-25fa-42b7-8f30-d83dcaa80bba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:29.197135 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9339be4-df70-4155-b7cb-dbd135856ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:29.197817 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9339be4-df70-4155-b7cb-dbd135856ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:29.198102 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9339be4-df70-4155-b7cb-dbd135856ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:29.198406 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9339be4-df70-4155-b7cb-dbd135856ea6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:29.272144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e28ca-25fa-42b7-8f30-d83dcaa80bba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:29.273730 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e28ca-25fa-42b7-8f30-d83dcaa80bba None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:29.275687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:29.292062 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9339be4-df70-4155-b7cb-dbd135856ea6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:29.293617 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9339be4-df70-4155-b7cb-dbd135856ea6 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:29.331590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:29.401121 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 102/201] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:28:29.405483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e28ca-25fa-42b7-8f30-d83dcaa80bba None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:29.424097 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 100/202] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:28:29.425238 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9339be4-df70-4155-b7cb-dbd135856ea6 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:29.525545 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e28ca-25fa-42b7-8f30-d83dcaa80bba None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:29.527142 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:29.543918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9339be4-df70-4155-b7cb-dbd135856ea6 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:29.572326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672c25c-32d8-4574-aa89-67bb4effd2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:29.573481 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672c25c-32d8-4574-aa89-67bb4effd2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:29.573770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672c25c-32d8-4574-aa89-67bb4effd2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:29.574052 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672c25c-32d8-4574-aa89-67bb4effd2f1 None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:29.575212 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:29.576771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672c25c-32d8-4574-aa89-67bb4effd2f1 None admin] RBAC: Authorizing `identity:get_project(project_id=2a169bbfc64d4c459ba54854d70678e7)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:29.578788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672c25c-32d8-4574-aa89-67bb4effd2f1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:29.582217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 103/203] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:29 2022] GET /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:29.583556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672c25c-32d8-4574-aa89-67bb4effd2f1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:29.587212 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a79b3f-0ca1-4e17-a496-e1a54dacfb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:29.588713 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a79b3f-0ca1-4e17-a496-e1a54dacfb13 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:29.589194 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a79b3f-0ca1-4e17-a496-e1a54dacfb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:29.589693 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a79b3f-0ca1-4e17-a496-e1a54dacfb13 None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:29.591118 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a79b3f-0ca1-4e17-a496-e1a54dacfb13 None admin] RBAC: Authorizing `identity:get_project(project_id=e743a4a482c24a1f88389b1830c2386e)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:29.592875 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a79b3f-0ca1-4e17-a496-e1a54dacfb13 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:29.595061 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 101/204] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:29 2022] GET /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:29.600834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a79b3f-0ca1-4e17-a496-e1a54dacfb13 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:29.711456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a79b3f-0ca1-4e17-a496-e1a54dacfb13 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:29.721625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672c25c-32d8-4574-aa89-67bb4effd2f1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:29.747960 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece3550-420e-4b3c-943e-5a852569821e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:29.749025 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece3550-420e-4b3c-943e-5a852569821e None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:29.749537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece3550-420e-4b3c-943e-5a852569821e None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:29.750126 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece3550-420e-4b3c-943e-5a852569821e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:29.751160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece3550-420e-4b3c-943e-5a852569821e None admin] RBAC: Adding query filter params (role.id=04bbf2f8d56744159d8dac700dde4379, scope.project.id=2a169bbfc64d4c459ba54854d70678e7, user.id=f9b7faf2dac248948b5572aa33781ed1) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:29.751673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece3550-420e-4b3c-943e-5a852569821e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:29.753319 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece3550-420e-4b3c-943e-5a852569821e None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:29.761555 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 102/205] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:28:29 2022] GET /identity/v3/role_assignments?user.id=f9b7faf2dac248948b5572aa33781ed1&scope.project.id=2a169bbfc64d4c459ba54854d70678e7&role.id=04bbf2f8d56744159d8dac700dde4379 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:29.762746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece3550-420e-4b3c-943e-5a852569821e None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:29.781795 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff40669-ab88-456c-8bc8-ca7e2c1e3e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:29.782596 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff40669-ab88-456c-8bc8-ca7e2c1e3e83 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:29.782884 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff40669-ab88-456c-8bc8-ca7e2c1e3e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:29.783164 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff40669-ab88-456c-8bc8-ca7e2c1e3e83 None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:29.784675 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff40669-ab88-456c-8bc8-ca7e2c1e3e83 None admin] RBAC: Authorizing `identity:get_project(project_id=e743a4a482c24a1f88389b1830c2386e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:29.787027 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff40669-ab88-456c-8bc8-ca7e2c1e3e83 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:29.790070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 104/206] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:29 2022] GET /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:29.796401 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff40669-ab88-456c-8bc8-ca7e2c1e3e83 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:29.839139 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:29.842575 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:29.893278 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece3550-420e-4b3c-943e-5a852569821e None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:29.909611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff40669-ab88-456c-8bc8-ca7e2c1e3e83 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:29.934634 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56afa8c-4a8a-4e4f-a999-147e61f6d6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:29.935752 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56afa8c-4a8a-4e4f-a999-147e61f6d6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:29.936327 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56afa8c-4a8a-4e4f-a999-147e61f6d6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:29.936806 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56afa8c-4a8a-4e4f-a999-147e61f6d6f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:29.937903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56afa8c-4a8a-4e4f-a999-147e61f6d6f0 None admin] RBAC: Adding query filter params (role.id=1e2bb0d759694428ada2b52285de933b, scope.project.id=e743a4a482c24a1f88389b1830c2386e, user.id=d9563e5282044deebdf7e84af709e6cb) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:29.938522 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56afa8c-4a8a-4e4f-a999-147e61f6d6f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:29.940327 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56afa8c-4a8a-4e4f-a999-147e61f6d6f0 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:29.947909 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba8017-e23d-4a49-b3bd-e195a1c2cb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:29.948450 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba8017-e23d-4a49-b3bd-e195a1c2cb12 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:29.948654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 103/207] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:28:29 2022] GET /identity/v3/role_assignments?user.id=d9563e5282044deebdf7e84af709e6cb&scope.project.id=e743a4a482c24a1f88389b1830c2386e&role.id=1e2bb0d759694428ada2b52285de933b => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:29.948750 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba8017-e23d-4a49-b3bd-e195a1c2cb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:29.953401 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba8017-e23d-4a49-b3bd-e195a1c2cb12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:29.953401 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba8017-e23d-4a49-b3bd-e195a1c2cb12 None admin] RBAC: Adding query filter params (role.id=1302d95e46b4422d84f581f8838d5aac, scope.project.id=e743a4a482c24a1f88389b1830c2386e, user.id=d9563e5282044deebdf7e84af709e6cb) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:29.953401 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba8017-e23d-4a49-b3bd-e195a1c2cb12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:29.953401 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba8017-e23d-4a49-b3bd-e195a1c2cb12 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:29.959058 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 105/208] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:28:29 2022] GET /identity/v3/role_assignments?user.id=d9563e5282044deebdf7e84af709e6cb&scope.project.id=e743a4a482c24a1f88389b1830c2386e&role.id=1302d95e46b4422d84f581f8838d5aac => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:31.405832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447dfc4-2b7a-4b54-aca2-21d2ff22ffc5 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:31.406845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447dfc4-2b7a-4b54-aca2-21d2ff22ffc5 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:31.407328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447dfc4-2b7a-4b54-aca2-21d2ff22ffc5 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:31.408923 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 104/209] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:31.414207 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cc81e-3a8e-4eff-86d9-3ba88a7021d0 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:31.415010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cc81e-3a8e-4eff-86d9-3ba88a7021d0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:31.415478 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2cc81e-3a8e-4eff-86d9-3ba88a7021d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:31.432950 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ed2cc81e-3a8e-4eff-86d9-3ba88a7021d0 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:31.434403 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ed2cc81e-3a8e-4eff-86d9-3ba88a7021d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:31.508049 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 106/210] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:31.531883 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447dfc4-2b7a-4b54-aca2-21d2ff22ffc5 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:31.554789 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cbd32-55df-46a2-8763-6b37e29340ae None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:31.555082 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cbd32-55df-46a2-8763-6b37e29340ae None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:31.555365 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cbd32-55df-46a2-8763-6b37e29340ae None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:31.556752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 107/211] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:31.561846 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a5a06-6d76-404e-8f93-f8306b352a96 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:31.562132 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a5a06-6d76-404e-8f93-f8306b352a96 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:31.562419 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a5a06-6d76-404e-8f93-f8306b352a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:31.584264 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-410a5a06-6d76-404e-8f93-f8306b352a96 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:31.585667 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-410a5a06-6d76-404e-8f93-f8306b352a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:31.613732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:31.643445 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447dfc4-2b7a-4b54-aca2-21d2ff22ffc5 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:31.664753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 108/212] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:31.672391 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:31.685655 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f234f0b-3eac-47ee-a0fb-a73b0885d890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:31.686465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f234f0b-3eac-47ee-a0fb-a73b0885d890 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:31.686747 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f234f0b-3eac-47ee-a0fb-a73b0885d890 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:31.687022 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f234f0b-3eac-47ee-a0fb-a73b0885d890 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:31.689484 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a5a06-6d76-404e-8f93-f8306b352a96 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:31.699213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f234f0b-3eac-47ee-a0fb-a73b0885d890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:31.707607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-8f234f0b-3eac-47ee-a0fb-a73b0885d890 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:31.707607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:31.707607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:31.707607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:31.707607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:31.707607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:31.707607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:31.707607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:31.707607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:31.707607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:31.707607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:31.707607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:31.707607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:31.707607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:31.707607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:31.707607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:31.708775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:31.708775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:31.708775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:31.708775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:31.708775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:31.708775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:31.708775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:31.708775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:31.708775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:31.708775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:31.708775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:31.708775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:31.708775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:31.708775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:31.708775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:31.708775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:31.709554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:31.709554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:31.709554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:31.709554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:31.709554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:31.709554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:31.709554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:31.709554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:31.709554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:31.709554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:31.709554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:31.709554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:31.709554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 105/213] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:31.714925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f234f0b-3eac-47ee-a0fb-a73b0885d890 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:31.792418 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a5a06-6d76-404e-8f93-f8306b352a96 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:31.833816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f234f0b-3eac-47ee-a0fb-a73b0885d890 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:31.836370 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c830638-b7ee-4f1c-a490-2fc1849c67aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:31.837346 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c830638-b7ee-4f1c-a490-2fc1849c67aa None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:31.837800 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c830638-b7ee-4f1c-a490-2fc1849c67aa None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:31.838212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c830638-b7ee-4f1c-a490-2fc1849c67aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:31.839534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c830638-b7ee-4f1c-a490-2fc1849c67aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:31.841157 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c830638-b7ee-4f1c-a490-2fc1849c67aa None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:31.842957 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 109/214] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:28:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:31.853393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c830638-b7ee-4f1c-a490-2fc1849c67aa None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:31.871588 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0048bc-a2d1-4e44-8ff4-bc95c87324ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:31.872608 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0048bc-a2d1-4e44-8ff4-bc95c87324ad None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:31.873158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0048bc-a2d1-4e44-8ff4-bc95c87324ad None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:31.873608 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0048bc-a2d1-4e44-8ff4-bc95c87324ad None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:31.874492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0048bc-a2d1-4e44-8ff4-bc95c87324ad None admin] RBAC: Adding query filter params (name=member) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:31.874940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0048bc-a2d1-4e44-8ff4-bc95c87324ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:31.876587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0048bc-a2d1-4e44-8ff4-bc95c87324ad None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:31.884749 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:31.890664 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 106/215] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:31.893944 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0048bc-a2d1-4e44-8ff4-bc95c87324ad None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:31.944556 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:31.966090 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c830638-b7ee-4f1c-a490-2fc1849c67aa None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:32.011780 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0048bc-a2d1-4e44-8ff4-bc95c87324ad None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:32.015426 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bc9a1-c9ca-4ef2-82a4-327f01004e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:32.015976 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bc9a1-c9ca-4ef2-82a4-327f01004e1e None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:32.016260 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bc9a1-c9ca-4ef2-82a4-327f01004e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:32.016540 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bc9a1-c9ca-4ef2-82a4-327f01004e1e None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:32.017258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bc9a1-c9ca-4ef2-82a4-327f01004e1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:32.018739 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bc9a1-c9ca-4ef2-82a4-327f01004e1e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:32.053634 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 110/216] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jun 14 19:28:31 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:28:32.064999 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f41d9-15c6-4f67-a5fd-c932366b29ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:32.065939 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f41d9-15c6-4f67-a5fd-c932366b29ff None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:32.066217 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f41d9-15c6-4f67-a5fd-c932366b29ff None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:32.066559 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f41d9-15c6-4f67-a5fd-c932366b29ff None admin] PATH_INFO: `/v3/users/3bed1751c0084129bf12fdcf6a411698` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:32.083137 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f41d9-15c6-4f67-a5fd-c932366b29ff None admin] RBAC: Authorizing `identity:get_user(user_id=3bed1751c0084129bf12fdcf6a411698)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:32.085199 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f41d9-15c6-4f67-a5fd-c932366b29ff None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:32.087697 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 107/217] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:31 2022] GET /identity/v3/users/3bed1751c0084129bf12fdcf6a411698 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:32.093289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bc9a1-c9ca-4ef2-82a4-327f01004e1e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:32.188406 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa094f51-e538-462c-a504-1a9ab59726ab None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:32.189048 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa094f51-e538-462c-a504-1a9ab59726ab None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:32.189560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa094f51-e538-462c-a504-1a9ab59726ab None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:32.191161 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 108/218] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:32.196906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e5dfb-dad5-4861-97b7-56fc3f95882f None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:32.197543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e5dfb-dad5-4861-97b7-56fc3f95882f None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:32.198021 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e5dfb-dad5-4861-97b7-56fc3f95882f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:32.205330 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:32.220686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-778e5dfb-dad5-4861-97b7-56fc3f95882f None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:32.221940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-778e5dfb-dad5-4861-97b7-56fc3f95882f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:32.224169 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bc9a1-c9ca-4ef2-82a4-327f01004e1e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:32.264399 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92cf29-4a8d-40b6-89cd-2311fbcba301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:32.265057 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92cf29-4a8d-40b6-89cd-2311fbcba301 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:32.265345 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92cf29-4a8d-40b6-89cd-2311fbcba301 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:32.265651 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92cf29-4a8d-40b6-89cd-2311fbcba301 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:32.308418 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 109/219] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:32.309757 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882d36e-f699-49cf-a996-d99ca2b3af19 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:32.310302 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882d36e-f699-49cf-a996-d99ca2b3af19 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:32.310586 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9882d36e-f699-49cf-a996-d99ca2b3af19 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:32.311863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 110/220] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:32.317032 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcf086-098e-4774-b24e-933b9db2c096 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:32.317318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcf086-098e-4774-b24e-933b9db2c096 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:32.317887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcf086-098e-4774-b24e-933b9db2c096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:32.337753 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-0dbcf086-098e-4774-b24e-933b9db2c096 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:32.339043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-0dbcf086-098e-4774-b24e-933b9db2c096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:32.345970 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92cf29-4a8d-40b6-89cd-2311fbcba301 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:32.347694 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92cf29-4a8d-40b6-89cd-2311fbcba301 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:32.373176 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:32.438373 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 111/221] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:32.438373 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcf086-098e-4774-b24e-933b9db2c096 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:32.459426 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:32.485614 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 111/222] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:28:32.486588 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92cf29-4a8d-40b6-89cd-2311fbcba301 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:32.554737 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcf086-098e-4774-b24e-933b9db2c096 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:32.599507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768caafc-d4d0-416c-b0f5-a901d6c78d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:32.600328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768caafc-d4d0-416c-b0f5-a901d6c78d1c None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:32.600613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768caafc-d4d0-416c-b0f5-a901d6c78d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:32.600894 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768caafc-d4d0-416c-b0f5-a901d6c78d1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:32.616929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92cf29-4a8d-40b6-89cd-2311fbcba301 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:32.617099 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768caafc-d4d0-416c-b0f5-a901d6c78d1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:32.627743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-768caafc-d4d0-416c-b0f5-a901d6c78d1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:28:32.627743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:32.627743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:32.627743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:32.627743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:32.627743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:32.627743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:32.627743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:32.627743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:32.627743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:32.627743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:32.627743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:32.627743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:32.627743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:32.627743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:32.627743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:32.628607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:32.628607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:32.628607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:32.628607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:32.628607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:32.628607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:32.628607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:32.628607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:32.628607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:32.628607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:32.628607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:32.628607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:32.628607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:32.628607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:32.628607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:32.628607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:32.629407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:32.629407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:32.629407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:32.629407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:32.629407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:32.629407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:32.629407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:32.629407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:32.629407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:32.629407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:32.629407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:28:32.629407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:32.629407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 112/223] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:28:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:32.633874 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768caafc-d4d0-416c-b0f5-a901d6c78d1c None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:32.664244 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c1ff2-b7bb-41b9-bd3c-93ba05ba1cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:32.665721 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1ff2-b7bb-41b9-bd3c-93ba05ba1cdb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:32.666705 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1ff2-b7bb-41b9-bd3c-93ba05ba1cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:32.667486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3c1ff2-b7bb-41b9-bd3c-93ba05ba1cdb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:32.673781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:32.682561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3c1ff2-b7bb-41b9-bd3c-93ba05ba1cdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:32.693556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-5d3c1ff2-b7bb-41b9-bd3c-93ba05ba1cdb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:32.693556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:32.693556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:32.693556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:32.693556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:32.693556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:32.693556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:32.693556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:32.693556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:32.693556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:32.693556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:32.693556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:32.693556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:32.693556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:32.693556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:32.693556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:32.694431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:32.694431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:32.694431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:32.694431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:32.694431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:32.694431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:32.694431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:32.694431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:32.694431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:32.694431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:32.694431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:32.694431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:32.694431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:32.694431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:32.694431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:32.694431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:32.695180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:32.695180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:32.695180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:32.695180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:32.695180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:32.695180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:32.695180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:32.695180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:32.695180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:32.695180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:32.695180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:32.695180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:32.698097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 112/224] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:28:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:32.699100 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c1ff2-b7bb-41b9-bd3c-93ba05ba1cdb None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:32.760090 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:32.767077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768caafc-d4d0-416c-b0f5-a901d6c78d1c None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:32.812725 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a28db-bbb6-4df1-9cdb-c3fc0b5419f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:32.813676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a28db-bbb6-4df1-9cdb-c3fc0b5419f1 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:32.813961 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a28db-bbb6-4df1-9cdb-c3fc0b5419f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:32.814239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a28db-bbb6-4df1-9cdb-c3fc0b5419f1 None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:32.815649 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a28db-bbb6-4df1-9cdb-c3fc0b5419f1 None admin] RBAC: Authorizing `identity:get_project(project_id=e743a4a482c24a1f88389b1830c2386e)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:32.819576 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a28db-bbb6-4df1-9cdb-c3fc0b5419f1 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:32.822319 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 113/225] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:32 2022] GET /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:32.822947 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a28db-bbb6-4df1-9cdb-c3fc0b5419f1 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:32.845367 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3c1ff2-b7bb-41b9-bd3c-93ba05ba1cdb None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:32.883745 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118548cc-cd75-4f72-8a1c-0839703af4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:32.884418 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118548cc-cd75-4f72-8a1c-0839703af4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:32.884702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118548cc-cd75-4f72-8a1c-0839703af4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:32.884982 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118548cc-cd75-4f72-8a1c-0839703af4e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:32.885892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118548cc-cd75-4f72-8a1c-0839703af4e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:32.886207 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118548cc-cd75-4f72-8a1c-0839703af4e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:32.887871 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118548cc-cd75-4f72-8a1c-0839703af4e3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:32.897533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 113/226] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:32.898362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118548cc-cd75-4f72-8a1c-0839703af4e3 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:32.925204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:32.936808 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a28db-bbb6-4df1-9cdb-c3fc0b5419f1 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:32.972044 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f1b4a-9d91-4e61-91e8-791f68ab15f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:32.973085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f1b4a-9d91-4e61-91e8-791f68ab15f8 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:32.973688 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f1b4a-9d91-4e61-91e8-791f68ab15f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:32.974169 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568f1b4a-9d91-4e61-91e8-791f68ab15f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:32.975303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f1b4a-9d91-4e61-91e8-791f68ab15f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:32.975827 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f1b4a-9d91-4e61-91e8-791f68ab15f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:32.977408 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568f1b4a-9d91-4e61-91e8-791f68ab15f8 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:32.986149 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 114/227] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:28:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:32.987247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f1b4a-9d91-4e61-91e8-791f68ab15f8 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:33.011535 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118548cc-cd75-4f72-8a1c-0839703af4e3 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:33.021821 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:33.051337 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55257f-2ba8-4115-babd-fb1a48d56360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:33.052479 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55257f-2ba8-4115-babd-fb1a48d56360 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:33.052767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55257f-2ba8-4115-babd-fb1a48d56360 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:33.053044 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55257f-2ba8-4115-babd-fb1a48d56360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:33.054009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55257f-2ba8-4115-babd-fb1a48d56360 None admin] RBAC: Adding query filter params (role.id=bf1733d36314409c80cd50b2268834b1, scope.project.id=e743a4a482c24a1f88389b1830c2386e, user.id=3bed1751c0084129bf12fdcf6a411698) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:33.054326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55257f-2ba8-4115-babd-fb1a48d56360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:33.055991 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55257f-2ba8-4115-babd-fb1a48d56360 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:33.062174 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 114/228] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:28:32 2022] GET /identity/v3/role_assignments?user.id=3bed1751c0084129bf12fdcf6a411698&scope.project.id=e743a4a482c24a1f88389b1830c2386e&role.id=bf1733d36314409c80cd50b2268834b1 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:33.069645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55257f-2ba8-4115-babd-fb1a48d56360 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:33.097045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568f1b4a-9d91-4e61-91e8-791f68ab15f8 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:33.136504 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a799fa-f18b-4a2d-85ec-aa2193745468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:33.137778 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a799fa-f18b-4a2d-85ec-aa2193745468 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:33.138265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a799fa-f18b-4a2d-85ec-aa2193745468 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:33.138738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a799fa-f18b-4a2d-85ec-aa2193745468 None admin] PATH_INFO: `/v3/users/d9563e5282044deebdf7e84af709e6cb` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:33.140249 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a799fa-f18b-4a2d-85ec-aa2193745468 None admin] RBAC: Authorizing `identity:get_user(user_id=d9563e5282044deebdf7e84af709e6cb)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:33.142019 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a799fa-f18b-4a2d-85ec-aa2193745468 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:33.143937 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 115/229] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:32 2022] GET /identity/v3/users/d9563e5282044deebdf7e84af709e6cb => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:33.154456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a799fa-f18b-4a2d-85ec-aa2193745468 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:33.197885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:33.211707 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55257f-2ba8-4115-babd-fb1a48d56360 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:33.282187 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f37596-05ac-4e2c-ab9a-c8902283ab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:33.282992 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f37596-05ac-4e2c-ab9a-c8902283ab2a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:33.283273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f37596-05ac-4e2c-ab9a-c8902283ab2a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:33.283548 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f37596-05ac-4e2c-ab9a-c8902283ab2a None admin] PATH_INFO: `/v3/users/d9563e5282044deebdf7e84af709e6cb` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:33.290265 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f37596-05ac-4e2c-ab9a-c8902283ab2a None admin] RBAC: Authorizing `identity:get_user(user_id=d9563e5282044deebdf7e84af709e6cb)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:33.292036 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f37596-05ac-4e2c-ab9a-c8902283ab2a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:33.294160 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 115/230] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:33 2022] GET /identity/v3/users/d9563e5282044deebdf7e84af709e6cb => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:33.299432 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f37596-05ac-4e2c-ab9a-c8902283ab2a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:33.321455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a799fa-f18b-4a2d-85ec-aa2193745468 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:33.378908 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:33.386295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd4f4c-a2c1-4a89-a30e-513838ea5a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:33.387459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd4f4c-a2c1-4a89-a30e-513838ea5a59 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:33.387681 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd4f4c-a2c1-4a89-a30e-513838ea5a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:33.387997 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd4f4c-a2c1-4a89-a30e-513838ea5a59 None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:33.390184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd4f4c-a2c1-4a89-a30e-513838ea5a59 None admin] RBAC: Authorizing `identity:get_project(project_id=e743a4a482c24a1f88389b1830c2386e)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:33.391665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd4f4c-a2c1-4a89-a30e-513838ea5a59 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:33.394407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 116/231] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:33 2022] GET /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:33.399207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd4f4c-a2c1-4a89-a30e-513838ea5a59 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:33.481262 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f37596-05ac-4e2c-ab9a-c8902283ab2a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:33.517790 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146d1dd-6cf9-497c-8c25-dd4a83acbc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:33.518696 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146d1dd-6cf9-497c-8c25-dd4a83acbc9b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:33.518990 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146d1dd-6cf9-497c-8c25-dd4a83acbc9b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:33.519271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146d1dd-6cf9-497c-8c25-dd4a83acbc9b None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:33.520670 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146d1dd-6cf9-497c-8c25-dd4a83acbc9b None admin] RBAC: Authorizing `identity:get_project(project_id=e743a4a482c24a1f88389b1830c2386e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:33.522154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146d1dd-6cf9-497c-8c25-dd4a83acbc9b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:33.528795 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 116/232] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:33 2022] GET /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:33.530130 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146d1dd-6cf9-497c-8c25-dd4a83acbc9b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:33.532978 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:33.549260 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd4f4c-a2c1-4a89-a30e-513838ea5a59 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:33.609526 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4867f-3c6c-49a7-ae5a-e4423cd2a7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:33.610432 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4867f-3c6c-49a7-ae5a-e4423cd2a7a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:33.610725 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4867f-3c6c-49a7-ae5a-e4423cd2a7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:33.611007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4867f-3c6c-49a7-ae5a-e4423cd2a7a3 None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e/users/d9563e5282044deebdf7e84af709e6cb/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:33.613762 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4867f-3c6c-49a7-ae5a-e4423cd2a7a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e743a4a482c24a1f88389b1830c2386e, user_id=d9563e5282044deebdf7e84af709e6cb, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:33.615800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4867f-3c6c-49a7-ae5a-e4423cd2a7a3 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:33.640617 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 117/233] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:28:33 2022] PUT /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e/users/d9563e5282044deebdf7e84af709e6cb/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:28:33.671818 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146d1dd-6cf9-497c-8c25-dd4a83acbc9b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:33.682205 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:33.711335 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6cec8a-70f1-4160-ba12-99ae5eda44fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:33.712239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cec8a-70f1-4160-ba12-99ae5eda44fb None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:33.712523 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cec8a-70f1-4160-ba12-99ae5eda44fb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:33.712863 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6cec8a-70f1-4160-ba12-99ae5eda44fb None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e/users/d9563e5282044deebdf7e84af709e6cb/roles/1302d95e46b4422d84f581f8838d5aac` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:33.715248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cec8a-70f1-4160-ba12-99ae5eda44fb None admin] RBAC: Authorizing `identity:create_grant(project_id=e743a4a482c24a1f88389b1830c2386e, user_id=d9563e5282044deebdf7e84af709e6cb, role_id=1302d95e46b4422d84f581f8838d5aac)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:33.716847 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6cec8a-70f1-4160-ba12-99ae5eda44fb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:33.734707 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 117/234] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:28:33 2022] PUT /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e/users/d9563e5282044deebdf7e84af709e6cb/roles/1302d95e46b4422d84f581f8838d5aac => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:28:34.677624 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa3da9-ad72-4fb6-9b2f-5d22a31d5306 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:34.678143 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa3da9-ad72-4fb6-9b2f-5d22a31d5306 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:34.678218 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa3da9-ad72-4fb6-9b2f-5d22a31d5306 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:34.679870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 118/235] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:34.684789 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858077a-64fb-45ec-a807-c612a3d42a0a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:34.685201 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858077a-64fb-45ec-a807-c612a3d42a0a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:34.685388 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858077a-64fb-45ec-a807-c612a3d42a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:34.706383 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d858077a-64fb-45ec-a807-c612a3d42a0a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:34.707600 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d858077a-64fb-45ec-a807-c612a3d42a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:34.796047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 118/236] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:34.835612 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa3da9-ad72-4fb6-9b2f-5d22a31d5306 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:34.904171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8876ec-3180-4783-9e67-99d79dc123d0 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:34.904489 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8876ec-3180-4783-9e67-99d79dc123d0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:34.904726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8876ec-3180-4783-9e67-99d79dc123d0 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:34.906403 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 119/237] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:34.912276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6501469-64bb-4b23-9487-c4487373b0ab None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:34.912562 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6501469-64bb-4b23-9487-c4487373b0ab None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:34.912841 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6501469-64bb-4b23-9487-c4487373b0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:34.946433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d6501469-64bb-4b23-9487-c4487373b0ab None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:34.947535 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d6501469-64bb-4b23-9487-c4487373b0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:34.964842 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa3da9-ad72-4fb6-9b2f-5d22a31d5306 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:35.004322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2553e4-4cfe-4256-a118-48fa2d846cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:35.005502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2553e4-4cfe-4256-a118-48fa2d846cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:35.006698 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2553e4-4cfe-4256-a118-48fa2d846cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:35.007216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2553e4-4cfe-4256-a118-48fa2d846cf2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:35.028393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2553e4-4cfe-4256-a118-48fa2d846cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:35.042628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-6a2553e4-4cfe-4256-a118-48fa2d846cf2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 19:28:35.042628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:35.042628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:35.042628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:35.042628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:35.042628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:35.042628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:35.042628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:35.042628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:35.042628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:35.042628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:35.042628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:35.042628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:35.042628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:35.042628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:35.042628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:35.043502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:35.043502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:35.043502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:35.043502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:35.043502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:35.043502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:35.043502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:35.043502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:35.043502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:35.043502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:35.043502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:35.043502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:35.043502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:35.043502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:35.043502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:35.043502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:35.044295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:35.044295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:35.044295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:35.044295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:35.044295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:35.044295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:35.044295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:35.044295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:35.044295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:35.044295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:35.044295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 19:28:35.044295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:35.048749 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 119/238] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:35.053535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2553e4-4cfe-4256-a118-48fa2d846cf2 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:35.075074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:35.088735 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 120/239] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:35.128663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6501469-64bb-4b23-9487-c4487373b0ab None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:35.186774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:35.218449 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2553e4-4cfe-4256-a118-48fa2d846cf2 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:35.257340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5419890-34aa-44d4-8b79-d71b4f70ec8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:35.258378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5419890-34aa-44d4-8b79-d71b4f70ec8b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:35.258862 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5419890-34aa-44d4-8b79-d71b4f70ec8b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:35.259759 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5419890-34aa-44d4-8b79-d71b4f70ec8b None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:35.260738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5419890-34aa-44d4-8b79-d71b4f70ec8b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:35.261267 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5419890-34aa-44d4-8b79-d71b4f70ec8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:35.262881 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5419890-34aa-44d4-8b79-d71b4f70ec8b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:35.273268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 120/240] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:35.281419 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5419890-34aa-44d4-8b79-d71b4f70ec8b None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:35.354337 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6501469-64bb-4b23-9487-c4487373b0ab None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:35.409949 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:35.412249 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229212b-5ac6-4a33-8de1-812e3292e767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:35.413045 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229212b-5ac6-4a33-8de1-812e3292e767 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:35.413327 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229212b-5ac6-4a33-8de1-812e3292e767 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:35.413661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229212b-5ac6-4a33-8de1-812e3292e767 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:35.417397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229212b-5ac6-4a33-8de1-812e3292e767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:35.417397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229212b-5ac6-4a33-8de1-812e3292e767 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:35.418549 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 121/241] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:28:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:35.430446 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229212b-5ac6-4a33-8de1-812e3292e767 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:35.446866 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5419890-34aa-44d4-8b79-d71b4f70ec8b None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:35.482755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38220b-f5de-4898-b74d-9c3e1c7a2d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:35.483556 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38220b-f5de-4898-b74d-9c3e1c7a2d12 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:35.483862 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38220b-f5de-4898-b74d-9c3e1c7a2d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:35.484208 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38220b-f5de-4898-b74d-9c3e1c7a2d12 None admin] PATH_INFO: `/v3/users/79e04ec20eee48c0b0faefbca93339a9` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:35.500616 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38220b-f5de-4898-b74d-9c3e1c7a2d12 None admin] RBAC: Authorizing `identity:get_user(user_id=79e04ec20eee48c0b0faefbca93339a9)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:35.502273 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38220b-f5de-4898-b74d-9c3e1c7a2d12 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:35.504290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 121/242] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:35 2022] GET /identity/v3/users/79e04ec20eee48c0b0faefbca93339a9 => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:35.510811 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38220b-f5de-4898-b74d-9c3e1c7a2d12 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:35.626796 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:35.635125 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229212b-5ac6-4a33-8de1-812e3292e767 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:35.670098 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc781273-72d8-4d55-9dbf-2073a684b4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:35.670792 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc781273-72d8-4d55-9dbf-2073a684b4d8 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:35.671080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc781273-72d8-4d55-9dbf-2073a684b4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:35.671360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc781273-72d8-4d55-9dbf-2073a684b4d8 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:35.672088 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc781273-72d8-4d55-9dbf-2073a684b4d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:35.672749 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38220b-f5de-4898-b74d-9c3e1c7a2d12 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:35.673842 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc781273-72d8-4d55-9dbf-2073a684b4d8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:35.718858 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 122/243] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jun 14 19:28:35 2022] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:28:35.736819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6893ec-8938-449f-ae72-0d822f9e896d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:35.737517 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6893ec-8938-449f-ae72-0d822f9e896d None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:35.737949 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6893ec-8938-449f-ae72-0d822f9e896d None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:35.738251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6893ec-8938-449f-ae72-0d822f9e896d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:35.749947 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f21cb8-76fb-4b6e-83a5-d27977cba0ad None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:35.750612 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f21cb8-76fb-4b6e-83a5-d27977cba0ad None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:35.751091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f21cb8-76fb-4b6e-83a5-d27977cba0ad None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:35.752794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 123/244] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:35.757454 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:35.759145 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c69a0-4518-47f6-972f-6c5cd9feef70 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:35.759661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c69a0-4518-47f6-972f-6c5cd9feef70 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:35.760143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c69a0-4518-47f6-972f-6c5cd9feef70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:35.779925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-551c69a0-4518-47f6-972f-6c5cd9feef70 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:35.781513 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-551c69a0-4518-47f6-972f-6c5cd9feef70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:35.815720 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6893ec-8938-449f-ae72-0d822f9e896d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:35.820157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6893ec-8938-449f-ae72-0d822f9e896d None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:35.938253 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 122/245] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:28:35.939934 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 124/246] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:35.943807 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6893ec-8938-449f-ae72-0d822f9e896d None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:35.966499 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c69a0-4518-47f6-972f-6c5cd9feef70 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:35.972527 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:36.059603 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6893ec-8938-449f-ae72-0d822f9e896d None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:36.076587 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:36.104047 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ca389-2a9d-4f46-b1cd-a21a11abfab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:36.104912 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ca389-2a9d-4f46-b1cd-a21a11abfab4 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:36.105189 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ca389-2a9d-4f46-b1cd-a21a11abfab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:36.105525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ca389-2a9d-4f46-b1cd-a21a11abfab4 None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:36.106712 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ca389-2a9d-4f46-b1cd-a21a11abfab4 None admin] RBAC: Authorizing `identity:get_project(project_id=e743a4a482c24a1f88389b1830c2386e)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:36.107189 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c69a0-4518-47f6-972f-6c5cd9feef70 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:36.108167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ca389-2a9d-4f46-b1cd-a21a11abfab4 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:36.110749 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 123/247] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:35 2022] GET /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:36.118806 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ca389-2a9d-4f46-b1cd-a21a11abfab4 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:36.154900 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87430f20-fa99-4aeb-a79b-8158c2f99650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:36.156272 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87430f20-fa99-4aeb-a79b-8158c2f99650 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:36.156941 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87430f20-fa99-4aeb-a79b-8158c2f99650 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:36.157359 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87430f20-fa99-4aeb-a79b-8158c2f99650 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:36.172087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87430f20-fa99-4aeb-a79b-8158c2f99650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:36.183194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-87430f20-fa99-4aeb-a79b-8158c2f99650 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:36.183194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:36.183194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:36.183194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:36.183194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:36.183194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:36.183194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:36.183194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:36.183194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:36.183194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:36.183194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:36.183194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:36.183194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:36.183194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:36.183194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:36.183194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:36.184297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:36.184297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:36.184297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:36.184297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:36.184297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:36.184297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:36.184297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:36.184297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:36.184297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:36.184297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:36.184297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:36.184297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:36.184297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:36.184297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:36.184297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:36.184297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:36.185246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:36.185246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:36.185246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:36.185246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:36.185246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:36.185246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:36.185246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:36.185246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:36.185246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:36.185246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:36.185246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:36.185246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:36.188950 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 125/248] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:28:36.197104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87430f20-fa99-4aeb-a79b-8158c2f99650 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:36.258725 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:36.271207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ca389-2a9d-4f46-b1cd-a21a11abfab4 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:36.313037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c219f-0414-468d-acbc-e4a9b2dec513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:36.314112 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c219f-0414-468d-acbc-e4a9b2dec513 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:36.314590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c219f-0414-468d-acbc-e4a9b2dec513 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:36.315060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c219f-0414-468d-acbc-e4a9b2dec513 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:36.316086 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c219f-0414-468d-acbc-e4a9b2dec513 None admin] RBAC: Adding query filter params (role.id=04bbf2f8d56744159d8dac700dde4379, scope.project.id=e743a4a482c24a1f88389b1830c2386e, user.id=79e04ec20eee48c0b0faefbca93339a9) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:36.316656 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c219f-0414-468d-acbc-e4a9b2dec513 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:36.319107 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c219f-0414-468d-acbc-e4a9b2dec513 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:36.326932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 124/249] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:28:36 2022] GET /identity/v3/role_assignments?user.id=79e04ec20eee48c0b0faefbca93339a9&scope.project.id=e743a4a482c24a1f88389b1830c2386e&role.id=04bbf2f8d56744159d8dac700dde4379 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:36.328539 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba600a4b-c9e7-4ef8-9b84-9befdc00683b None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:36.328832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba600a4b-c9e7-4ef8-9b84-9befdc00683b None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:36.329109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba600a4b-c9e7-4ef8-9b84-9befdc00683b None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:36.330975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 125/250] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:36.339160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08d7e9-e404-4862-a231-b67318dbbefd None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:36.339469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08d7e9-e404-4862-a231-b67318dbbefd None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:36.339716 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac08d7e9-e404-4862-a231-b67318dbbefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:36.341213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87430f20-fa99-4aeb-a79b-8158c2f99650 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:36.378540 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-ac08d7e9-e404-4862-a231-b67318dbbefd None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:36.380562 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-ac08d7e9-e404-4862-a231-b67318dbbefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:36.388375 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac364f-b148-4658-af84-8817e57248a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:36.389116 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac364f-b148-4658-af84-8817e57248a3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:36.389431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac364f-b148-4658-af84-8817e57248a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:36.393404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac364f-b148-4658-af84-8817e57248a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:36.393404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac364f-b148-4658-af84-8817e57248a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:36.393404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac364f-b148-4658-af84-8817e57248a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:36.393404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac364f-b148-4658-af84-8817e57248a3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:36.409321 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 126/251] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:36.413721 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac364f-b148-4658-af84-8817e57248a3 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:36.420451 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:36.487706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 126/252] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:36.513747 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08d7e9-e404-4862-a231-b67318dbbefd None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:36.552015 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac364f-b148-4658-af84-8817e57248a3 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:36.594861 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecae37d-1310-4475-ae7c-b0d7208d1ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:36.596346 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecae37d-1310-4475-ae7c-b0d7208d1ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:36.596987 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecae37d-1310-4475-ae7c-b0d7208d1ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:36.597263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecae37d-1310-4475-ae7c-b0d7208d1ed7 None admin] PATH_INFO: `/v3/users/3bed1751c0084129bf12fdcf6a411698` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:36.599498 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecae37d-1310-4475-ae7c-b0d7208d1ed7 None admin] RBAC: Authorizing `identity:get_user(user_id=3bed1751c0084129bf12fdcf6a411698)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:36.601445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecae37d-1310-4475-ae7c-b0d7208d1ed7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:36.603784 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 127/253] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:36 2022] GET /identity/v3/users/3bed1751c0084129bf12fdcf6a411698 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:36.605188 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dfd59-a1b6-45f9-ba68-3bfa208f39e3 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:36.605865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dfd59-a1b6-45f9-ba68-3bfa208f39e3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:36.606293 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7dfd59-a1b6-45f9-ba68-3bfa208f39e3 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:36.607675 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 128/254] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:36.613409 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7f590-2f62-47d1-8497-fd232e00e339 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:36.613560 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7f590-2f62-47d1-8497-fd232e00e339 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:36.614450 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f7f590-2f62-47d1-8497-fd232e00e339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:36.633920 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-88f7f590-2f62-47d1-8497-fd232e00e339 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:36.635252 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-88f7f590-2f62-47d1-8497-fd232e00e339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:36.662918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:36.680736 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac08d7e9-e404-4862-a231-b67318dbbefd None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:36.740717 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 129/255] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 14 19:28:36.741736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7f590-2f62-47d1-8497-fd232e00e339 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:36.744163 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:36.774657 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4aebc-9826-4cea-b861-3ea228950575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:36.775474 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4aebc-9826-4cea-b861-3ea228950575 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:36.775755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4aebc-9826-4cea-b861-3ea228950575 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:36.776032 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4aebc-9826-4cea-b861-3ea228950575 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:36.798203 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4aebc-9826-4cea-b861-3ea228950575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:36.825180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-ffa4aebc-9826-4cea-b861-3ea228950575 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:28:36.825180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:36.825180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:36.825180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:36.825180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:36.825180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:36.825180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:36.825180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:36.825180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:36.825180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:36.825180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:36.825180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:36.825180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:36.825180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:36.825180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:36.825180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:36.826266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:36.826266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:36.826266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:36.826266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:36.826266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:36.826266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:36.826266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:36.826266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:36.826266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:36.826266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:36.826266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:36.826266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:36.826266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:36.826266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:36.826266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:36.826266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:36.827153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:36.827153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:36.827153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:36.827153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:36.827153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:36.827153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:36.827153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:36.827153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:36.827153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:36.827153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:36.827153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:28:36.827153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:36.830050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 127/256] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:28:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:28:36.831782 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4aebc-9826-4cea-b861-3ea228950575 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:36.943635 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f7f590-2f62-47d1-8497-fd232e00e339 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:36.948465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4aebc-9826-4cea-b861-3ea228950575 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:36.986713 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adc24d-e828-430e-a08b-c99b2ce9e2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:36.987972 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29ac99-5098-421e-8ba0-7c4c458c0aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:36.988231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adc24d-e828-430e-a08b-c99b2ce9e2de None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:36.988728 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adc24d-e828-430e-a08b-c99b2ce9e2de None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:36.988868 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29ac99-5098-421e-8ba0-7c4c458c0aad None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:36.989134 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29ac99-5098-421e-8ba0-7c4c458c0aad None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:36.989432 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29ac99-5098-421e-8ba0-7c4c458c0aad None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:36.989786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5adc24d-e828-430e-a08b-c99b2ce9e2de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:36.990666 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29ac99-5098-421e-8ba0-7c4c458c0aad None admin] RBAC: Authorizing `identity:get_project(project_id=e743a4a482c24a1f88389b1830c2386e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:36.992300 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29ac99-5098-421e-8ba0-7c4c458c0aad None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:36.994023 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 130/257] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:36 2022] GET /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:36.994866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29ac99-5098-421e-8ba0-7c4c458c0aad None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:37.007893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5adc24d-e828-430e-a08b-c99b2ce9e2de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:37.016873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-a5adc24d-e828-430e-a08b-c99b2ce9e2de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:37.016873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:37.016873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:37.016873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:37.016873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:37.016873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:37.016873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:37.016873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:37.016873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:37.016873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:37.016873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:37.016873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:37.016873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:37.016873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:37.016873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:37.016873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:37.017885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:37.017885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:37.017885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:37.017885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:37.017885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:37.017885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:37.017885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:37.017885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:37.017885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:37.017885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:37.017885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:37.017885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:37.017885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:37.017885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:37.017885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:37.017885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:37.018665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:37.018665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:37.018665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:37.018665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:37.018665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:37.018665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:37.018665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:37.018665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:37.018665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:37.018665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:37.018665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:37.018665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:37.028522 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 128/258] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:28:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:37.029525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adc24d-e828-430e-a08b-c99b2ce9e2de None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:37.049742 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:37.068745 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:37.102455 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29ac99-5098-421e-8ba0-7c4c458c0aad None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:37.170748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fdfaa-3009-4bcd-8928-af5b052971de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:37.172843 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fdfaa-3009-4bcd-8928-af5b052971de None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:37.173126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fdfaa-3009-4bcd-8928-af5b052971de None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:37.173422 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fdfaa-3009-4bcd-8928-af5b052971de None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:37.174185 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fdfaa-3009-4bcd-8928-af5b052971de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:37.174492 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fdfaa-3009-4bcd-8928-af5b052971de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:37.175887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191fdfaa-3009-4bcd-8928-af5b052971de None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:37.200431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 131/259] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:37.201291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fdfaa-3009-4bcd-8928-af5b052971de None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:37.219073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5adc24d-e828-430e-a08b-c99b2ce9e2de None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:37.288331 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2490d5-2725-4ca7-8d23-b3a0e856b9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:37.289229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2490d5-2725-4ca7-8d23-b3a0e856b9b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:37.289537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2490d5-2725-4ca7-8d23-b3a0e856b9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:37.289820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2490d5-2725-4ca7-8d23-b3a0e856b9b4 None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e/users/3bed1751c0084129bf12fdcf6a411698/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:37.294767 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2490d5-2725-4ca7-8d23-b3a0e856b9b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e743a4a482c24a1f88389b1830c2386e, user_id=3bed1751c0084129bf12fdcf6a411698, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:37.296244 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2490d5-2725-4ca7-8d23-b3a0e856b9b4 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:37.323411 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 129/260] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:28:37 2022] PUT /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e/users/3bed1751c0084129bf12fdcf6a411698/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:28:37.324975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2490d5-2725-4ca7-8d23-b3a0e856b9b4 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:37.399776 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fdfaa-3009-4bcd-8928-af5b052971de None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:37.425111 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:37.464542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:37.480412 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9a410-5b13-4e14-b445-0a226f44f782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:37.481094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9a410-5b13-4e14-b445-0a226f44f782 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:37.481398 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9a410-5b13-4e14-b445-0a226f44f782 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:37.481690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9a410-5b13-4e14-b445-0a226f44f782 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:37.482450 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9a410-5b13-4e14-b445-0a226f44f782 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:37.482761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9a410-5b13-4e14-b445-0a226f44f782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:37.484167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9a410-5b13-4e14-b445-0a226f44f782 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:37.503601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 132/261] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:28:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:37.510354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9a410-5b13-4e14-b445-0a226f44f782 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:37.515565 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2490d5-2725-4ca7-8d23-b3a0e856b9b4 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:37.584036 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0bcb1-b9d5-4872-938f-f80192f5ef60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:37.584928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0bcb1-b9d5-4872-938f-f80192f5ef60 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:37.585220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0bcb1-b9d5-4872-938f-f80192f5ef60 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:37.598283 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0bcb1-b9d5-4872-938f-f80192f5ef60 None admin] PATH_INFO: `/v3/users/d9563e5282044deebdf7e84af709e6cb` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:37.599795 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0bcb1-b9d5-4872-938f-f80192f5ef60 None admin] RBAC: Authorizing `identity:get_user(user_id=d9563e5282044deebdf7e84af709e6cb)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:37.601274 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca0bcb1-b9d5-4872-938f-f80192f5ef60 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:37.603614 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 130/262] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:37 2022] GET /identity/v3/users/d9563e5282044deebdf7e84af709e6cb => generated 283 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:37.609966 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0bcb1-b9d5-4872-938f-f80192f5ef60 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:37.745216 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9a410-5b13-4e14-b445-0a226f44f782 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:37.745767 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca0bcb1-b9d5-4872-938f-f80192f5ef60 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:37.784682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad0891-1e63-4d88-bfd1-4f17a6c4cb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:37.785436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad0891-1e63-4d88-bfd1-4f17a6c4cb3c None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:37.786183 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad0891-1e63-4d88-bfd1-4f17a6c4cb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:37.789454 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad0891-1e63-4d88-bfd1-4f17a6c4cb3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:37.795982 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:37.842002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19801531-1e3f-4912-9cdb-5765e0a9008e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:37.842903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19801531-1e3f-4912-9cdb-5765e0a9008e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:37.843189 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19801531-1e3f-4912-9cdb-5765e0a9008e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:37.843466 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19801531-1e3f-4912-9cdb-5765e0a9008e None admin] PATH_INFO: `/v3/users/d9563e5282044deebdf7e84af709e6cb` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:37.844814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19801531-1e3f-4912-9cdb-5765e0a9008e None admin] RBAC: Authorizing `identity:get_user(user_id=d9563e5282044deebdf7e84af709e6cb)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:37.846329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19801531-1e3f-4912-9cdb-5765e0a9008e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:37.848962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 133/263] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:37 2022] GET /identity/v3/users/d9563e5282044deebdf7e84af709e6cb => generated 283 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:37.858041 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19801531-1e3f-4912-9cdb-5765e0a9008e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:37.872322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad0891-1e63-4d88-bfd1-4f17a6c4cb3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:37.873825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad0891-1e63-4d88-bfd1-4f17a6c4cb3c None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:38.031187 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:38.032443 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 131/264] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 14 19:28:38.039297 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad0891-1e63-4d88-bfd1-4f17a6c4cb3c None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:38.121153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19801531-1e3f-4912-9cdb-5765e0a9008e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:38.124032 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:38.188565 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd448ad0-a362-460e-bbbb-2b2eae3530d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:38.189220 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd448ad0-a362-460e-bbbb-2b2eae3530d6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:38.189686 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd448ad0-a362-460e-bbbb-2b2eae3530d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:38.189969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd448ad0-a362-460e-bbbb-2b2eae3530d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:38.271576 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad0891-1e63-4d88-bfd1-4f17a6c4cb3c None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:38.309287 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd448ad0-a362-460e-bbbb-2b2eae3530d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:38.311035 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd448ad0-a362-460e-bbbb-2b2eae3530d6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:38.351486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114d735-851f-4f60-a8d7-881f4d590f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:38.352366 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114d735-851f-4f60-a8d7-881f4d590f74 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:38.352648 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114d735-851f-4f60-a8d7-881f4d590f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:38.352926 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114d735-851f-4f60-a8d7-881f4d590f74 None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:38.358143 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114d735-851f-4f60-a8d7-881f4d590f74 None admin] RBAC: Authorizing `identity:get_project(project_id=e743a4a482c24a1f88389b1830c2386e)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:38.359614 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114d735-851f-4f60-a8d7-881f4d590f74 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:38.361364 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 132/265] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:38 2022] GET /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:38.376704 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114d735-851f-4f60-a8d7-881f4d590f74 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:38.419811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:38.489706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 134/266] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:28:38.495300 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd448ad0-a362-460e-bbbb-2b2eae3530d6 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:38.537615 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114d735-851f-4f60-a8d7-881f4d590f74 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:38.557752 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:38.585851 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c02a85-1740-4952-ab14-742c8acbb1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:38.586437 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c02a85-1740-4952-ab14-742c8acbb1cb None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:38.586725 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c02a85-1740-4952-ab14-742c8acbb1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:38.587013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c02a85-1740-4952-ab14-742c8acbb1cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:38.587859 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c02a85-1740-4952-ab14-742c8acbb1cb None admin] RBAC: Adding query filter params (role.id=1e2bb0d759694428ada2b52285de933b, scope.project.id=e743a4a482c24a1f88389b1830c2386e, user.id=d9563e5282044deebdf7e84af709e6cb) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:38.588179 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c02a85-1740-4952-ab14-742c8acbb1cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:38.589657 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c02a85-1740-4952-ab14-742c8acbb1cb None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:38.596567 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 133/267] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:28:38 2022] GET /identity/v3/role_assignments?user.id=d9563e5282044deebdf7e84af709e6cb&scope.project.id=e743a4a482c24a1f88389b1830c2386e&role.id=1e2bb0d759694428ada2b52285de933b => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:38.714140 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd448ad0-a362-460e-bbbb-2b2eae3530d6 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:38.769013 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f066e-a20c-49c6-8c47-30cc06740210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:38.769923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f066e-a20c-49c6-8c47-30cc06740210 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:38.770871 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f066e-a20c-49c6-8c47-30cc06740210 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:38.771189 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f066e-a20c-49c6-8c47-30cc06740210 None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:38.772468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f066e-a20c-49c6-8c47-30cc06740210 None admin] RBAC: Authorizing `identity:get_project(project_id=e743a4a482c24a1f88389b1830c2386e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:38.773975 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f066e-a20c-49c6-8c47-30cc06740210 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:38.775732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 135/268] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:38 2022] GET /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:38.782001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c02a85-1740-4952-ab14-742c8acbb1cb None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:38.892664 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c02a85-1740-4952-ab14-742c8acbb1cb None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:38.928122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24814580-664e-4afa-b4ba-df255901847b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:38.928780 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24814580-664e-4afa-b4ba-df255901847b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:38.929064 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24814580-664e-4afa-b4ba-df255901847b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:38.929340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24814580-664e-4afa-b4ba-df255901847b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:38.930208 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24814580-664e-4afa-b4ba-df255901847b None admin] RBAC: Adding query filter params (role.id=1302d95e46b4422d84f581f8838d5aac, scope.project.id=e743a4a482c24a1f88389b1830c2386e, user.id=d9563e5282044deebdf7e84af709e6cb) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:38.930517 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24814580-664e-4afa-b4ba-df255901847b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:38.931962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24814580-664e-4afa-b4ba-df255901847b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:38.938144 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 134/269] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:28:38 2022] GET /identity/v3/role_assignments?user.id=d9563e5282044deebdf7e84af709e6cb&scope.project.id=e743a4a482c24a1f88389b1830c2386e&role.id=1302d95e46b4422d84f581f8838d5aac => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:39.241710 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b06a5-99ec-4505-a184-a08447bd50a6 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:39.242528 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b06a5-99ec-4505-a184-a08447bd50a6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:39.243028 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b06a5-99ec-4505-a184-a08447bd50a6 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:39.244633 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 136/270] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:39.258178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177a6ec-ea0d-452f-a750-0c18828086eb None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:39.258784 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177a6ec-ea0d-452f-a750-0c18828086eb None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:39.259280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177a6ec-ea0d-452f-a750-0c18828086eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:39.286214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f56afd-5312-455e-b7ac-b38bbddd44f4 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:39.286962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f56afd-5312-455e-b7ac-b38bbddd44f4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:39.287072 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f56afd-5312-455e-b7ac-b38bbddd44f4 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:39.288628 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 137/271] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:39.289007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-0177a6ec-ea0d-452f-a750-0c18828086eb None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:39.289796 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5766ce-4bfe-4589-94de-f5b79898ceb0 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:39.290083 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5766ce-4bfe-4589-94de-f5b79898ceb0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:39.290359 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5766ce-4bfe-4589-94de-f5b79898ceb0 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:39.291321 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-0177a6ec-ea0d-452f-a750-0c18828086eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:39.292079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 138/272] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:39.295756 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbda14-6583-465c-8cd5-e4fe9efed973 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:39.296048 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbda14-6583-465c-8cd5-e4fe9efed973 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:39.296339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbda14-6583-465c-8cd5-e4fe9efed973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:39.316515 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-38cbda14-6583-465c-8cd5-e4fe9efed973 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:39.318054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-38cbda14-6583-465c-8cd5-e4fe9efed973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:39.325127 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:39.349723 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:39.380719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 135/273] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:39.382171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5debe02-ae04-4b13-91e0-4b6892689a4a None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:39.382470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5debe02-ae04-4b13-91e0-4b6892689a4a None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:39.382750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5debe02-ae04-4b13-91e0-4b6892689a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:39.401960 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-e5debe02-ae04-4b13-91e0-4b6892689a4a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:39.403156 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e5debe02-ae04-4b13-91e0-4b6892689a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:39.406791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 139/274] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:39.407789 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbda14-6583-465c-8cd5-e4fe9efed973 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:39.476196 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 136/275] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:39.477061 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5debe02-ae04-4b13-91e0-4b6892689a4a None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:39.520484 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbda14-6583-465c-8cd5-e4fe9efed973 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:39.558822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db823121-cf76-4b86-8249-13c0ceaafecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:39.559971 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db823121-cf76-4b86-8249-13c0ceaafecc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:39.560257 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db823121-cf76-4b86-8249-13c0ceaafecc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:39.560536 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db823121-cf76-4b86-8249-13c0ceaafecc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:39.561740 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db823121-cf76-4b86-8249-13c0ceaafecc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:39.563213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db823121-cf76-4b86-8249-13c0ceaafecc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:39.564835 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 140/276] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:28:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:39.569550 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db823121-cf76-4b86-8249-13c0ceaafecc None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:39.587039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:39.594965 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5debe02-ae04-4b13-91e0-4b6892689a4a None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:39.597449 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:39.631702 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec7ff2-d1e0-492c-9b0b-3d7b4a4fa081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:39.632556 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec7ff2-d1e0-492c-9b0b-3d7b4a4fa081 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:39.632780 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec7ff2-d1e0-492c-9b0b-3d7b4a4fa081 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:39.633057 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec7ff2-d1e0-492c-9b0b-3d7b4a4fa081 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:39.650684 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec7ff2-d1e0-492c-9b0b-3d7b4a4fa081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:39.658584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-26ec7ff2-d1e0-492c-9b0b-3d7b4a4fa081 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 19:28:39.658584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:39.658584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:39.658584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:39.658584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:39.658584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:39.658584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:39.658584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:39.658584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:39.658584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:39.658584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:39.658584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:39.658584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:39.658584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:39.658584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:39.658584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:39.659438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:39.659438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:39.659438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:39.659438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:39.659438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:39.659438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:39.659438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:39.659438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:39.659438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:39.659438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:39.659438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:39.659438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:39.659438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:39.659438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:39.659438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:39.659438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:39.660268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:39.660268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:39.660268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:39.660268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:39.660268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:39.660268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:39.660268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:39.660268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:39.660268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:39.660268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:39.660268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 19:28:39.660268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:39.660268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 137/277] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:39.661627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec7ff2-d1e0-492c-9b0b-3d7b4a4fa081 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:39.684959 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db823121-cf76-4b86-8249-13c0ceaafecc None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:39.720360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7af2a0-a741-4eb5-b555-3c6f95746d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:39.721517 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7af2a0-a741-4eb5-b555-3c6f95746d95 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:39.722011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7af2a0-a741-4eb5-b555-3c6f95746d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:39.722347 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7af2a0-a741-4eb5-b555-3c6f95746d95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:39.733807 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7af2a0-a741-4eb5-b555-3c6f95746d95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:39.741949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-9a7af2a0-a741-4eb5-b555-3c6f95746d95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:39.741949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:39.741949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:39.741949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:39.741949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:39.741949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:39.741949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:39.741949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:39.741949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:39.741949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:39.741949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:39.741949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:39.741949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:39.741949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:39.741949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:39.741949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:39.742837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:39.742837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:39.742837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:39.742837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:39.742837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:39.742837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:39.742837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:39.742837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:39.742837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:39.742837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:39.742837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:39.742837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:39.742837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:39.742837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:39.742837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:39.742837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:39.744297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:39.744297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:39.744297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:39.744297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:39.744297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:39.744297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:39.744297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:39.744297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:39.744297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:39.744297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:39.744297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:39.744297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:39.744297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 141/278] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:39.744297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7af2a0-a741-4eb5-b555-3c6f95746d95 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:39.774329 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec7ff2-d1e0-492c-9b0b-3d7b4a4fa081 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:39.809664 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee870d5-cc3e-4d50-94ec-0e47c42f5f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:39.812973 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee870d5-cc3e-4d50-94ec-0e47c42f5f71 None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:39.812973 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee870d5-cc3e-4d50-94ec-0e47c42f5f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:39.812973 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee870d5-cc3e-4d50-94ec-0e47c42f5f71 None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:39.812973 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee870d5-cc3e-4d50-94ec-0e47c42f5f71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:39.813310 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee870d5-cc3e-4d50-94ec-0e47c42f5f71 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:39.838742 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 138/279] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jun 14 19:28:39 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:28:39.840666 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee870d5-cc3e-4d50-94ec-0e47c42f5f71 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:39.850601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:39.865300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:39.866401 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7af2a0-a741-4eb5-b555-3c6f95746d95 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:39.912282 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1783ab6-4b49-44b3-994d-2155360d2539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:39.913650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1783ab6-4b49-44b3-994d-2155360d2539 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:39.914697 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1783ab6-4b49-44b3-994d-2155360d2539 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:39.915217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1783ab6-4b49-44b3-994d-2155360d2539 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:39.916743 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1783ab6-4b49-44b3-994d-2155360d2539 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:39.917552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1783ab6-4b49-44b3-994d-2155360d2539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:39.919724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1783ab6-4b49-44b3-994d-2155360d2539 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:39.933224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 142/280] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:39.939765 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1783ab6-4b49-44b3-994d-2155360d2539 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:39.987419 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee870d5-cc3e-4d50-94ec-0e47c42f5f71 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:40.025484 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50750f03-e9c7-44e5-96a7-926a2b253917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:40.025894 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50750f03-e9c7-44e5-96a7-926a2b253917 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:40.026249 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50750f03-e9c7-44e5-96a7-926a2b253917 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:40.026594 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50750f03-e9c7-44e5-96a7-926a2b253917 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:40.027416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50750f03-e9c7-44e5-96a7-926a2b253917 None admin] RBAC: Adding query filter params (name=member) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:40.027732 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50750f03-e9c7-44e5-96a7-926a2b253917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:40.029136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50750f03-e9c7-44e5-96a7-926a2b253917 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:40.039317 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 139/281] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:40.045834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50750f03-e9c7-44e5-96a7-926a2b253917 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:40.056013 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1783ab6-4b49-44b3-994d-2155360d2539 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:40.100014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabc6f4-eb31-4de2-b8f0-2cdfe672dc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:40.100899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabc6f4-eb31-4de2-b8f0-2cdfe672dc26 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:40.101346 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabc6f4-eb31-4de2-b8f0-2cdfe672dc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:40.101659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabc6f4-eb31-4de2-b8f0-2cdfe672dc26 None admin] PATH_INFO: `/v3/users/79e04ec20eee48c0b0faefbca93339a9` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:40.103183 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabc6f4-eb31-4de2-b8f0-2cdfe672dc26 None admin] RBAC: Authorizing `identity:get_user(user_id=79e04ec20eee48c0b0faefbca93339a9)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:40.104640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabc6f4-eb31-4de2-b8f0-2cdfe672dc26 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:40.106913 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 143/282] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:39 2022] GET /identity/v3/users/79e04ec20eee48c0b0faefbca93339a9 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:40.112889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabc6f4-eb31-4de2-b8f0-2cdfe672dc26 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:40.135049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:40.136355 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:40.179771 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50750f03-e9c7-44e5-96a7-926a2b253917 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:40.226694 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41df7e-0792-4d3e-a92c-c3b591c80565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:40.228170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41df7e-0792-4d3e-a92c-c3b591c80565 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:40.229064 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41df7e-0792-4d3e-a92c-c3b591c80565 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:40.229589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db41df7e-0792-4d3e-a92c-c3b591c80565 None admin] PATH_INFO: `/v3/users/7b30e55c706e4e6b8427e82c24b1e569` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:40.246690 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41df7e-0792-4d3e-a92c-c3b591c80565 None admin] RBAC: Authorizing `identity:get_user(user_id=7b30e55c706e4e6b8427e82c24b1e569)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:40.247212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabc6f4-eb31-4de2-b8f0-2cdfe672dc26 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:40.248171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db41df7e-0792-4d3e-a92c-c3b591c80565 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:40.253426 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 140/283] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:40 2022] GET /identity/v3/users/7b30e55c706e4e6b8427e82c24b1e569 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:40.260982 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41df7e-0792-4d3e-a92c-c3b591c80565 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:40.308515 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12dddee-a00b-4e81-8d7d-5ba05a02d5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:40.309316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12dddee-a00b-4e81-8d7d-5ba05a02d5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:40.310313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12dddee-a00b-4e81-8d7d-5ba05a02d5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:40.310313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12dddee-a00b-4e81-8d7d-5ba05a02d5f8 None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:40.311147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12dddee-a00b-4e81-8d7d-5ba05a02d5f8 None admin] RBAC: Authorizing `identity:get_project(project_id=e743a4a482c24a1f88389b1830c2386e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:40.312589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12dddee-a00b-4e81-8d7d-5ba05a02d5f8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:40.314774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 144/284] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:40 2022] GET /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:40.328640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12dddee-a00b-4e81-8d7d-5ba05a02d5f8 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:40.408636 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db41df7e-0792-4d3e-a92c-c3b591c80565 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:40.423825 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:40.444840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:40.445570 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12dddee-a00b-4e81-8d7d-5ba05a02d5f8 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:40.452620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853decf9-082f-4b76-99d2-71a04f0e2d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:40.453285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853decf9-082f-4b76-99d2-71a04f0e2d8e None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:40.453613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853decf9-082f-4b76-99d2-71a04f0e2d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:40.454431 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853decf9-082f-4b76-99d2-71a04f0e2d8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:40.455287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853decf9-082f-4b76-99d2-71a04f0e2d8e None admin] RBAC: Adding query filter params (role.id=bf1733d36314409c80cd50b2268834b1, user.id=7b30e55c706e4e6b8427e82c24b1e569, scope.system=all) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:40.455604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853decf9-082f-4b76-99d2-71a04f0e2d8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:40.457060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853decf9-082f-4b76-99d2-71a04f0e2d8e None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:40.464936 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 141/285] 10.222.0.44 () {56 vars in 1308 bytes} [Tue Jun 14 19:28:40 2022] GET /identity/v3/role_assignments?user.id=7b30e55c706e4e6b8427e82c24b1e569&scope.system=all&role.id=bf1733d36314409c80cd50b2268834b1 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:40.470328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dedbea-4a3b-4f07-8e73-d648d20aa5ce None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:40.470661 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dedbea-4a3b-4f07-8e73-d648d20aa5ce None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:40.470945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dedbea-4a3b-4f07-8e73-d648d20aa5ce None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:40.472376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 142/286] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:40.484385 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c5a19-b839-45b9-a194-69fb83826cdc None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:40.484702 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c5a19-b839-45b9-a194-69fb83826cdc None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:40.484939 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c5a19-b839-45b9-a194-69fb83826cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:40.508858 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-c90c5a19-b839-45b9-a194-69fb83826cdc None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:40.510176 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c90c5a19-b839-45b9-a194-69fb83826cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:40.539305 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254eb4a-c628-40c5-8d47-61ac2a0a1e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:40.540250 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254eb4a-c628-40c5-8d47-61ac2a0a1e96 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:40.540540 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254eb4a-c628-40c5-8d47-61ac2a0a1e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:40.540849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254eb4a-c628-40c5-8d47-61ac2a0a1e96 None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e/users/79e04ec20eee48c0b0faefbca93339a9/roles/04bbf2f8d56744159d8dac700dde4379` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:40.543416 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254eb4a-c628-40c5-8d47-61ac2a0a1e96 None admin] RBAC: Authorizing `identity:create_grant(project_id=e743a4a482c24a1f88389b1830c2386e, user_id=79e04ec20eee48c0b0faefbca93339a9, role_id=04bbf2f8d56744159d8dac700dde4379)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:40.550262 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254eb4a-c628-40c5-8d47-61ac2a0a1e96 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:40.580991 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 145/287] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:28:40 2022] PUT /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e/users/79e04ec20eee48c0b0faefbca93339a9/roles/04bbf2f8d56744159d8dac700dde4379 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:28:40.605711 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 143/288] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:40.637753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254eb4a-c628-40c5-8d47-61ac2a0a1e96 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:40.766726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254eb4a-c628-40c5-8d47-61ac2a0a1e96 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:40.812907 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820bbb8-6143-4a9c-95c9-c1e35fc18c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:40.813742 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820bbb8-6143-4a9c-95c9-c1e35fc18c6d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:40.814030 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820bbb8-6143-4a9c-95c9-c1e35fc18c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:40.814310 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1820bbb8-6143-4a9c-95c9-c1e35fc18c6d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:40.834713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1820bbb8-6143-4a9c-95c9-c1e35fc18c6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:40.842663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-1820bbb8-6143-4a9c-95c9-c1e35fc18c6d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:40.842663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:40.842663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:40.842663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:40.842663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:40.842663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:40.842663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:40.842663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:40.842663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:40.842663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:40.842663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:40.842663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:40.842663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:40.842663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:40.842663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:40.842663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:40.843501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:40.843501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:40.843501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:40.843501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:40.843501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:40.843501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:40.843501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:40.843501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:40.843501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:40.843501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:40.843501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:40.843501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:40.843501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:40.843501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:40.843501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:40.843501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:40.844273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:40.844273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:40.844273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:40.844273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:40.844273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:40.844273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:40.844273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:40.844273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:40.844273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:40.844273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:40.844273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:40.844273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:40.844273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 146/289] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:40.849893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c5a19-b839-45b9-a194-69fb83826cdc None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:40.981514 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c5a19-b839-45b9-a194-69fb83826cdc None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:41.016448 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:41.034091 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982dc2a-9636-472c-a060-ebea9a34d870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:41.034818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982dc2a-9636-472c-a060-ebea9a34d870 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:41.035139 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982dc2a-9636-472c-a060-ebea9a34d870 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:41.035421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982dc2a-9636-472c-a060-ebea9a34d870 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:41.036698 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982dc2a-9636-472c-a060-ebea9a34d870 None admin] RBAC: Adding query filter params (name=member) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:41.037004 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982dc2a-9636-472c-a060-ebea9a34d870 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:41.038420 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0982dc2a-9636-472c-a060-ebea9a34d870 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:41.053134 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 144/290] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:41.058978 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820bbb8-6143-4a9c-95c9-c1e35fc18c6d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:41.079679 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:41.226074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1820bbb8-6143-4a9c-95c9-c1e35fc18c6d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:41.283480 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116a5b3-a52c-455a-baac-f24b3c1f9eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:41.284376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116a5b3-a52c-455a-baac-f24b3c1f9eaa None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:41.284664 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116a5b3-a52c-455a-baac-f24b3c1f9eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:41.284948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116a5b3-a52c-455a-baac-f24b3c1f9eaa None admin] PATH_INFO: `/v3/users/3bed1751c0084129bf12fdcf6a411698` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:41.286328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116a5b3-a52c-455a-baac-f24b3c1f9eaa None admin] RBAC: Authorizing `identity:get_user(user_id=3bed1751c0084129bf12fdcf6a411698)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:41.287804 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116a5b3-a52c-455a-baac-f24b3c1f9eaa None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:41.293633 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 147/291] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:41 2022] GET /identity/v3/users/3bed1751c0084129bf12fdcf6a411698 => generated 297 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:41.295225 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982dc2a-9636-472c-a060-ebea9a34d870 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:41.447060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982dc2a-9636-472c-a060-ebea9a34d870 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:41.482439 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3433450-33a6-43c7-b752-041d6a295ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:41.483026 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3433450-33a6-43c7-b752-041d6a295ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:41.483309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3433450-33a6-43c7-b752-041d6a295ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:41.483589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3433450-33a6-43c7-b752-041d6a295ee0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:41.545831 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:41.556505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3433450-33a6-43c7-b752-041d6a295ee0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:41.558273 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3433450-33a6-43c7-b752-041d6a295ee0 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:41.661047 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 145/292] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:28:41.666602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116a5b3-a52c-455a-baac-f24b3c1f9eaa None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:41.781698 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:41.823878 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116a5b3-a52c-455a-baac-f24b3c1f9eaa None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:41.875025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81993d6b-88ad-446b-8779-6c9a92261309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:41.875887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81993d6b-88ad-446b-8779-6c9a92261309 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:41.876172 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81993d6b-88ad-446b-8779-6c9a92261309 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:41.876450 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81993d6b-88ad-446b-8779-6c9a92261309 None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:41.882087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81993d6b-88ad-446b-8779-6c9a92261309 None admin] RBAC: Authorizing `identity:get_project(project_id=e743a4a482c24a1f88389b1830c2386e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:41.883541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81993d6b-88ad-446b-8779-6c9a92261309 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:41.885566 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 148/293] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:41 2022] GET /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:41.891283 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3433450-33a6-43c7-b752-041d6a295ee0 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:41.998034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:42.013942 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3433450-33a6-43c7-b752-041d6a295ee0 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:42.049396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20c1f6-501a-4718-bccd-cd661a8b3e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:42.050008 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20c1f6-501a-4718-bccd-cd661a8b3e57 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:42.050255 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20c1f6-501a-4718-bccd-cd661a8b3e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:42.050537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20c1f6-501a-4718-bccd-cd661a8b3e57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:42.052001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20c1f6-501a-4718-bccd-cd661a8b3e57 None admin] RBAC: Adding query filter params (role.id=bf1733d36314409c80cd50b2268834b1, scope.project.id=e743a4a482c24a1f88389b1830c2386e, user.id=3bed1751c0084129bf12fdcf6a411698) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:42.052407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20c1f6-501a-4718-bccd-cd661a8b3e57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:42.053945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20c1f6-501a-4718-bccd-cd661a8b3e57 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:42.060379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 146/294] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:28:41 2022] GET /identity/v3/role_assignments?user.id=3bed1751c0084129bf12fdcf6a411698&scope.project.id=e743a4a482c24a1f88389b1830c2386e&role.id=bf1733d36314409c80cd50b2268834b1 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:42.615686 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56524ef2-99ad-42b5-afea-faa4729f8adc None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:42.616751 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56524ef2-99ad-42b5-afea-faa4729f8adc None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:42.617239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56524ef2-99ad-42b5-afea-faa4729f8adc None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:42.618861 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 149/295] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:42.624162 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82850171-9ded-44b2-be3b-cfa31b4d104a None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:42.624717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82850171-9ded-44b2-be3b-cfa31b4d104a None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:42.625194 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82850171-9ded-44b2-be3b-cfa31b4d104a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:42.643156 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-82850171-9ded-44b2-be3b-cfa31b4d104a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:42.644649 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-82850171-9ded-44b2-be3b-cfa31b4d104a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:42.729287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 147/296] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:42.753208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56524ef2-99ad-42b5-afea-faa4729f8adc None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:42.797662 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5918cb3-8c57-441f-b6b6-a0d472c8b8ae None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:42.798279 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5918cb3-8c57-441f-b6b6-a0d472c8b8ae None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:42.798777 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5918cb3-8c57-441f-b6b6-a0d472c8b8ae None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:42.800603 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 148/297] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:42.806324 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653440ed-9196-44c4-b837-d6c01c673c5e None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:42.806617 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653440ed-9196-44c4-b837-d6c01c673c5e None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:42.806903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653440ed-9196-44c4-b837-d6c01c673c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:42.829027 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-653440ed-9196-44c4-b837-d6c01c673c5e None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:42.830466 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-653440ed-9196-44c4-b837-d6c01c673c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:42.877862 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56524ef2-99ad-42b5-afea-faa4729f8adc None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:42.899561 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 149/298] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:42.915271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfa3e5-30f3-469c-aef8-16efdc36d9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:42.916327 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfa3e5-30f3-469c-aef8-16efdc36d9de None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:42.916612 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfa3e5-30f3-469c-aef8-16efdc36d9de None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:42.916883 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfa3e5-30f3-469c-aef8-16efdc36d9de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:42.924207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653440ed-9196-44c4-b837-d6c01c673c5e None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:42.928396 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfa3e5-30f3-469c-aef8-16efdc36d9de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:42.936461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-84cfa3e5-30f3-469c-aef8-16efdc36d9de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 19:28:42.936461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:42.936461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:42.936461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:42.936461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:42.936461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:42.936461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:42.936461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:42.936461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:42.936461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:42.936461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:42.936461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:42.936461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:42.936461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:42.936461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:42.936461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:42.937326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:42.937326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:42.937326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:42.937326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:42.937326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:42.937326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:42.937326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:42.937326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:42.937326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:42.937326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:42.937326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:42.937326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:42.937326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:42.937326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:42.937326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:42.937326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:42.938594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:42.938594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:42.938594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:42.938594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:42.938594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:42.938594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:42.938594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:42.938594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:42.938594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:42.938594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:42.938594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 19:28:42.938594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:42.938594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 150/299] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:42.943675 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:42.944790 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfa3e5-30f3-469c-aef8-16efdc36d9de None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:42.947908 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:43.050134 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653440ed-9196-44c4-b837-d6c01c673c5e None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:43.074491 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfa3e5-30f3-469c-aef8-16efdc36d9de None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:43.100637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93341d4-55a5-426a-bcb6-3294e738def5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:43.101472 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93341d4-55a5-426a-bcb6-3294e738def5 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:43.101764 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93341d4-55a5-426a-bcb6-3294e738def5 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:43.102588 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93341d4-55a5-426a-bcb6-3294e738def5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:43.104072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93341d4-55a5-426a-bcb6-3294e738def5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:43.105725 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93341d4-55a5-426a-bcb6-3294e738def5 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:43.107974 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 150/300] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:28:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:43.108834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b88f5e-adf9-4244-ba17-d4217396db19 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:43.109120 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b88f5e-adf9-4244-ba17-d4217396db19 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:43.109494 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b88f5e-adf9-4244-ba17-d4217396db19 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:43.111025 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 151/301] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:43.117204 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb469af6-fc46-44c5-9e71-afc931ae198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:43.117858 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b88f5e-adf9-4244-ba17-d4217396db19 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:43.118230 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb469af6-fc46-44c5-9e71-afc931ae198d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:43.118448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb469af6-fc46-44c5-9e71-afc931ae198d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:43.118723 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb469af6-fc46-44c5-9e71-afc931ae198d None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:43.119465 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb469af6-fc46-44c5-9e71-afc931ae198d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:43.119770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb469af6-fc46-44c5-9e71-afc931ae198d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:43.121136 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb469af6-fc46-44c5-9e71-afc931ae198d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:43.131913 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 151/302] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:43.133111 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c246a4-9762-48fa-a660-891900555f6f None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:43.133424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c246a4-9762-48fa-a660-891900555f6f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:43.133701 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c246a4-9762-48fa-a660-891900555f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:43.150758 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a9c246a4-9762-48fa-a660-891900555f6f None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:43.151931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a9c246a4-9762-48fa-a660-891900555f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:43.208131 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:43.220888 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:43.231150 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 152/303] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:43.231931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c246a4-9762-48fa-a660-891900555f6f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:43.247229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b88f5e-adf9-4244-ba17-d4217396db19 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:43.285826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9bdcf-e967-40ee-970c-45122813233c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:43.286512 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9bdcf-e967-40ee-970c-45122813233c None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:43.286798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9bdcf-e967-40ee-970c-45122813233c None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:43.287079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9bdcf-e967-40ee-970c-45122813233c None admin] PATH_INFO: `/v3/groups` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:43.287771 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9bdcf-e967-40ee-970c-45122813233c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:43.289195 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9bdcf-e967-40ee-970c-45122813233c None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:43.304299 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 152/304] 10.222.0.44 () {60 vars in 1134 bytes} [Tue Jun 14 19:28:43 2022] POST /identity/v3/groups => generated 229 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:28:43.305116 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9bdcf-e967-40ee-970c-45122813233c None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:43.354615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c246a4-9762-48fa-a660-891900555f6f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:43.391997 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f66110-8b93-4097-9e02-d47f2714c919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:43.392807 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f66110-8b93-4097-9e02-d47f2714c919 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:43.393092 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f66110-8b93-4097-9e02-d47f2714c919 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:43.393369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f66110-8b93-4097-9e02-d47f2714c919 None admin] PATH_INFO: `/v3/users/072892d247394600b4f5e45e9c922a2b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:43.409159 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f66110-8b93-4097-9e02-d47f2714c919 None admin] RBAC: Authorizing `identity:get_user(user_id=072892d247394600b4f5e45e9c922a2b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:43.410961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f66110-8b93-4097-9e02-d47f2714c919 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:43.418178 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 153/305] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:43 2022] GET /identity/v3/users/072892d247394600b4f5e45e9c922a2b => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:43.419856 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db3e42-c229-4cb9-80e1-32add7d1eff1 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:43.420299 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db3e42-c229-4cb9-80e1-32add7d1eff1 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:43.420410 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9bdcf-e967-40ee-970c-45122813233c None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:43.420833 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db3e42-c229-4cb9-80e1-32add7d1eff1 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:43.422401 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 154/306] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:43.423352 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db3e42-c229-4cb9-80e1-32add7d1eff1 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:43.463534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de032b2-d257-40a7-a63f-72423f85eda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:43.464341 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de032b2-d257-40a7-a63f-72423f85eda8 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:43.464628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de032b2-d257-40a7-a63f-72423f85eda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:43.464909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de032b2-d257-40a7-a63f-72423f85eda8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:43.475467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:43.481131 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de032b2-d257-40a7-a63f-72423f85eda8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:43.484653 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:43.491216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-3de032b2-d257-40a7-a63f-72423f85eda8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:43.491216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:43.491216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:43.491216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:43.491216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:43.491216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:43.491216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:43.491216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:43.491216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:43.491216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:43.491216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:43.491216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:43.491216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:43.491216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:43.491216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:43.491216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:43.492103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:43.492103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:43.492103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:43.492103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:43.492103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:43.492103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:43.492103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:43.492103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:43.492103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:43.492103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:43.492103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:43.492103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:43.492103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:43.492103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:43.492103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:43.492103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:43.492870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:43.492870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:43.492870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:43.492870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:43.492870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:43.492870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:43.492870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:43.492870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:43.492870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:43.492870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:43.492870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:43.492870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:43.492870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 153/307] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:43.494307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5121e-0403-4e9b-ab79-75977c4baed7 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:43.494307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5121e-0403-4e9b-ab79-75977c4baed7 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:43.494307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5121e-0403-4e9b-ab79-75977c4baed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:43.513971 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-24c5121e-0403-4e9b-ab79-75977c4baed7 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:43.515291 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-24c5121e-0403-4e9b-ab79-75977c4baed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:43.543427 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db3e42-c229-4cb9-80e1-32add7d1eff1 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:43.580779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508c0d2-d8a3-4cc6-a327-1e2cfd32af7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:43.581458 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508c0d2-d8a3-4cc6-a327-1e2cfd32af7d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:43.581744 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508c0d2-d8a3-4cc6-a327-1e2cfd32af7d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:43.582020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508c0d2-d8a3-4cc6-a327-1e2cfd32af7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:43.582881 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508c0d2-d8a3-4cc6-a327-1e2cfd32af7d None admin] RBAC: Adding query filter params (role.id=04bbf2f8d56744159d8dac700dde4379, user.id=072892d247394600b4f5e45e9c922a2b, scope.system=all) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:43.583198 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508c0d2-d8a3-4cc6-a327-1e2cfd32af7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:43.584636 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508c0d2-d8a3-4cc6-a327-1e2cfd32af7d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:43.589923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 155/308] 10.222.0.44 () {56 vars in 1308 bytes} [Tue Jun 14 19:28:43 2022] GET /identity/v3/role_assignments?user.id=072892d247394600b4f5e45e9c922a2b&scope.system=all&role.id=04bbf2f8d56744159d8dac700dde4379 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:43.590698 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508c0d2-d8a3-4cc6-a327-1e2cfd32af7d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:43.603266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 154/309] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:43.627607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5121e-0403-4e9b-ab79-75977c4baed7 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:43.714713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508c0d2-d8a3-4cc6-a327-1e2cfd32af7d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:43.734386 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:43.753103 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a74c7a-212d-414a-bda2-fe8b69a09e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:43.753975 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a74c7a-212d-414a-bda2-fe8b69a09e2b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:43.754928 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a74c7a-212d-414a-bda2-fe8b69a09e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:43.755391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a74c7a-212d-414a-bda2-fe8b69a09e2b None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:43.756038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5121e-0403-4e9b-ab79-75977c4baed7 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:43.756312 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a74c7a-212d-414a-bda2-fe8b69a09e2b None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:43.756690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a74c7a-212d-414a-bda2-fe8b69a09e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:43.758198 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a74c7a-212d-414a-bda2-fe8b69a09e2b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:43.767790 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 156/310] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:43.773774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a74c7a-212d-414a-bda2-fe8b69a09e2b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:43.795020 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:43.804943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854c278-2191-4097-bdc0-10a3d3420581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:43.805839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854c278-2191-4097-bdc0-10a3d3420581 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:43.806125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854c278-2191-4097-bdc0-10a3d3420581 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:43.806600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854c278-2191-4097-bdc0-10a3d3420581 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:43.827108 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854c278-2191-4097-bdc0-10a3d3420581 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:43.837583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-6854c278-2191-4097-bdc0-10a3d3420581 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 19:28:43.837583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:43.837583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:43.837583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:43.837583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:43.837583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:43.837583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:43.837583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:43.837583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:43.837583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:43.837583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:43.837583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:43.837583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:43.837583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:43.837583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:43.837583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:43.838459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:43.838459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:43.838459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:43.838459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:43.838459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:43.838459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:43.838459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:43.838459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:43.838459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:43.838459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:43.838459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:43.838459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:43.838459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:43.838459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:43.838459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:43.838459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:43.839231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:43.839231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:43.839231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:43.839231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:43.839231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:43.839231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:43.839231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:43.839231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:43.839231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:43.839231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:43.839231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 19:28:43.839231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:43.839231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 155/311] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:28:43.844334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854c278-2191-4097-bdc0-10a3d3420581 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:43.906618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a74c7a-212d-414a-bda2-fe8b69a09e2b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:43.945520 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4bbc4-8193-4eee-8f45-b4d3b1182b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:43.946746 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4bbc4-8193-4eee-8f45-b4d3b1182b59 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:43.947332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4bbc4-8193-4eee-8f45-b4d3b1182b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:43.947812 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4bbc4-8193-4eee-8f45-b4d3b1182b59 None admin] PATH_INFO: `/v3/users/7b30e55c706e4e6b8427e82c24b1e569` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:43.949281 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4bbc4-8193-4eee-8f45-b4d3b1182b59 None admin] RBAC: Authorizing `identity:get_user(user_id=7b30e55c706e4e6b8427e82c24b1e569)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:43.951072 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4bbc4-8193-4eee-8f45-b4d3b1182b59 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:43.957830 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 157/312] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:43 2022] GET /identity/v3/users/7b30e55c706e4e6b8427e82c24b1e569 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:43.958932 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4bbc4-8193-4eee-8f45-b4d3b1182b59 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:43.963636 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854c278-2191-4097-bdc0-10a3d3420581 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:44.001120 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad027ca-e707-4e65-a067-a830ac5b2f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:44.001827 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad027ca-e707-4e65-a067-a830ac5b2f88 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:44.002121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad027ca-e707-4e65-a067-a830ac5b2f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:44.002405 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad027ca-e707-4e65-a067-a830ac5b2f88 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:44.003162 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad027ca-e707-4e65-a067-a830ac5b2f88 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:44.003476 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad027ca-e707-4e65-a067-a830ac5b2f88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:44.004914 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad027ca-e707-4e65-a067-a830ac5b2f88 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:44.013943 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:44.016033 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 156/313] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:44.021171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad027ca-e707-4e65-a067-a830ac5b2f88 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:44.085774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4bbc4-8193-4eee-8f45-b4d3b1182b59 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:44.093859 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:44.136974 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f6686-098c-4762-b448-4a764830cf2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:44.138235 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f6686-098c-4762-b448-4a764830cf2d None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:44.138596 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f6686-098c-4762-b448-4a764830cf2d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:44.139359 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f6686-098c-4762-b448-4a764830cf2d None admin] PATH_INFO: `/v3/system/users/7b30e55c706e4e6b8427e82c24b1e569/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:44.141236 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f6686-098c-4762-b448-4a764830cf2d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7b30e55c706e4e6b8427e82c24b1e569, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:44.143597 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f6686-098c-4762-b448-4a764830cf2d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:44.149945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad027ca-e707-4e65-a067-a830ac5b2f88 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:44.157365 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 158/314] 10.222.0.44 () {58 vars in 1334 bytes} [Tue Jun 14 19:28:43 2022] PUT /identity/v3/system/users/7b30e55c706e4e6b8427e82c24b1e569/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:28:44.194011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9004b-88ce-46fe-a9d1-755ec2bd7841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:44.195252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9004b-88ce-46fe-a9d1-755ec2bd7841 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:44.195718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9004b-88ce-46fe-a9d1-755ec2bd7841 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:44.196173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db9004b-88ce-46fe-a9d1-755ec2bd7841 None admin] PATH_INFO: `/v3/users/79e04ec20eee48c0b0faefbca93339a9` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:44.197879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9004b-88ce-46fe-a9d1-755ec2bd7841 None admin] RBAC: Authorizing `identity:get_user(user_id=79e04ec20eee48c0b0faefbca93339a9)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:44.199922 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db9004b-88ce-46fe-a9d1-755ec2bd7841 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:44.203025 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 157/315] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:44 2022] GET /identity/v3/users/79e04ec20eee48c0b0faefbca93339a9 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:44.209638 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f6686-098c-4762-b448-4a764830cf2d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:44.332042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f6686-098c-4762-b448-4a764830cf2d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:44.344758 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:44.374369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a927e-a797-40a4-9919-a8421dcf64c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:44.375027 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a927e-a797-40a4-9919-a8421dcf64c3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:44.375324 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a927e-a797-40a4-9919-a8421dcf64c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:44.375597 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a927e-a797-40a4-9919-a8421dcf64c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:44.449693 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a927e-a797-40a4-9919-a8421dcf64c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:44.451219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a927e-a797-40a4-9919-a8421dcf64c3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:44.555156 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 159/316] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 14 19:28:44.560320 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9004b-88ce-46fe-a9d1-755ec2bd7841 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:44.672075 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db9004b-88ce-46fe-a9d1-755ec2bd7841 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:44.689978 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:44.709893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dcfadf-1f1a-4511-b28b-d393911d225d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:44.710773 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcfadf-1f1a-4511-b28b-d393911d225d None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:44.711060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcfadf-1f1a-4511-b28b-d393911d225d None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:44.711342 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dcfadf-1f1a-4511-b28b-d393911d225d None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:44.712549 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcfadf-1f1a-4511-b28b-d393911d225d None admin] RBAC: Authorizing `identity:get_project(project_id=e743a4a482c24a1f88389b1830c2386e)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:44.714045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dcfadf-1f1a-4511-b28b-d393911d225d None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:44.716194 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 158/317] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:44 2022] GET /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:44.722499 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a927e-a797-40a4-9919-a8421dcf64c3 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:44.735162 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:44.825851 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a927e-a797-40a4-9919-a8421dcf64c3 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:44.860361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05df2f-3b93-4718-9dfb-db8c9d91ac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:44.861028 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05df2f-3b93-4718-9dfb-db8c9d91ac78 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:44.861315 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05df2f-3b93-4718-9dfb-db8c9d91ac78 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:44.861621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05df2f-3b93-4718-9dfb-db8c9d91ac78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:44.862455 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05df2f-3b93-4718-9dfb-db8c9d91ac78 None admin] RBAC: Adding query filter params (role.id=04bbf2f8d56744159d8dac700dde4379, scope.project.id=e743a4a482c24a1f88389b1830c2386e, user.id=79e04ec20eee48c0b0faefbca93339a9) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:44.862769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05df2f-3b93-4718-9dfb-db8c9d91ac78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:44.864810 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05df2f-3b93-4718-9dfb-db8c9d91ac78 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:44.870959 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 160/318] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:28:44 2022] GET /identity/v3/role_assignments?user.id=79e04ec20eee48c0b0faefbca93339a9&scope.project.id=e743a4a482c24a1f88389b1830c2386e&role.id=04bbf2f8d56744159d8dac700dde4379 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:45.550128 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd51c28-5515-46dc-b658-6ca1412e48f4 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:45.550636 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd51c28-5515-46dc-b658-6ca1412e48f4 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:45.550711 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd51c28-5515-46dc-b658-6ca1412e48f4 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:45.552612 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 159/319] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:45.557490 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9f022-7670-44d7-978c-9ee7f13a763a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:45.557788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9f022-7670-44d7-978c-9ee7f13a763a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:45.558073 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9f022-7670-44d7-978c-9ee7f13a763a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:45.575704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c2a9f022-7670-44d7-978c-9ee7f13a763a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:45.576896 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c2a9f022-7670-44d7-978c-9ee7f13a763a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:45.645817 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 161/320] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:45.668114 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd51c28-5515-46dc-b658-6ca1412e48f4 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:45.776180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd51c28-5515-46dc-b658-6ca1412e48f4 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:45.806151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dd0b8-79fe-44a6-a47e-bef3adb2d783 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:45.806666 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dd0b8-79fe-44a6-a47e-bef3adb2d783 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:45.806666 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dd0b8-79fe-44a6-a47e-bef3adb2d783 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:45.808023 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 162/321] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:45.811485 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91797d95-37b1-4b96-ad68-ffd8657f353d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:45.812285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91797d95-37b1-4b96-ad68-ffd8657f353d None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:45.812573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91797d95-37b1-4b96-ad68-ffd8657f353d None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:45.812854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91797d95-37b1-4b96-ad68-ffd8657f353d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:45.813847 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5854c0-e5df-43ee-8efe-fc5f414a6540 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:45.814099 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91797d95-37b1-4b96-ad68-ffd8657f353d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:45.814541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5854c0-e5df-43ee-8efe-fc5f414a6540 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:45.815038 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5854c0-e5df-43ee-8efe-fc5f414a6540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:45.815616 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91797d95-37b1-4b96-ad68-ffd8657f353d None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:45.822572 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 160/322] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:28:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:45.823298 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91797d95-37b1-4b96-ad68-ffd8657f353d None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:45.825053 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:45.836602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-2f5854c0-e5df-43ee-8efe-fc5f414a6540 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:45.837824 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2f5854c0-e5df-43ee-8efe-fc5f414a6540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:45.884239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:45.915874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 163/323] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:45.936162 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91797d95-37b1-4b96-ad68-ffd8657f353d None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:45.938082 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5854c0-e5df-43ee-8efe-fc5f414a6540 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:45.975232 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15b2a3-9c59-4844-af6c-82f9c372c8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:45.976005 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15b2a3-9c59-4844-af6c-82f9c372c8eb None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:45.976192 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15b2a3-9c59-4844-af6c-82f9c372c8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:45.976472 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15b2a3-9c59-4844-af6c-82f9c372c8eb None admin] PATH_INFO: `/v3/groups` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:45.977167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15b2a3-9c59-4844-af6c-82f9c372c8eb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:45.978677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15b2a3-9c59-4844-af6c-82f9c372c8eb None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:45.993706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 161/324] 10.222.0.44 () {60 vars in 1134 bytes} [Tue Jun 14 19:28:45 2022] POST /identity/v3/groups => generated 226 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:28:46.052966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5854c0-e5df-43ee-8efe-fc5f414a6540 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:46.090896 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a86f1-0af4-4047-b371-d784e478d267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:46.091619 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a86f1-0af4-4047-b371-d784e478d267 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:46.091904 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a86f1-0af4-4047-b371-d784e478d267 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:46.092202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a86f1-0af4-4047-b371-d784e478d267 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:46.094303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:46.105282 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a86f1-0af4-4047-b371-d784e478d267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:46.113186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-e27a86f1-0af4-4047-b371-d784e478d267 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 19:28:46.113186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:46.113186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:46.113186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:46.113186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:46.113186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:46.113186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:46.113186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:46.113186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:46.113186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:46.113186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:46.113186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:46.113186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:46.113186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:46.113186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:46.113186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:46.114155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:46.114155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:46.114155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:46.114155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:46.114155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:46.114155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:46.114155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:46.114155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:46.114155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:46.114155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:46.114155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:46.114155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:46.114155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:46.114155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:46.114155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:46.114155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:46.114911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:46.114911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:46.114911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:46.114911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:46.114911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:46.114911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:46.114911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:46.114911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:46.114911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:46.114911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:46.114911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 19:28:46.114911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:46.117733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 164/325] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:28:46.120701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15b2a3-9c59-4844-af6c-82f9c372c8eb None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:46.234915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15b2a3-9c59-4844-af6c-82f9c372c8eb None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:46.249903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:46.275938 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685663a-35a5-4ac9-9ae0-f575c22fc239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:46.276617 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685663a-35a5-4ac9-9ae0-f575c22fc239 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:46.276905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685663a-35a5-4ac9-9ae0-f575c22fc239 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:46.277183 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685663a-35a5-4ac9-9ae0-f575c22fc239 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:46.278047 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685663a-35a5-4ac9-9ae0-f575c22fc239 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:46.278356 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685663a-35a5-4ac9-9ae0-f575c22fc239 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:46.279727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685663a-35a5-4ac9-9ae0-f575c22fc239 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:46.289798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 162/326] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:46.296377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a86f1-0af4-4047-b371-d784e478d267 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:46.412654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a86f1-0af4-4047-b371-d784e478d267 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:46.432810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d1205-a090-4c7f-a111-019835f341d6 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:46.433125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d1205-a090-4c7f-a111-019835f341d6 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:46.433423 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d1205-a090-4c7f-a111-019835f341d6 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:46.434755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 163/327] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:28:46.441591 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5b045-b832-46e9-bdbf-bcfaf622baaa None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:46.442344 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5b045-b832-46e9-bdbf-bcfaf622baaa None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:46.442746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5b045-b832-46e9-bdbf-bcfaf622baaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:46.454841 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fb664-3b6e-4a3f-bc1c-06f13adc3ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:46.455732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fb664-3b6e-4a3f-bc1c-06f13adc3ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:46.456016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fb664-3b6e-4a3f-bc1c-06f13adc3ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:46.456296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fb664-3b6e-4a3f-bc1c-06f13adc3ec4 None admin] PATH_INFO: `/v3/users/072892d247394600b4f5e45e9c922a2b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:46.457591 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fb664-3b6e-4a3f-bc1c-06f13adc3ec4 None admin] RBAC: Authorizing `identity:get_user(user_id=072892d247394600b4f5e45e9c922a2b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:46.459078 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fb664-3b6e-4a3f-bc1c-06f13adc3ec4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:46.461075 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 165/328] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:46 2022] GET /identity/v3/users/072892d247394600b4f5e45e9c922a2b => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:46.466420 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fb664-3b6e-4a3f-bc1c-06f13adc3ec4 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:46.471440 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-a4f5b045-b832-46e9-bdbf-bcfaf622baaa None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:46.472647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-a4f5b045-b832-46e9-bdbf-bcfaf622baaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:46.540382 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:46.555338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 164/329] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:46.579896 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5b045-b832-46e9-bdbf-bcfaf622baaa None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:46.585231 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fb664-3b6e-4a3f-bc1c-06f13adc3ec4 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:46.627938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cdfc2-06e5-42c9-b53c-5457591891fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:46.629837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cdfc2-06e5-42c9-b53c-5457591891fa None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:46.630447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cdfc2-06e5-42c9-b53c-5457591891fa None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:46.630747 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07cdfc2-06e5-42c9-b53c-5457591891fa None admin] PATH_INFO: `/v3/system/users/072892d247394600b4f5e45e9c922a2b/roles/04bbf2f8d56744159d8dac700dde4379` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:46.633113 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07cdfc2-06e5-42c9-b53c-5457591891fa None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=072892d247394600b4f5e45e9c922a2b, role_id=04bbf2f8d56744159d8dac700dde4379)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:46.635315 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07cdfc2-06e5-42c9-b53c-5457591891fa None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:46.644823 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 166/330] 10.222.0.44 () {58 vars in 1334 bytes} [Tue Jun 14 19:28:46 2022] PUT /identity/v3/system/users/072892d247394600b4f5e45e9c922a2b/roles/04bbf2f8d56744159d8dac700dde4379 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:28:46.724834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5b045-b832-46e9-bdbf-bcfaf622baaa None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:46.735919 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:46.770492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91fe54-69a1-4e3b-ad1d-21e2e9287c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:46.771325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91fe54-69a1-4e3b-ad1d-21e2e9287c2a None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:46.771606 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91fe54-69a1-4e3b-ad1d-21e2e9287c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:46.771878 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91fe54-69a1-4e3b-ad1d-21e2e9287c2a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:46.787946 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e91fe54-69a1-4e3b-ad1d-21e2e9287c2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:46.796376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-9e91fe54-69a1-4e3b-ad1d-21e2e9287c2a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:46.796376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:46.796376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:46.796376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:46.796376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:46.796376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:46.796376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:46.796376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:46.796376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:46.796376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:46.796376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:46.796376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:46.796376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:46.796376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:46.796376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:46.796376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:46.797307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:46.797307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:46.797307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:46.797307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:46.797307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:46.797307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:46.797307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:46.797307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:46.797307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:46.797307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:46.797307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:46.797307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:46.797307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:46.797307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:46.797307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:46.797307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:46.798109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:46.798109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:46.798109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:46.798109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:46.798109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:46.798109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:46.798109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:46.798109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:46.798109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:46.798109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:46.798109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:46.798109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:46.800617 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 165/331] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:28:46.806736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cdfc2-06e5-42c9-b53c-5457591891fa None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:46.928579 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07cdfc2-06e5-42c9-b53c-5457591891fa None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:46.961238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:46.971299 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec617bd4-4e92-41d1-a24d-944c96e9a985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:46.972088 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec617bd4-4e92-41d1-a24d-944c96e9a985 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:46.972401 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec617bd4-4e92-41d1-a24d-944c96e9a985 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:46.972687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec617bd4-4e92-41d1-a24d-944c96e9a985 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:46.974555 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec617bd4-4e92-41d1-a24d-944c96e9a985 None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:46.977955 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec617bd4-4e92-41d1-a24d-944c96e9a985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:46.979443 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec617bd4-4e92-41d1-a24d-944c96e9a985 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:46.989639 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 167/332] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:46.995236 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91fe54-69a1-4e3b-ad1d-21e2e9287c2a None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:47.110716 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91fe54-69a1-4e3b-ad1d-21e2e9287c2a None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:47.151012 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28dffbf-fb30-4e8d-9261-2457f5951405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:47.152240 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dffbf-fb30-4e8d-9261-2457f5951405 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:47.152725 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dffbf-fb30-4e8d-9261-2457f5951405 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:47.153201 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28dffbf-fb30-4e8d-9261-2457f5951405 None admin] PATH_INFO: `/v3/users/7b30e55c706e4e6b8427e82c24b1e569` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:47.154934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dffbf-fb30-4e8d-9261-2457f5951405 None admin] RBAC: Authorizing `identity:get_user(user_id=7b30e55c706e4e6b8427e82c24b1e569)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:47.156600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28dffbf-fb30-4e8d-9261-2457f5951405 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:47.158477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 166/333] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:46 2022] GET /identity/v3/users/7b30e55c706e4e6b8427e82c24b1e569 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:47.168937 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec617bd4-4e92-41d1-a24d-944c96e9a985 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:47.310761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec617bd4-4e92-41d1-a24d-944c96e9a985 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:47.349781 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4896f5-06c6-4e60-88c3-b6149d63f1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:47.350442 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4896f5-06c6-4e60-88c3-b6149d63f1bc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:47.350733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4896f5-06c6-4e60-88c3-b6149d63f1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:47.351014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4896f5-06c6-4e60-88c3-b6149d63f1bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:47.351857 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4896f5-06c6-4e60-88c3-b6149d63f1bc None admin] RBAC: Adding query filter params (role.id=bf1733d36314409c80cd50b2268834b1, user.id=7b30e55c706e4e6b8427e82c24b1e569, scope.system=all) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:47.352169 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4896f5-06c6-4e60-88c3-b6149d63f1bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:47.353632 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4896f5-06c6-4e60-88c3-b6149d63f1bc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:47.372800 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 168/334] 10.222.0.44 () {56 vars in 1308 bytes} [Tue Jun 14 19:28:47 2022] GET /identity/v3/role_assignments?user.id=7b30e55c706e4e6b8427e82c24b1e569&scope.system=all&role.id=bf1733d36314409c80cd50b2268834b1 => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:48.535038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a4e84-cb9a-40b6-952d-e2a32600027b None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:48.535636 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a4e84-cb9a-40b6-952d-e2a32600027b None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:48.535636 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a4e84-cb9a-40b6-952d-e2a32600027b None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:48.537442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 167/335] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:48.542613 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d6435-92c4-4f6a-a034-fb7474ae0b2a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:48.543476 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d6435-92c4-4f6a-a034-fb7474ae0b2a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:48.543963 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d6435-92c4-4f6a-a034-fb7474ae0b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:48.570371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-646d6435-92c4-4f6a-a034-fb7474ae0b2a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:48.571888 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-646d6435-92c4-4f6a-a034-fb7474ae0b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:48.627366 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:48.657151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 169/336] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:48.694184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a4e84-cb9a-40b6-952d-e2a32600027b None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:48.739808 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:48.842293 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a4e84-cb9a-40b6-952d-e2a32600027b None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:48.900475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78afe1-5b6d-4f8d-b789-71d32761dabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:48.901281 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78afe1-5b6d-4f8d-b789-71d32761dabd None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:48.901607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78afe1-5b6d-4f8d-b789-71d32761dabd None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:48.901889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78afe1-5b6d-4f8d-b789-71d32761dabd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:48.920204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e78afe1-5b6d-4f8d-b789-71d32761dabd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:48.928940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-4e78afe1-5b6d-4f8d-b789-71d32761dabd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:48.928940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:48.928940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:48.928940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:48.928940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:48.928940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:48.928940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:48.928940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:48.928940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:48.928940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:48.928940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:48.928940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:48.928940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:48.928940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:48.928940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:48.928940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:48.929909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:48.929909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:48.929909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:48.929909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:48.929909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:48.929909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:48.929909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:48.929909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:48.929909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:48.929909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:48.929909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:48.929909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:48.929909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:48.929909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:48.929909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:48.929909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:48.930658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:48.930658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:48.930658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:48.930658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:48.930658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:48.930658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:48.930658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:48.930658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:48.930658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:48.930658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:48.930658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:48.930658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:48.930658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 168/337] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:48.936324 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d6435-92c4-4f6a-a034-fb7474ae0b2a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:49.062123 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d6435-92c4-4f6a-a034-fb7474ae0b2a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:49.106610 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa5225-5956-4c98-88af-dec33095ba41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:49.107211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa5225-5956-4c98-88af-dec33095ba41 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:49.107499 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa5225-5956-4c98-88af-dec33095ba41 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:49.107777 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa5225-5956-4c98-88af-dec33095ba41 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:49.108528 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa5225-5956-4c98-88af-dec33095ba41 None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:49.108836 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa5225-5956-4c98-88af-dec33095ba41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:49.110248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa5225-5956-4c98-88af-dec33095ba41 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:49.121556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 170/338] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:49.127443 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78afe1-5b6d-4f8d-b789-71d32761dabd None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:49.143968 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d53f2-2bee-4bc4-87e0-413e8c7f9389 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:49.144248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d53f2-2bee-4bc4-87e0-413e8c7f9389 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:49.144849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d53f2-2bee-4bc4-87e0-413e8c7f9389 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:49.146270 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 171/339] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:28:49.160453 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94326850-3c57-4981-b072-57e420c7ffe4 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:49.160794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94326850-3c57-4981-b072-57e420c7ffe4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:49.161006 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94326850-3c57-4981-b072-57e420c7ffe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:49.182686 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-94326850-3c57-4981-b072-57e420c7ffe4 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:49.183870 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-94326850-3c57-4981-b072-57e420c7ffe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:49.233399 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:49.276420 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 172/340] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:49.295609 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:49.308180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78afe1-5b6d-4f8d-b789-71d32761dabd None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:49.308374 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94326850-3c57-4981-b072-57e420c7ffe4 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:49.386694 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e924c-1f55-4e8c-9656-2e9e6f71afee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:49.387724 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e924c-1f55-4e8c-9656-2e9e6f71afee None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:49.388207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e924c-1f55-4e8c-9656-2e9e6f71afee None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:49.388676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e924c-1f55-4e8c-9656-2e9e6f71afee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:49.443506 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94326850-3c57-4981-b072-57e420c7ffe4 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:49.512284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8906e5f-e81d-46d5-805e-e242986e0563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:49.513102 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8906e5f-e81d-46d5-805e-e242986e0563 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:49.513400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8906e5f-e81d-46d5-805e-e242986e0563 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:49.513686 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8906e5f-e81d-46d5-805e-e242986e0563 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:49.537992 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8906e5f-e81d-46d5-805e-e242986e0563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:49.547457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-a8906e5f-e81d-46d5-805e-e242986e0563 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:49.547457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:49.547457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:49.547457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:49.547457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:49.547457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:49.547457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:49.547457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:49.547457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:49.547457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:49.547457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:49.547457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:49.547457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:49.547457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:49.547457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:49.547457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:49.548811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:49.548811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:49.548811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:49.548811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:49.548811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:49.548811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:49.548811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:49.548811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:49.548811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:49.548811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:49.548811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:49.548811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:49.548811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:49.548811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:49.548811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:49.548811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:49.549654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:49.549654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:49.549654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:49.549654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:49.549654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:49.549654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:49.549654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:49.549654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:49.549654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:49.549654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:49.549654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:49.549654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:49.549654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 173/341] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:28:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:28:49.556329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8906e5f-e81d-46d5-805e-e242986e0563 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:49.571331 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e924c-1f55-4e8c-9656-2e9e6f71afee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:49.573272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e924c-1f55-4e8c-9656-2e9e6f71afee None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:49.617352 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:49.764712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8906e5f-e81d-46d5-805e-e242986e0563 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:49.775122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:49.784809 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 169/342] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:28:49.793202 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e924c-1f55-4e8c-9656-2e9e6f71afee None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:49.855377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586a28c-586c-4370-94d4-1ef41cc18d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:49.856066 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586a28c-586c-4370-94d4-1ef41cc18d1f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:49.856349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586a28c-586c-4370-94d4-1ef41cc18d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:49.856627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586a28c-586c-4370-94d4-1ef41cc18d1f None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:49.857396 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586a28c-586c-4370-94d4-1ef41cc18d1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:49.857716 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586a28c-586c-4370-94d4-1ef41cc18d1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:49.859104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586a28c-586c-4370-94d4-1ef41cc18d1f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:49.883376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 174/343] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:28:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:49.899101 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586a28c-586c-4370-94d4-1ef41cc18d1f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:49.924447 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e924c-1f55-4e8c-9656-2e9e6f71afee None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:49.961985 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ac581-dac0-458b-8f81-29b915a47c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:49.963535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ac581-dac0-458b-8f81-29b915a47c54 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:49.963825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ac581-dac0-458b-8f81-29b915a47c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:49.964106 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ac581-dac0-458b-8f81-29b915a47c54 None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:49.965463 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ac581-dac0-458b-8f81-29b915a47c54 None admin] RBAC: Authorizing `identity:get_project(project_id=2a169bbfc64d4c459ba54854d70678e7)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:49.971302 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ac581-dac0-458b-8f81-29b915a47c54 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:49.974668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 170/344] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:49 2022] GET /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:49.979862 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ac581-dac0-458b-8f81-29b915a47c54 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:50.064321 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:50.078979 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586a28c-586c-4370-94d4-1ef41cc18d1f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:50.081355 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:50.139710 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad31337b-356d-4fd9-a73e-dd52f7c41bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:50.140377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31337b-356d-4fd9-a73e-dd52f7c41bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:50.140661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31337b-356d-4fd9-a73e-dd52f7c41bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:50.140936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31337b-356d-4fd9-a73e-dd52f7c41bc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:50.187374 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ac581-dac0-458b-8f81-29b915a47c54 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:50.243926 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31337b-356d-4fd9-a73e-dd52f7c41bc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:50.245439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad31337b-356d-4fd9-a73e-dd52f7c41bc2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:50.251503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68393e-3738-42c4-8bf3-e2ccf9e4633a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:50.252383 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68393e-3738-42c4-8bf3-e2ccf9e4633a None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:50.252670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68393e-3738-42c4-8bf3-e2ccf9e4633a None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:50.252949 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68393e-3738-42c4-8bf3-e2ccf9e4633a None admin] PATH_INFO: `/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:50.270652 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68393e-3738-42c4-8bf3-e2ccf9e4633a None admin] RBAC: Authorizing `identity:get_group(group_id=d6b2ea7a25da4b58ba439afbbe3a87ab)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:50.272134 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68393e-3738-42c4-8bf3-e2ccf9e4633a None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:50.274254 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 171/345] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jun 14 19:28:49 2022] GET /identity/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab => generated 226 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:50.275520 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea991e77-d7e7-4764-938f-8243f3829d29 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:50.275815 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea991e77-d7e7-4764-938f-8243f3829d29 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:50.276095 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea991e77-d7e7-4764-938f-8243f3829d29 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:50.279623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 172/346] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:50.287790 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb2a16-bc38-44f0-983c-6be080a750da None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:50.288074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb2a16-bc38-44f0-983c-6be080a750da None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:50.288367 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb2a16-bc38-44f0-983c-6be080a750da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:50.320019 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-34cb2a16-bc38-44f0-983c-6be080a750da None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:50.321149 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-34cb2a16-bc38-44f0-983c-6be080a750da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:50.413487 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 173/347] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:50.414736 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb2a16-bc38-44f0-983c-6be080a750da None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:50.428279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:50.461284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 175/348] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:28:50.463218 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc757f-9e60-4334-a5f9-c49ca297e113 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:50.463503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc757f-9e60-4334-a5f9-c49ca297e113 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:50.463782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc757f-9e60-4334-a5f9-c49ca297e113 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:50.465046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 176/349] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:50.465782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc757f-9e60-4334-a5f9-c49ca297e113 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:50.499990 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:50.553534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb2a16-bc38-44f0-983c-6be080a750da None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:50.601357 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77a57f-f46a-4170-ba1d-b20199165f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:50.602017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77a57f-f46a-4170-ba1d-b20199165f9b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:50.602263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77a57f-f46a-4170-ba1d-b20199165f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:50.602539 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a77a57f-f46a-4170-ba1d-b20199165f9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:50.603384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77a57f-f46a-4170-ba1d-b20199165f9b None admin] RBAC: Adding query filter params (group.id=d6b2ea7a25da4b58ba439afbbe3a87ab, role.id=bf1733d36314409c80cd50b2268834b1, scope.project.id=2a169bbfc64d4c459ba54854d70678e7) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:50.603696 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77a57f-f46a-4170-ba1d-b20199165f9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:50.605223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a77a57f-f46a-4170-ba1d-b20199165f9b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:50.616017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 174/350] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jun 14 19:28:50 2022] GET /identity/v3/role_assignments?group.id=d6b2ea7a25da4b58ba439afbbe3a87ab&scope.project.id=2a169bbfc64d4c459ba54854d70678e7&role.id=bf1733d36314409c80cd50b2268834b1 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:50.616301 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc757f-9e60-4334-a5f9-c49ca297e113 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:50.616978 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77a57f-f46a-4170-ba1d-b20199165f9b None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:50.669837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca4c0d-ddba-4151-890a-617901c8e9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:50.671083 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca4c0d-ddba-4151-890a-617901c8e9ad None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:50.671524 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca4c0d-ddba-4151-890a-617901c8e9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:50.671949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca4c0d-ddba-4151-890a-617901c8e9ad None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:50.687180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca4c0d-ddba-4151-890a-617901c8e9ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:50.698557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-88ca4c0d-ddba-4151-890a-617901c8e9ad None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:50.698557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:50.698557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:50.698557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:50.698557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:50.698557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:50.698557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:50.698557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:50.698557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:50.698557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:50.698557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:50.698557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:50.698557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:50.698557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:50.698557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:50.698557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:50.699704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:50.699704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:50.699704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:50.699704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:50.699704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:50.699704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:50.699704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:50.699704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:50.699704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:50.699704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:50.699704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:50.699704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:50.699704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:50.699704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:50.699704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:50.699704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:50.700684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:50.700684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:50.700684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:50.700684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:50.700684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:50.700684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:50.700684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:50.700684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:50.700684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:50.700684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:50.700684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:50.700684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:50.703047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 177/351] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:28:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:50.706038 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a06784-22b4-4b88-af01-7ef8e5a7c2f6 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:50.706038 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a06784-22b4-4b88-af01-7ef8e5a7c2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:50.706038 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a06784-22b4-4b88-af01-7ef8e5a7c2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:50.724188 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-84a06784-22b4-4b88-af01-7ef8e5a7c2f6 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:50.725445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-84a06784-22b4-4b88-af01-7ef8e5a7c2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:50.782155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:50.804576 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a77a57f-f46a-4170-ba1d-b20199165f9b None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:50.806883 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 178/352] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:50.808212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84240a30-d5ca-466c-b523-94e23a8782af None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:50.808491 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84240a30-d5ca-466c-b523-94e23a8782af None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:50.808769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84240a30-d5ca-466c-b523-94e23a8782af None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:50.816115 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 179/353] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:50.817974 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84240a30-d5ca-466c-b523-94e23a8782af None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:50.840383 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:50.865697 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ff2fa-5314-4603-86dd-bb5b39e64faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:50.867032 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ff2fa-5314-4603-86dd-bb5b39e64faa None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:50.867560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ff2fa-5314-4603-86dd-bb5b39e64faa None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:50.868049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ff2fa-5314-4603-86dd-bb5b39e64faa None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:50.869660 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ff2fa-5314-4603-86dd-bb5b39e64faa None admin] RBAC: Authorizing `identity:get_project(project_id=2a169bbfc64d4c459ba54854d70678e7)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:50.872170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ff2fa-5314-4603-86dd-bb5b39e64faa None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:50.874207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 175/354] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:50 2022] GET /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:50.875702 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535ef33-1b40-4eae-969a-1221197785d3 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:50.876676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535ef33-1b40-4eae-969a-1221197785d3 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:50.877213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535ef33-1b40-4eae-969a-1221197785d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:50.900143 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-1535ef33-1b40-4eae-969a-1221197785d3 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:50.901342 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-1535ef33-1b40-4eae-969a-1221197785d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:50.970225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84240a30-d5ca-466c-b523-94e23a8782af None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:50.996318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 176/355] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:50.997165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535ef33-1b40-4eae-969a-1221197785d3 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:51.031618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f01e9-0301-422e-ae78-7dbd15e34d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:51.032310 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f01e9-0301-422e-ae78-7dbd15e34d4f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:51.032597 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f01e9-0301-422e-ae78-7dbd15e34d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:51.032874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f01e9-0301-422e-ae78-7dbd15e34d4f None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:51.033666 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f01e9-0301-422e-ae78-7dbd15e34d4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:51.033974 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f01e9-0301-422e-ae78-7dbd15e34d4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:51.035590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0f01e9-0301-422e-ae78-7dbd15e34d4f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:51.044809 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 180/356] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:28:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:51.048495 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f01e9-0301-422e-ae78-7dbd15e34d4f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:51.116290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1535ef33-1b40-4eae-969a-1221197785d3 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:51.136820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:51.141976 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:51.155187 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f01e9-0301-422e-ae78-7dbd15e34d4f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:51.166802 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2cb500-622f-45d3-bfc0-3d546295b9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:51.167769 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2cb500-622f-45d3-bfc0-3d546295b9af None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:51.168178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2cb500-622f-45d3-bfc0-3d546295b9af None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:51.168461 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2cb500-622f-45d3-bfc0-3d546295b9af None admin] PATH_INFO: `/v3/roles/member` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:51.193206 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2cb500-622f-45d3-bfc0-3d546295b9af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:51.195066 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f12e3-188b-427a-9ad7-da20404df809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:51.195924 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f12e3-188b-427a-9ad7-da20404df809 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:51.196201 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f12e3-188b-427a-9ad7-da20404df809 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:51.196473 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f12e3-188b-427a-9ad7-da20404df809 None admin] PATH_INFO: `/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:51.197668 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f12e3-188b-427a-9ad7-da20404df809 None admin] RBAC: Authorizing `identity:get_group(group_id=d6b2ea7a25da4b58ba439afbbe3a87ab)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:51.199106 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f12e3-188b-427a-9ad7-da20404df809 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:51.200886 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 181/357] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jun 14 19:28:51 2022] GET /identity/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:51.202407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f12e3-188b-427a-9ad7-da20404df809 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:51.205207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-0f2cb500-622f-45d3-bfc0-3d546295b9af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:51.205207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:51.205207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:51.205207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:51.205207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:51.205207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:51.205207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:51.205207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:51.205207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:51.205207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:51.205207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:51.205207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:51.205207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:51.205207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:51.205207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:51.205207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:51.206155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:51.206155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:51.206155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:51.206155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:51.206155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:51.206155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:51.206155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:51.206155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:51.206155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:51.206155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:51.206155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:51.206155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:51.206155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:51.206155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:51.206155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:51.206155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:51.207542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:51.207542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:51.207542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:51.207542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:51.207542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:51.207542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:51.207542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:51.207542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:51.207542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:51.207542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:51.207542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:51.207542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:51.207542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 177/358] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:51.209611 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2cb500-622f-45d3-bfc0-3d546295b9af None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:51.338078 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f12e3-188b-427a-9ad7-da20404df809 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:51.353842 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:51.354758 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2cb500-622f-45d3-bfc0-3d546295b9af None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:51.391030 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02640782-3e37-4373-815c-fb36d8750b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:51.392034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02640782-3e37-4373-815c-fb36d8750b3c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:51.392319 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02640782-3e37-4373-815c-fb36d8750b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:51.392601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02640782-3e37-4373-815c-fb36d8750b3c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:51.399116 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ef840-1e82-4fed-bac4-e4d81054ec64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:51.399855 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ef840-1e82-4fed-bac4-e4d81054ec64 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:51.400421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ef840-1e82-4fed-bac4-e4d81054ec64 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:51.400785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ef840-1e82-4fed-bac4-e4d81054ec64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:51.405898 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02640782-3e37-4373-815c-fb36d8750b3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:51.415691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-02640782-3e37-4373-815c-fb36d8750b3c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 19:28:51.415691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:51.415691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:51.415691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:51.415691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:51.415691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:51.415691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:51.415691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:51.415691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:51.415691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:51.415691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:51.415691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:51.415691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:51.415691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:51.415691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:51.415691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:51.416903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:51.416903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:51.416903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:51.416903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:51.416903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:51.416903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:51.416903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:51.416903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:51.416903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:51.416903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:51.416903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:51.416903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:51.416903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:51.416903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:51.416903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:51.416903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:51.418084 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:51.418084 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:51.418084 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:51.418084 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:51.418084 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:51.418084 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:51.418084 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:51.418084 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:51.418084 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:51.418084 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:51.418084 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 14 19:28:51.418084 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:51.418084 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 182/359] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:51.418732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02640782-3e37-4373-815c-fb36d8750b3c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:51.457596 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:51.492860 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ef840-1e82-4fed-bac4-e4d81054ec64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:51.494407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ef840-1e82-4fed-bac4-e4d81054ec64 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:51.555321 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02640782-3e37-4373-815c-fb36d8750b3c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:51.599495 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0128e-448b-4ebf-bf20-6f29c90a4bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:51.600157 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0128e-448b-4ebf-bf20-6f29c90a4bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:51.600443 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0128e-448b-4ebf-bf20-6f29c90a4bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:51.600724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0128e-448b-4ebf-bf20-6f29c90a4bb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:51.601643 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0128e-448b-4ebf-bf20-6f29c90a4bb2 None admin] RBAC: Adding query filter params (group.id=d6b2ea7a25da4b58ba439afbbe3a87ab, role.id=1302d95e46b4422d84f581f8838d5aac, scope.project.id=2a169bbfc64d4c459ba54854d70678e7) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:51.601962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0128e-448b-4ebf-bf20-6f29c90a4bb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:51.603411 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0128e-448b-4ebf-bf20-6f29c90a4bb2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:51.609061 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 183/360] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jun 14 19:28:51 2022] GET /identity/v3/role_assignments?group.id=d6b2ea7a25da4b58ba439afbbe3a87ab&scope.project.id=2a169bbfc64d4c459ba54854d70678e7&role.id=1302d95e46b4422d84f581f8838d5aac => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:51.610549 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0128e-448b-4ebf-bf20-6f29c90a4bb2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:51.632877 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 178/361] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:28:51.635890 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f5965-60f7-4cae-b6ac-43e8139e6958 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:51.636732 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f5965-60f7-4cae-b6ac-43e8139e6958 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:51.637305 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f5965-60f7-4cae-b6ac-43e8139e6958 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:51.639938 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 179/362] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:51.641344 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f5965-60f7-4cae-b6ac-43e8139e6958 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:51.668573 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:51.752560 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0128e-448b-4ebf-bf20-6f29c90a4bb2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:51.755942 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:51.783021 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f5965-60f7-4cae-b6ac-43e8139e6958 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:51.795899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930c692-e3cb-4c1f-aedf-c66e0da6fd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:51.796574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930c692-e3cb-4c1f-aedf-c66e0da6fd9b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:51.796859 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930c692-e3cb-4c1f-aedf-c66e0da6fd9b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:51.797139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930c692-e3cb-4c1f-aedf-c66e0da6fd9b None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:51.797943 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930c692-e3cb-4c1f-aedf-c66e0da6fd9b None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:51.798255 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930c692-e3cb-4c1f-aedf-c66e0da6fd9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:51.799656 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930c692-e3cb-4c1f-aedf-c66e0da6fd9b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:51.811049 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 184/363] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:51.811994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930c692-e3cb-4c1f-aedf-c66e0da6fd9b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:51.838416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5db9e-0ff2-4af3-951b-886076974c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:51.839113 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5db9e-0ff2-4af3-951b-886076974c18 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:51.839393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5db9e-0ff2-4af3-951b-886076974c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:51.839667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5db9e-0ff2-4af3-951b-886076974c18 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:51.840577 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5db9e-0ff2-4af3-951b-886076974c18 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:51.840888 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5db9e-0ff2-4af3-951b-886076974c18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:51.842612 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5db9e-0ff2-4af3-951b-886076974c18 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:51.854005 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 180/364] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:51.855709 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f65792-af7c-42ec-860e-1dabe54de062 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:51.856122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f65792-af7c-42ec-860e-1dabe54de062 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:51.856402 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f65792-af7c-42ec-860e-1dabe54de062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:51.884016 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-62f65792-af7c-42ec-860e-1dabe54de062 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:51.885336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-62f65792-af7c-42ec-860e-1dabe54de062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:51.934573 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:51.942758 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930c692-e3cb-4c1f-aedf-c66e0da6fd9b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:51.977947 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 181/365] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:51.978461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bb0eb-7217-432f-85b4-dd3080235984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:51.978844 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f65792-af7c-42ec-860e-1dabe54de062 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:51.979324 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bb0eb-7217-432f-85b4-dd3080235984 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:51.979607 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bb0eb-7217-432f-85b4-dd3080235984 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:51.979882 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52bb0eb-7217-432f-85b4-dd3080235984 None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:51.981078 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52bb0eb-7217-432f-85b4-dd3080235984 None admin] RBAC: Authorizing `identity:get_project(project_id=e743a4a482c24a1f88389b1830c2386e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:51.982626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52bb0eb-7217-432f-85b4-dd3080235984 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:51.984634 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 185/366] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:51 2022] GET /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:51.985409 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bb0eb-7217-432f-85b4-dd3080235984 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:52.067375 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:52.105273 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f65792-af7c-42ec-860e-1dabe54de062 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:52.112744 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52bb0eb-7217-432f-85b4-dd3080235984 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:52.148934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcaff3-24d0-4d56-8c44-118091188499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:52.149618 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcaff3-24d0-4d56-8c44-118091188499 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:52.149905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcaff3-24d0-4d56-8c44-118091188499 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:52.150184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcaff3-24d0-4d56-8c44-118091188499 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:52.151317 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c74a0f-71c4-4e9c-b3e6-86a251fc44d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:52.152256 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c74a0f-71c4-4e9c-b3e6-86a251fc44d5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:52.152541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c74a0f-71c4-4e9c-b3e6-86a251fc44d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:52.152918 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c74a0f-71c4-4e9c-b3e6-86a251fc44d5 None admin] PATH_INFO: `/v3/users/072892d247394600b4f5e45e9c922a2b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:52.156131 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c74a0f-71c4-4e9c-b3e6-86a251fc44d5 None admin] RBAC: Authorizing `identity:get_user(user_id=072892d247394600b4f5e45e9c922a2b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:52.157697 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c74a0f-71c4-4e9c-b3e6-86a251fc44d5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:52.159536 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 186/367] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:28:51 2022] GET /identity/v3/users/072892d247394600b4f5e45e9c922a2b => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:52.160881 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c74a0f-71c4-4e9c-b3e6-86a251fc44d5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:52.205645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:52.248882 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcaff3-24d0-4d56-8c44-118091188499 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:52.251480 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcaff3-24d0-4d56-8c44-118091188499 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:52.285761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c74a0f-71c4-4e9c-b3e6-86a251fc44d5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:52.327111 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0f628-820a-4731-9b3b-2c437faa5709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:52.327973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0f628-820a-4731-9b3b-2c437faa5709 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:52.328256 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0f628-820a-4731-9b3b-2c437faa5709 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:52.328529 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0f628-820a-4731-9b3b-2c437faa5709 None admin] PATH_INFO: `/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:52.329745 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0f628-820a-4731-9b3b-2c437faa5709 None admin] RBAC: Authorizing `identity:get_group(group_id=d6b2ea7a25da4b58ba439afbbe3a87ab)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:52.331198 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0f628-820a-4731-9b3b-2c437faa5709 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:52.332881 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 187/368] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jun 14 19:28:52 2022] GET /identity/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:52.339530 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0f628-820a-4731-9b3b-2c437faa5709 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:52.344199 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:52.387950 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 182/369] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:28:52.389119 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcaff3-24d0-4d56-8c44-118091188499 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:52.458376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:52.462473 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0f628-820a-4731-9b3b-2c437faa5709 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:52.500931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af46a6-85dc-42d8-800b-5bb0869c8293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:52.502045 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af46a6-85dc-42d8-800b-5bb0869c8293 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:52.502618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af46a6-85dc-42d8-800b-5bb0869c8293 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:52.504190 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af46a6-85dc-42d8-800b-5bb0869c8293 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:52.520359 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af46a6-85dc-42d8-800b-5bb0869c8293 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:52.530462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-05af46a6-85dc-42d8-800b-5bb0869c8293 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:28:52.530462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:52.530462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:52.530462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:52.530462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:52.530462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:52.530462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:52.530462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:52.530462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:52.530462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:52.530462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:52.530462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:52.530462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:52.530462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:52.530462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:52.530462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:52.531574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:52.531574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:52.531574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:52.531574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:52.531574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:52.531574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:52.531574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:52.531574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:52.531574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:52.531574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:52.531574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:52.531574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:52.531574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:52.531574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:52.531574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:52.531574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:52.532552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:52.532552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:52.532552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:52.532552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:52.532552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:52.532552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:52.532552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:52.532552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:52.532552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:52.532552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:52.532552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:28:52.532552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:52.534448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 188/370] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:28:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:52.536183 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af46a6-85dc-42d8-800b-5bb0869c8293 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:52.538917 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcaff3-24d0-4d56-8c44-118091188499 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:52.586660 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b12eb-bc18-4907-8fe8-9202506f56cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:52.587583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b12eb-bc18-4907-8fe8-9202506f56cc None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:52.588025 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b12eb-bc18-4907-8fe8-9202506f56cc None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:52.588451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7b12eb-bc18-4907-8fe8-9202506f56cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:52.590210 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b12eb-bc18-4907-8fe8-9202506f56cc None admin] RBAC: Adding query filter params (role.id=04bbf2f8d56744159d8dac700dde4379, user.id=072892d247394600b4f5e45e9c922a2b, scope.system=all) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:52.590670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b12eb-bc18-4907-8fe8-9202506f56cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:52.592312 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7b12eb-bc18-4907-8fe8-9202506f56cc None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:52.610899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 183/371] 10.222.0.44 () {56 vars in 1308 bytes} [Tue Jun 14 19:28:52 2022] GET /identity/v3/role_assignments?user.id=072892d247394600b4f5e45e9c922a2b&scope.system=all&role.id=04bbf2f8d56744159d8dac700dde4379 => generated 510 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:52.612229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b12eb-bc18-4907-8fe8-9202506f56cc None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:52.663873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:52.684749 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af46a6-85dc-42d8-800b-5bb0869c8293 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:52.725755 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f79df-e2b5-4640-9e13-15802905834f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:52.726872 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f79df-e2b5-4640-9e13-15802905834f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:52.727320 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f79df-e2b5-4640-9e13-15802905834f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:52.727755 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f79df-e2b5-4640-9e13-15802905834f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:52.728790 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f79df-e2b5-4640-9e13-15802905834f None admin] RBAC: Adding query filter params (group.id=d6b2ea7a25da4b58ba439afbbe3a87ab, role.id=1302d95e46b4422d84f581f8838d5aac, scope.project.id=e743a4a482c24a1f88389b1830c2386e) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:52.729284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f79df-e2b5-4640-9e13-15802905834f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:52.731130 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f79df-e2b5-4640-9e13-15802905834f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:52.737738 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 189/372] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jun 14 19:28:52 2022] GET /identity/v3/role_assignments?group.id=d6b2ea7a25da4b58ba439afbbe3a87ab&scope.project.id=e743a4a482c24a1f88389b1830c2386e&role.id=1302d95e46b4422d84f581f8838d5aac => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:52.738796 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f79df-e2b5-4640-9e13-15802905834f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:52.767193 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7b12eb-bc18-4907-8fe8-9202506f56cc None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:52.767501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:52.834464 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb72d2c-181a-40ff-bf6a-911255e92f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:52.835232 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb72d2c-181a-40ff-bf6a-911255e92f48 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:52.835582 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb72d2c-181a-40ff-bf6a-911255e92f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:52.835926 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb72d2c-181a-40ff-bf6a-911255e92f48 None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:52.837414 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb72d2c-181a-40ff-bf6a-911255e92f48 None admin] RBAC: Authorizing `identity:get_project(project_id=e743a4a482c24a1f88389b1830c2386e)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:52.839096 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb72d2c-181a-40ff-bf6a-911255e92f48 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:52.841108 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 184/373] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:52 2022] GET /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:52.846452 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb72d2c-181a-40ff-bf6a-911255e92f48 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:52.865302 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f79df-e2b5-4640-9e13-15802905834f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:52.905442 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5a8a7-0fb0-4654-8878-05a0751eaaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:52.906543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5a8a7-0fb0-4654-8878-05a0751eaaab None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:52.907060 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5a8a7-0fb0-4654-8878-05a0751eaaab None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:52.907534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5a8a7-0fb0-4654-8878-05a0751eaaab None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:52.908500 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5a8a7-0fb0-4654-8878-05a0751eaaab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:52.909022 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5a8a7-0fb0-4654-8878-05a0751eaaab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:52.911297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5a8a7-0fb0-4654-8878-05a0751eaaab None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:52.921907 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 190/374] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:52.930690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5a8a7-0fb0-4654-8878-05a0751eaaab None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:52.991283 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:52.997920 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb72d2c-181a-40ff-bf6a-911255e92f48 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:53.037081 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644da96-0102-4ef3-b327-8776bb0b7e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:53.038135 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644da96-0102-4ef3-b327-8776bb0b7e5b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:53.038516 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644da96-0102-4ef3-b327-8776bb0b7e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:53.038911 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644da96-0102-4ef3-b327-8776bb0b7e5b None admin] PATH_INFO: `/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:53.040443 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644da96-0102-4ef3-b327-8776bb0b7e5b None admin] RBAC: Authorizing `identity:get_group(group_id=d6b2ea7a25da4b58ba439afbbe3a87ab)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:53.042222 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644da96-0102-4ef3-b327-8776bb0b7e5b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:53.044017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 185/375] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jun 14 19:28:52 2022] GET /identity/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:53.044908 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:53.050210 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644da96-0102-4ef3-b327-8776bb0b7e5b None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:53.065297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5a8a7-0fb0-4654-8878-05a0751eaaab None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:53.110280 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21b069-4e22-4b0b-96be-c59b42600c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:53.111533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21b069-4e22-4b0b-96be-c59b42600c04 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:53.111970 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21b069-4e22-4b0b-96be-c59b42600c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:53.112883 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21b069-4e22-4b0b-96be-c59b42600c04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:53.178686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644da96-0102-4ef3-b327-8776bb0b7e5b None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:53.206091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21b069-4e22-4b0b-96be-c59b42600c04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:53.208398 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21b069-4e22-4b0b-96be-c59b42600c04 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:53.252498 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29462387-6706-43d8-bf26-f1a3ba2c7319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:53.253356 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29462387-6706-43d8-bf26-f1a3ba2c7319 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:53.254039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29462387-6706-43d8-bf26-f1a3ba2c7319 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:53.254172 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29462387-6706-43d8-bf26-f1a3ba2c7319 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:53.255897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29462387-6706-43d8-bf26-f1a3ba2c7319 None admin] RBAC: Adding query filter params (group.id=d6b2ea7a25da4b58ba439afbbe3a87ab, role.id=bf1733d36314409c80cd50b2268834b1, scope.project.id=e743a4a482c24a1f88389b1830c2386e) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:53.256224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29462387-6706-43d8-bf26-f1a3ba2c7319 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:53.257710 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29462387-6706-43d8-bf26-f1a3ba2c7319 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:53.266118 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 186/376] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jun 14 19:28:53 2022] GET /identity/v3/role_assignments?group.id=d6b2ea7a25da4b58ba439afbbe3a87ab&scope.project.id=e743a4a482c24a1f88389b1830c2386e&role.id=bf1733d36314409c80cd50b2268834b1 => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:53.268793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4239e-3944-41d5-b961-ccb35691be5c None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:53.268793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4239e-3944-41d5-b961-ccb35691be5c None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:53.268793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e4239e-3944-41d5-b961-ccb35691be5c None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:53.270613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 187/377] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:53.277411 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cae0a9-5a00-443e-be5d-8c24bddab118 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:53.277756 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cae0a9-5a00-443e-be5d-8c24bddab118 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:53.278018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cae0a9-5a00-443e-be5d-8c24bddab118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:53.300887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-e1cae0a9-5a00-443e-be5d-8c24bddab118 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:53.302830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e1cae0a9-5a00-443e-be5d-8c24bddab118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:53.323250 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:53.331388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:53.344987 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 191/378] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:28:53.354829 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21b069-4e22-4b0b-96be-c59b42600c04 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:53.382842 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 188/379] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:28:53.406158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cae0a9-5a00-443e-be5d-8c24bddab118 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:53.503766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21b069-4e22-4b0b-96be-c59b42600c04 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:53.516128 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cae0a9-5a00-443e-be5d-8c24bddab118 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:53.542769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc70375-b0d5-4c37-85b9-4f8ddaf9023c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:53.543656 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc70375-b0d5-4c37-85b9-4f8ddaf9023c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:53.544757 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc70375-b0d5-4c37-85b9-4f8ddaf9023c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:53.544757 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc70375-b0d5-4c37-85b9-4f8ddaf9023c None admin] PATH_INFO: `/v3/projects/782dbf52581f4a55b95487f939e373c1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:53.545560 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc70375-b0d5-4c37-85b9-4f8ddaf9023c None admin] RBAC: Authorizing `identity:get_project(project_id=782dbf52581f4a55b95487f939e373c1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:53.547050 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc70375-b0d5-4c37-85b9-4f8ddaf9023c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:53.553498 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 192/380] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:53 2022] GET /identity/v3/projects/782dbf52581f4a55b95487f939e373c1 => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:53.555247 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc70375-b0d5-4c37-85b9-4f8ddaf9023c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:53.560300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bd945-8912-4b66-9c16-8346a922d465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:53.561589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bd945-8912-4b66-9c16-8346a922d465 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:53.562073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bd945-8912-4b66-9c16-8346a922d465 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:53.562559 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bd945-8912-4b66-9c16-8346a922d465 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:53.575014 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bd945-8912-4b66-9c16-8346a922d465 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:53.583823 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-455bd945-8912-4b66-9c16-8346a922d465 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:53.583823 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:53.583823 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:53.583823 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:53.583823 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:53.583823 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:53.583823 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:53.583823 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:53.583823 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:53.583823 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:53.583823 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:53.583823 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:53.583823 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:53.583823 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:53.583823 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:53.583823 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:53.584743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:53.584743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:53.584743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:53.584743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:53.584743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:53.584743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:53.584743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:53.584743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:53.584743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:53.584743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:53.584743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:53.584743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:53.584743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:53.584743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:53.584743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:53.584743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:53.585959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:53.585959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:53.585959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:53.585959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:53.585959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:53.585959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:53.585959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:53.585959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:53.585959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:53.585959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:53.585959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:53.585959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:53.588345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 189/381] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:53.594293 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bd945-8912-4b66-9c16-8346a922d465 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:53.618266 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:53.620248 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:53.691733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc70375-b0d5-4c37-85b9-4f8ddaf9023c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:53.709665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bd945-8912-4b66-9c16-8346a922d465 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:53.745800 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9d517-f13c-4aa5-842e-e3dc9f54b170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:53.746666 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9d517-f13c-4aa5-842e-e3dc9f54b170 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:53.746956 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9d517-f13c-4aa5-842e-e3dc9f54b170 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:53.747237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9d517-f13c-4aa5-842e-e3dc9f54b170 None admin] PATH_INFO: `/v3/groups/27ecaff3aec14b62906b1e9d0d79fb88` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:53.748274 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29089b9-e507-4983-951a-0668aa363002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:53.749181 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29089b9-e507-4983-951a-0668aa363002 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:53.749703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29089b9-e507-4983-951a-0668aa363002 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:53.750175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29089b9-e507-4983-951a-0668aa363002 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:53.751222 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29089b9-e507-4983-951a-0668aa363002 None admin] RBAC: Adding query filter params (name=member) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:53.751727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29089b9-e507-4983-951a-0668aa363002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:53.755226 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29089b9-e507-4983-951a-0668aa363002 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:53.764188 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9d517-f13c-4aa5-842e-e3dc9f54b170 None admin] RBAC: Authorizing `identity:get_group(group_id=27ecaff3aec14b62906b1e9d0d79fb88)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:53.765091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9d517-f13c-4aa5-842e-e3dc9f54b170 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:53.765989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 190/382] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:53.770021 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 193/383] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jun 14 19:28:53 2022] GET /identity/v3/groups/27ecaff3aec14b62906b1e9d0d79fb88 => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:53.772590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29089b9-e507-4983-951a-0668aa363002 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:53.774114 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9d517-f13c-4aa5-842e-e3dc9f54b170 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:53.868927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:53.891667 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9d517-f13c-4aa5-842e-e3dc9f54b170 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:53.900517 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29089b9-e507-4983-951a-0668aa363002 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:53.918570 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:53.936406 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aacddb5-a03a-45db-a4f7-1210ed9f66ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:53.938166 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacddb5-a03a-45db-a4f7-1210ed9f66ec None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:53.938455 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacddb5-a03a-45db-a4f7-1210ed9f66ec None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:53.938736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aacddb5-a03a-45db-a4f7-1210ed9f66ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:53.939964 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aacddb5-a03a-45db-a4f7-1210ed9f66ec None admin] RBAC: Adding query filter params (group.id=27ecaff3aec14b62906b1e9d0d79fb88, role.id=1e2bb0d759694428ada2b52285de933b, scope.project.id=782dbf52581f4a55b95487f939e373c1) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:53.940164 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aacddb5-a03a-45db-a4f7-1210ed9f66ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:53.941765 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aacddb5-a03a-45db-a4f7-1210ed9f66ec None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:53.957520 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 194/384] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jun 14 19:28:53 2022] GET /identity/v3/role_assignments?group.id=27ecaff3aec14b62906b1e9d0d79fb88&scope.project.id=782dbf52581f4a55b95487f939e373c1&role.id=1e2bb0d759694428ada2b52285de933b => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:53.965604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065972e-63f5-4d69-9915-c42d0c5ba1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:53.966470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065972e-63f5-4d69-9915-c42d0c5ba1fc None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:53.966754 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065972e-63f5-4d69-9915-c42d0c5ba1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:53.967035 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065972e-63f5-4d69-9915-c42d0c5ba1fc None admin] PATH_INFO: `/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:53.970487 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065972e-63f5-4d69-9915-c42d0c5ba1fc None admin] RBAC: Authorizing `identity:get_group(group_id=d6b2ea7a25da4b58ba439afbbe3a87ab)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:53.971989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065972e-63f5-4d69-9915-c42d0c5ba1fc None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:53.974830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 191/385] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jun 14 19:28:53 2022] GET /identity/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:53.980274 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aacddb5-a03a-45db-a4f7-1210ed9f66ec None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:54.109484 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aacddb5-a03a-45db-a4f7-1210ed9f66ec None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:54.154433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b08c4-4a1f-4080-a942-69575d96b853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:54.155320 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b08c4-4a1f-4080-a942-69575d96b853 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:54.155607 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b08c4-4a1f-4080-a942-69575d96b853 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:54.155890 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b08c4-4a1f-4080-a942-69575d96b853 None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:54.157156 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b08c4-4a1f-4080-a942-69575d96b853 None admin] RBAC: Authorizing `identity:get_project(project_id=2a169bbfc64d4c459ba54854d70678e7)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:54.158699 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b08c4-4a1f-4080-a942-69575d96b853 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:54.161518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 195/386] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:53 2022] GET /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:54.166641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065972e-63f5-4d69-9915-c42d0c5ba1fc None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:54.291475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065972e-63f5-4d69-9915-c42d0c5ba1fc None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:54.335974 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed7262-0fa8-4b02-8bec-6863fdc18f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:54.336880 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed7262-0fa8-4b02-8bec-6863fdc18f5f None admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:54.337165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed7262-0fa8-4b02-8bec-6863fdc18f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:54.337486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed7262-0fa8-4b02-8bec-6863fdc18f5f None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7/groups/d6b2ea7a25da4b58ba439afbbe3a87ab/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:54.342805 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed7262-0fa8-4b02-8bec-6863fdc18f5f None admin] RBAC: Authorizing `identity:create_grant(project_id=2a169bbfc64d4c459ba54854d70678e7, group_id=d6b2ea7a25da4b58ba439afbbe3a87ab, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:54.344277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed7262-0fa8-4b02-8bec-6863fdc18f5f None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:54.362857 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 192/387] 10.222.0.44 () {58 vars in 1442 bytes} [Tue Jun 14 19:28:54 2022] PUT /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7/groups/d6b2ea7a25da4b58ba439afbbe3a87ab/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:28:54.562045 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ac1bd-39ac-4834-b6a3-d35989cedf86 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:54.562408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ac1bd-39ac-4834-b6a3-d35989cedf86 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:54.562618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ac1bd-39ac-4834-b6a3-d35989cedf86 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:54.564014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 196/388] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:54.571368 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d8ec9-906a-46cd-a604-dc3cdf85e178 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:54.571659 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d8ec9-906a-46cd-a604-dc3cdf85e178 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:54.571941 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d8ec9-906a-46cd-a604-dc3cdf85e178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:54.594451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-e32d8ec9-906a-46cd-a604-dc3cdf85e178 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:54.595674 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e32d8ec9-906a-46cd-a604-dc3cdf85e178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:54.598679 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:54.683276 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 193/389] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:54.706901 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ac1bd-39ac-4834-b6a3-d35989cedf86 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:54.771088 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:54.835053 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ac1bd-39ac-4834-b6a3-d35989cedf86 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:54.881087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310c361-5496-4a09-83a0-570e8f96c875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:54.881940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310c361-5496-4a09-83a0-570e8f96c875 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:54.882229 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310c361-5496-4a09-83a0-570e8f96c875 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:54.882513 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310c361-5496-4a09-83a0-570e8f96c875 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:54.899309 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a310c361-5496-4a09-83a0-570e8f96c875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:54.911586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-a310c361-5496-4a09-83a0-570e8f96c875 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:54.911586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:54.911586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:54.911586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:54.911586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:54.911586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:54.911586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:54.911586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:54.911586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:54.911586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:54.911586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:54.911586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:54.911586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:54.911586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:54.911586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:54.911586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:54.912472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:54.912472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:54.912472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:54.912472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:54.912472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:54.912472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:54.912472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:54.912472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:54.912472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:54.912472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:54.912472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:54.912472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:54.912472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:54.912472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:54.912472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:54.912472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:54.913242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:54.913242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:54.913242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:54.913242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:54.913242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:54.913242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:54.913242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:54.913242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:54.913242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:54.913242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:54.913242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:54.913242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:54.913242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 197/390] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:28:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:54.919336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d8ec9-906a-46cd-a604-dc3cdf85e178 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:55.073729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d8ec9-906a-46cd-a604-dc3cdf85e178 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:55.113834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2727e-b6b1-4825-aca5-6fe6ac3bc7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:55.114542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2727e-b6b1-4825-aca5-6fe6ac3bc7fb None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:55.114827 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2727e-b6b1-4825-aca5-6fe6ac3bc7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:55.115108 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2727e-b6b1-4825-aca5-6fe6ac3bc7fb None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:55.115896 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2727e-b6b1-4825-aca5-6fe6ac3bc7fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:55.116210 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2727e-b6b1-4825-aca5-6fe6ac3bc7fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:55.117776 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2727e-b6b1-4825-aca5-6fe6ac3bc7fb None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:55.123899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:55.132786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 194/391] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:28:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:55.138666 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310c361-5496-4a09-83a0-570e8f96c875 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:55.273849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310c361-5496-4a09-83a0-570e8f96c875 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:55.289069 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:55.319385 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9316019-343b-4707-8722-dd521408bc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:55.320242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9316019-343b-4707-8722-dd521408bc57 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:55.320527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9316019-343b-4707-8722-dd521408bc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:55.320803 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9316019-343b-4707-8722-dd521408bc57 None admin] PATH_INFO: `/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:55.323230 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9316019-343b-4707-8722-dd521408bc57 None admin] RBAC: Authorizing `identity:get_group(group_id=d6b2ea7a25da4b58ba439afbbe3a87ab)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:55.324802 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9316019-343b-4707-8722-dd521408bc57 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:55.326723 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 198/392] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jun 14 19:28:55 2022] GET /identity/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:55.332872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2727e-b6b1-4825-aca5-6fe6ac3bc7fb None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:55.446082 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2727e-b6b1-4825-aca5-6fe6ac3bc7fb None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:55.486988 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643b9b8-ebaf-4658-9492-da6f3ccdf032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:55.487868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643b9b8-ebaf-4658-9492-da6f3ccdf032 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:55.488712 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643b9b8-ebaf-4658-9492-da6f3ccdf032 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:55.489177 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643b9b8-ebaf-4658-9492-da6f3ccdf032 None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:55.490423 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643b9b8-ebaf-4658-9492-da6f3ccdf032 None admin] RBAC: Authorizing `identity:get_project(project_id=2a169bbfc64d4c459ba54854d70678e7)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:55.491870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643b9b8-ebaf-4658-9492-da6f3ccdf032 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:55.493980 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 195/393] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:55 2022] GET /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:55.499540 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9316019-343b-4707-8722-dd521408bc57 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:55.622964 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9316019-343b-4707-8722-dd521408bc57 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:55.665606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0e347-9690-4d2a-8f8c-a13dc6f8a24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:55.666956 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0e347-9690-4d2a-8f8c-a13dc6f8a24d None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:55.667242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0e347-9690-4d2a-8f8c-a13dc6f8a24d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:55.667518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0e347-9690-4d2a-8f8c-a13dc6f8a24d None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7/groups/d6b2ea7a25da4b58ba439afbbe3a87ab/roles/1302d95e46b4422d84f581f8838d5aac` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:55.675687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0e347-9690-4d2a-8f8c-a13dc6f8a24d None admin] RBAC: Authorizing `identity:create_grant(project_id=2a169bbfc64d4c459ba54854d70678e7, group_id=d6b2ea7a25da4b58ba439afbbe3a87ab, role_id=1302d95e46b4422d84f581f8838d5aac)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:55.677205 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0e347-9690-4d2a-8f8c-a13dc6f8a24d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:55.702171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 199/394] 10.222.0.44 () {58 vars in 1442 bytes} [Tue Jun 14 19:28:55 2022] PUT /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7/groups/d6b2ea7a25da4b58ba439afbbe3a87ab/roles/1302d95e46b4422d84f581f8838d5aac => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:28:55.742441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbba0a-b0c5-44a2-a669-cb8f1bc55002 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:55.742745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbba0a-b0c5-44a2-a669-cb8f1bc55002 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:55.743062 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbba0a-b0c5-44a2-a669-cb8f1bc55002 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:55.744799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 196/395] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:55.750115 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462fa0b-b2d9-4633-a097-288c08046f9c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:55.751051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462fa0b-b2d9-4633-a097-288c08046f9c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:55.751535 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3462fa0b-b2d9-4633-a097-288c08046f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:55.774094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-3462fa0b-b2d9-4633-a097-288c08046f9c None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:55.775695 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3462fa0b-b2d9-4633-a097-288c08046f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:55.822280 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:55.874301 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 200/396] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:55.909453 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbba0a-b0c5-44a2-a669-cb8f1bc55002 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:55.991677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:56.029796 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbba0a-b0c5-44a2-a669-cb8f1bc55002 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:56.067316 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d58bd4-096a-43b2-b02b-2c628afaa852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:56.068150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d58bd4-096a-43b2-b02b-2c628afaa852 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:56.068487 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d58bd4-096a-43b2-b02b-2c628afaa852 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:56.068774 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d58bd4-096a-43b2-b02b-2c628afaa852 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:56.079914 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d58bd4-096a-43b2-b02b-2c628afaa852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:56.088446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-b4d58bd4-096a-43b2-b02b-2c628afaa852 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:56.088446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:56.088446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:56.088446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:56.088446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:56.088446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:56.088446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:56.088446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:56.088446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:56.088446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:56.088446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:56.088446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:56.088446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:56.088446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:56.088446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:56.088446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:56.089304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:56.089304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:56.089304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:56.089304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:56.089304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:56.089304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:56.089304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:56.089304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:56.089304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:56.089304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:56.089304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:56.089304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:56.089304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:56.089304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:56.089304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:56.089304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:56.090230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:56.090230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:56.090230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:56.090230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:56.090230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:56.090230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:56.090230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:56.090230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:56.090230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:56.090230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:56.090230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:56.090230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:56.090230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 197/397] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:28:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:56.099245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462fa0b-b2d9-4633-a097-288c08046f9c None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:56.226024 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3462fa0b-b2d9-4633-a097-288c08046f9c None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:56.265444 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685d37f-17ff-4da8-9bdc-530f38ad49b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:56.266121 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685d37f-17ff-4da8-9bdc-530f38ad49b2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:56.266405 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685d37f-17ff-4da8-9bdc-530f38ad49b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:56.266691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685d37f-17ff-4da8-9bdc-530f38ad49b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:56.267443 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685d37f-17ff-4da8-9bdc-530f38ad49b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:56.267750 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685d37f-17ff-4da8-9bdc-530f38ad49b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:56.269680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685d37f-17ff-4da8-9bdc-530f38ad49b2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:56.280267 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 201/398] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:28:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:56.286143 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d58bd4-096a-43b2-b02b-2c628afaa852 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:56.401014 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d58bd4-096a-43b2-b02b-2c628afaa852 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:56.429572 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:56.437806 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52148d04-fef2-473b-8f3f-f28dae7fdf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:56.438669 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52148d04-fef2-473b-8f3f-f28dae7fdf7a None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:56.438954 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52148d04-fef2-473b-8f3f-f28dae7fdf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:56.439236 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52148d04-fef2-473b-8f3f-f28dae7fdf7a None admin] PATH_INFO: `/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:56.440422 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52148d04-fef2-473b-8f3f-f28dae7fdf7a None admin] RBAC: Authorizing `identity:get_group(group_id=d6b2ea7a25da4b58ba439afbbe3a87ab)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:56.442500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52148d04-fef2-473b-8f3f-f28dae7fdf7a None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:56.444436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 198/399] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jun 14 19:28:56 2022] GET /identity/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:56.450009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685d37f-17ff-4da8-9bdc-530f38ad49b2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:56.482551 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:56.558128 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685d37f-17ff-4da8-9bdc-530f38ad49b2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:56.603538 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cb888-9a16-4a3a-bd3c-dbb6e3ab4762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:56.604430 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb888-9a16-4a3a-bd3c-dbb6e3ab4762 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:56.604716 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb888-9a16-4a3a-bd3c-dbb6e3ab4762 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:56.604991 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cb888-9a16-4a3a-bd3c-dbb6e3ab4762 None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:56.610349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cb888-9a16-4a3a-bd3c-dbb6e3ab4762 None admin] RBAC: Authorizing `identity:get_project(project_id=e743a4a482c24a1f88389b1830c2386e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:56.611851 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cb888-9a16-4a3a-bd3c-dbb6e3ab4762 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:56.614291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 202/400] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:56 2022] GET /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:56.620440 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52148d04-fef2-473b-8f3f-f28dae7fdf7a None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:56.679704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f8569-e195-4f06-890c-8c870a9fefd3 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:56.680040 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f8569-e195-4f06-890c-8c870a9fefd3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:56.680572 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f8569-e195-4f06-890c-8c870a9fefd3 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:56.682143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 203/401] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:56.695326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b43542-f9d2-44fb-bd5d-c5f67114bd8c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:56.695624 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b43542-f9d2-44fb-bd5d-c5f67114bd8c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:56.695893 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b43542-f9d2-44fb-bd5d-c5f67114bd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:56.734101 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a6b43542-f9d2-44fb-bd5d-c5f67114bd8c None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:56.735311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a6b43542-f9d2-44fb-bd5d-c5f67114bd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:56.799760 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52148d04-fef2-473b-8f3f-f28dae7fdf7a None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:56.839830 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 204/402] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:56.842365 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e536657-681e-47d7-b40c-582313735dd8 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:56.843122 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e536657-681e-47d7-b40c-582313735dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:56.843600 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e536657-681e-47d7-b40c-582313735dd8 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:56.845962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 205/403] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:56.851768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf205c-7041-4955-bbe4-85f542521117 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:56.852349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf205c-7041-4955-bbe4-85f542521117 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:56.852631 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf205c-7041-4955-bbe4-85f542521117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:56.861920 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed590392-7528-4bbf-a219-31962be3349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:56.862812 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed590392-7528-4bbf-a219-31962be3349c None admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:56.863151 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed590392-7528-4bbf-a219-31962be3349c None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:56.863492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed590392-7528-4bbf-a219-31962be3349c None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e/groups/d6b2ea7a25da4b58ba439afbbe3a87ab/roles/1302d95e46b4422d84f581f8838d5aac` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:56.870095 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed590392-7528-4bbf-a219-31962be3349c None admin] RBAC: Authorizing `identity:create_grant(project_id=e743a4a482c24a1f88389b1830c2386e, group_id=d6b2ea7a25da4b58ba439afbbe3a87ab, role_id=1302d95e46b4422d84f581f8838d5aac)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:56.871666 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed590392-7528-4bbf-a219-31962be3349c None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:56.882876 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a6cf205c-7041-4955-bbe4-85f542521117 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:56.885725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a6cf205c-7041-4955-bbe4-85f542521117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:56.892901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 199/404] 10.222.0.44 () {58 vars in 1442 bytes} [Tue Jun 14 19:28:56 2022] PUT /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e/groups/d6b2ea7a25da4b58ba439afbbe3a87ab/roles/1302d95e46b4422d84f581f8838d5aac => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:28:56.896397 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed590392-7528-4bbf-a219-31962be3349c None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:56.936804 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:57.022288 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 206/405] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:57.023372 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:57.079940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf205c-7041-4955-bbe4-85f542521117 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:57.100942 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed590392-7528-4bbf-a219-31962be3349c None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:57.151916 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfcea6-7e7a-4e44-953b-40868615efb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:57.153103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfcea6-7e7a-4e44-953b-40868615efb7 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:57.153733 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfcea6-7e7a-4e44-953b-40868615efb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:57.154263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfcea6-7e7a-4e44-953b-40868615efb7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:57.166957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfcea6-7e7a-4e44-953b-40868615efb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:57.175750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-a1bfcea6-7e7a-4e44-953b-40868615efb7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:57.175750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:57.175750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:57.175750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:57.175750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:57.175750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:57.175750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:57.175750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:57.175750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:57.175750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:57.175750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:57.175750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:57.175750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:57.175750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:57.175750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:57.175750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:57.176676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:57.176676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:57.176676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:57.176676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:57.176676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:57.176676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:57.176676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:57.176676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:57.176676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:57.176676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:57.176676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:57.176676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:57.176676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:57.176676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:57.176676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:57.176676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:57.177467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:57.177467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:57.177467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:57.177467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:57.177467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:57.177467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:57.177467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:57.177467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:57.177467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:57.177467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:57.177467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:57.177467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:57.181001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 200/406] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:57.187103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfcea6-7e7a-4e44-953b-40868615efb7 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:57.207387 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf205c-7041-4955-bbe4-85f542521117 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:57.248907 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421846c-6872-4975-9e4d-d2f37ec886c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:57.250006 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421846c-6872-4975-9e4d-d2f37ec886c9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:57.250293 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421846c-6872-4975-9e4d-d2f37ec886c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:57.250569 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6421846c-6872-4975-9e4d-d2f37ec886c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:57.263645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6421846c-6872-4975-9e4d-d2f37ec886c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:57.274919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-6421846c-6872-4975-9e4d-d2f37ec886c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:28:57.274919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:57.274919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:57.274919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:57.274919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:57.274919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:57.274919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:57.274919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:57.274919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:57.274919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:57.274919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:57.274919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:57.274919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:57.274919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:57.274919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:57.274919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:57.275811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:57.275811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:57.275811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:57.275811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:57.275811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:57.275811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:57.275811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:57.275811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:57.275811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:57.275811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:57.275811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:57.275811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:57.275811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:57.275811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:57.275811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:57.275811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:57.276571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:57.276571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:57.276571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:57.276571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:57.276571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:57.276571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:57.276571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:57.276571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:57.276571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:57.276571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:57.276571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:28:57.276571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:57.276571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 207/407] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:28:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:57.281616 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421846c-6872-4975-9e4d-d2f37ec886c9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:57.311474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:57.314449 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfcea6-7e7a-4e44-953b-40868615efb7 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:57.347771 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:57.389359 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a681e-0196-418b-897d-13a6272643d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:57.390461 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a681e-0196-418b-897d-13a6272643d8 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:57.390968 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a681e-0196-418b-897d-13a6272643d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:57.391461 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a681e-0196-418b-897d-13a6272643d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:57.392410 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a681e-0196-418b-897d-13a6272643d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:57.392913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a681e-0196-418b-897d-13a6272643d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:57.395148 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a681e-0196-418b-897d-13a6272643d8 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:57.395787 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6421846c-6872-4975-9e4d-d2f37ec886c9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:57.424863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 201/408] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:28:57.432990 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a681e-0196-418b-897d-13a6272643d8 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:57.474577 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4a965-0296-4dc5-b91a-674c96fb1b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:57.475248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4a965-0296-4dc5-b91a-674c96fb1b14 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:57.475528 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4a965-0296-4dc5-b91a-674c96fb1b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:57.475802 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4a965-0296-4dc5-b91a-674c96fb1b14 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:57.476554 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4a965-0296-4dc5-b91a-674c96fb1b14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:57.476859 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4a965-0296-4dc5-b91a-674c96fb1b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:57.478281 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4a965-0296-4dc5-b91a-674c96fb1b14 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:57.494276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 208/409] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:57.495795 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ee6a-d7ec-4dc7-8717-0f03b44d8599 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:57.496087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ee6a-d7ec-4dc7-8717-0f03b44d8599 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:57.496371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ee6a-d7ec-4dc7-8717-0f03b44d8599 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:57.502074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 209/410] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:57.503031 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177ee6a-d7ec-4dc7-8717-0f03b44d8599 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:57.578204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a681e-0196-418b-897d-13a6272643d8 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:57.593190 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:57.615007 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177ee6a-d7ec-4dc7-8717-0f03b44d8599 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:57.617964 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df865005-8900-473a-ab43-4adb9f20eb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:57.618827 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df865005-8900-473a-ab43-4adb9f20eb7d None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:57.619110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df865005-8900-473a-ab43-4adb9f20eb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:57.619388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df865005-8900-473a-ab43-4adb9f20eb7d None admin] PATH_INFO: `/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:57.620575 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df865005-8900-473a-ab43-4adb9f20eb7d None admin] RBAC: Authorizing `identity:get_group(group_id=d6b2ea7a25da4b58ba439afbbe3a87ab)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:57.622110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df865005-8900-473a-ab43-4adb9f20eb7d None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:57.623899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 202/411] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jun 14 19:28:57 2022] GET /identity/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:57.625040 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dd5a8-d448-40cd-867a-a270777d53cf None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:57.625406 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dd5a8-d448-40cd-867a-a270777d53cf None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:57.625682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dd5a8-d448-40cd-867a-a270777d53cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:57.645651 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-7d3dd5a8-d448-40cd-867a-a270777d53cf None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:57.647555 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7d3dd5a8-d448-40cd-867a-a270777d53cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:57.664018 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69af510-3f4a-41c0-bd37-39ef9d4c3767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:57.665093 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69af510-3f4a-41c0-bd37-39ef9d4c3767 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:57.665465 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69af510-3f4a-41c0-bd37-39ef9d4c3767 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:57.666004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69af510-3f4a-41c0-bd37-39ef9d4c3767 None admin] PATH_INFO: `/v3/groups/27ecaff3aec14b62906b1e9d0d79fb88` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:57.667907 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69af510-3f4a-41c0-bd37-39ef9d4c3767 None admin] RBAC: Authorizing `identity:get_group(group_id=27ecaff3aec14b62906b1e9d0d79fb88)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:57.669926 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69af510-3f4a-41c0-bd37-39ef9d4c3767 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:57.671557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 210/412] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jun 14 19:28:57 2022] GET /identity/v3/groups/27ecaff3aec14b62906b1e9d0d79fb88 => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:57.672360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69af510-3f4a-41c0-bd37-39ef9d4c3767 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:57.740086 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:57.741948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 203/413] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:57.743578 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dd5a8-d448-40cd-867a-a270777d53cf None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:57.804143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69af510-3f4a-41c0-bd37-39ef9d4c3767 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:57.850082 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36daad-0ef1-4ee0-91fc-2bbe9b80c652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:57.851681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36daad-0ef1-4ee0-91fc-2bbe9b80c652 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:57.852192 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36daad-0ef1-4ee0-91fc-2bbe9b80c652 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:57.852667 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36daad-0ef1-4ee0-91fc-2bbe9b80c652 None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:57.854086 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36daad-0ef1-4ee0-91fc-2bbe9b80c652 None admin] RBAC: Authorizing `identity:get_project(project_id=e743a4a482c24a1f88389b1830c2386e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:57.855834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36daad-0ef1-4ee0-91fc-2bbe9b80c652 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:57.861536 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 211/414] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:57 2022] GET /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:57.862704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36daad-0ef1-4ee0-91fc-2bbe9b80c652 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:57.870792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dd5a8-d448-40cd-867a-a270777d53cf None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:57.887744 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:57.913001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699f59f-26e7-4727-985c-ad42eaffe309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:57.914332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699f59f-26e7-4727-985c-ad42eaffe309 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:57.914836 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699f59f-26e7-4727-985c-ad42eaffe309 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:57.915356 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699f59f-26e7-4727-985c-ad42eaffe309 None admin] PATH_INFO: `/v3/projects/782dbf52581f4a55b95487f939e373c1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:57.917623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699f59f-26e7-4727-985c-ad42eaffe309 None admin] RBAC: Authorizing `identity:get_project(project_id=782dbf52581f4a55b95487f939e373c1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:57.919842 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699f59f-26e7-4727-985c-ad42eaffe309 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:57.922973 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 204/415] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:57 2022] GET /identity/v3/projects/782dbf52581f4a55b95487f939e373c1 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:57.924288 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699f59f-26e7-4727-985c-ad42eaffe309 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:57.987201 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:58.005170 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36daad-0ef1-4ee0-91fc-2bbe9b80c652 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:58.051775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46914a2-4527-4aa3-9170-ddd7cc1e2b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:58.052980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46914a2-4527-4aa3-9170-ddd7cc1e2b11 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:58.053338 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46914a2-4527-4aa3-9170-ddd7cc1e2b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:58.054166 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46914a2-4527-4aa3-9170-ddd7cc1e2b11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:58.062343 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699f59f-26e7-4727-985c-ad42eaffe309 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:58.072275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46914a2-4527-4aa3-9170-ddd7cc1e2b11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:58.083541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-c46914a2-4527-4aa3-9170-ddd7cc1e2b11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:58.083541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:58.083541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:58.083541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:58.083541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:58.083541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:58.083541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:58.083541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:58.083541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:58.083541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:58.083541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:58.083541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:58.083541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:58.083541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:58.083541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:58.083541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:58.084447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:58.084447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:58.084447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:58.084447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:58.084447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:58.084447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:58.084447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:58.084447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:58.084447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:58.084447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:58.084447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:58.084447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:58.084447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:58.084447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:58.084447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:58.084447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:58.090070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:58.090070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:58.090070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:58.090070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:58.090070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:58.090070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:58.090070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:58.090070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:58.090070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:58.090070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:58.090070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:28:58.090070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:28:58.090070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 212/416] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:28:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:58.090070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46914a2-4527-4aa3-9170-ddd7cc1e2b11 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:58.108472 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b339b-599c-4157-b3e2-6afaa863bab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:58.109836 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b339b-599c-4157-b3e2-6afaa863bab8 None admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:58.110310 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b339b-599c-4157-b3e2-6afaa863bab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:58.110805 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1b339b-599c-4157-b3e2-6afaa863bab8 None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e/groups/d6b2ea7a25da4b58ba439afbbe3a87ab/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:58.113707 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b339b-599c-4157-b3e2-6afaa863bab8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e743a4a482c24a1f88389b1830c2386e, group_id=d6b2ea7a25da4b58ba439afbbe3a87ab, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:58.115461 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1b339b-599c-4157-b3e2-6afaa863bab8 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:58.137642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 205/417] 10.222.0.44 () {58 vars in 1442 bytes} [Tue Jun 14 19:28:57 2022] PUT /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e/groups/d6b2ea7a25da4b58ba439afbbe3a87ab/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:28:58.138905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b339b-599c-4157-b3e2-6afaa863bab8 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:58.178252 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:58.206282 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46914a2-4527-4aa3-9170-ddd7cc1e2b11 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:58.249565 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1780c3-6002-4466-a6ab-0d52aeb174a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:58.249565 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1780c3-6002-4466-a6ab-0d52aeb174a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:58.249565 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1780c3-6002-4466-a6ab-0d52aeb174a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:58.249565 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1780c3-6002-4466-a6ab-0d52aeb174a5 None admin] PATH_INFO: `/v3/projects/782dbf52581f4a55b95487f939e373c1/groups/27ecaff3aec14b62906b1e9d0d79fb88/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:58.249981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1780c3-6002-4466-a6ab-0d52aeb174a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=782dbf52581f4a55b95487f939e373c1, group_id=27ecaff3aec14b62906b1e9d0d79fb88, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:58.249981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1780c3-6002-4466-a6ab-0d52aeb174a5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:58.273700 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 213/418] 10.222.0.44 () {58 vars in 1442 bytes} [Tue Jun 14 19:28:58 2022] PUT /identity/v3/projects/782dbf52581f4a55b95487f939e373c1/groups/27ecaff3aec14b62906b1e9d0d79fb88/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:28:58.326374 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1b339b-599c-4157-b3e2-6afaa863bab8 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:58.328961 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:58.378145 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5a9db-36ec-47ed-a1d9-954b78f41693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:58.378785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5a9db-36ec-47ed-a1d9-954b78f41693 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:58.379072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5a9db-36ec-47ed-a1d9-954b78f41693 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:58.379349 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5a9db-36ec-47ed-a1d9-954b78f41693 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:58.380310 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5a9db-36ec-47ed-a1d9-954b78f41693 None admin] RBAC: Adding query filter params (name=member) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:58.380619 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5a9db-36ec-47ed-a1d9-954b78f41693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:58.382134 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b5a9db-36ec-47ed-a1d9-954b78f41693 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:58.392171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 206/419] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:28:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:58.399777 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1780c3-6002-4466-a6ab-0d52aeb174a5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:58.526310 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1780c3-6002-4466-a6ab-0d52aeb174a5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:58.566025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e35a39-6f08-4074-88df-49c1fbe69332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:58.567560 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e35a39-6f08-4074-88df-49c1fbe69332 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:58.568131 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e35a39-6f08-4074-88df-49c1fbe69332 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:58.568621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e35a39-6f08-4074-88df-49c1fbe69332 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:58.569924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b4d9b-ebce-4360-ac20-684ae5a9166c None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:58.570188 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b4d9b-ebce-4360-ac20-684ae5a9166c None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:58.570466 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b4d9b-ebce-4360-ac20-684ae5a9166c None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:58.575565 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 207/420] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:58.577637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda5e16-309f-4f0b-8e63-3eb9998c26bf None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:58.577927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda5e16-309f-4f0b-8e63-3eb9998c26bf None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:58.578203 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda5e16-309f-4f0b-8e63-3eb9998c26bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:58.578348 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:58.606262 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-feda5e16-309f-4f0b-8e63-3eb9998c26bf None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:58.607496 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-feda5e16-309f-4f0b-8e63-3eb9998c26bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:58.648355 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e35a39-6f08-4074-88df-49c1fbe69332 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:58.649888 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e35a39-6f08-4074-88df-49c1fbe69332 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:58.724383 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 208/421] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:58.750385 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda5e16-309f-4f0b-8e63-3eb9998c26bf None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:58.856150 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 214/422] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:28:58.861175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:58.866322 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e35a39-6f08-4074-88df-49c1fbe69332 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:58.869291 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda5e16-309f-4f0b-8e63-3eb9998c26bf None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:58.906721 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e668c2-668c-4730-97ca-0a1ff390d322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:58.907473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e668c2-668c-4730-97ca-0a1ff390d322 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:58.907758 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e668c2-668c-4730-97ca-0a1ff390d322 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:58.908038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e668c2-668c-4730-97ca-0a1ff390d322 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:58.920578 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e668c2-668c-4730-97ca-0a1ff390d322 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:28:58.929560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-68e668c2-668c-4730-97ca-0a1ff390d322 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:58.929560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:28:58.929560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:28:58.929560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:28:58.929560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:28:58.929560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:28:58.929560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:28:58.929560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:28:58.929560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:28:58.929560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:28:58.929560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:28:58.929560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:28:58.929560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:28:58.929560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:28:58.929560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:28:58.929560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:28:58.930479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:28:58.930479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:28:58.930479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:28:58.930479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:28:58.930479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:28:58.930479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:28:58.930479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:28:58.930479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:28:58.930479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:28:58.930479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:28:58.930479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:28:58.930479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:28:58.930479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:28:58.930479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:28:58.930479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:28:58.930479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:28:58.931258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:28:58.931258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:28:58.931258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:28:58.931258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:28:58.931258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:28:58.931258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:28:58.931258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:28:58.931258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:28:58.931258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:28:58.931258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:28:58.931258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:28:58.931258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:28:58.935809 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 209/423] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:28:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:28:58.937041 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e668c2-668c-4730-97ca-0a1ff390d322 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:58.951566 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:59.054189 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e35a39-6f08-4074-88df-49c1fbe69332 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:59.075237 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e668c2-668c-4730-97ca-0a1ff390d322 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:59.097413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91a155-0ac3-411e-99ba-912ef0a001d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:59.097413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91a155-0ac3-411e-99ba-912ef0a001d3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:59.097413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91a155-0ac3-411e-99ba-912ef0a001d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:59.097413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91a155-0ac3-411e-99ba-912ef0a001d3 None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:59.097847 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91a155-0ac3-411e-99ba-912ef0a001d3 None admin] RBAC: Authorizing `identity:get_project(project_id=2a169bbfc64d4c459ba54854d70678e7)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:59.097847 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91a155-0ac3-411e-99ba-912ef0a001d3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:59.097847 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 215/424] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:58 2022] GET /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:59.101051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91a155-0ac3-411e-99ba-912ef0a001d3 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:59.150101 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe639c98-7adf-4a16-b14f-c65c44ca7a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:59.150771 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe639c98-7adf-4a16-b14f-c65c44ca7a70 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:59.151056 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe639c98-7adf-4a16-b14f-c65c44ca7a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:59.151329 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe639c98-7adf-4a16-b14f-c65c44ca7a70 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:59.152074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe639c98-7adf-4a16-b14f-c65c44ca7a70 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:59.152376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe639c98-7adf-4a16-b14f-c65c44ca7a70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:59.153762 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe639c98-7adf-4a16-b14f-c65c44ca7a70 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:59.178318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 210/425] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:28:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:59.183902 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe639c98-7adf-4a16-b14f-c65c44ca7a70 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:59.209831 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:59.303540 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91a155-0ac3-411e-99ba-912ef0a001d3 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:59.330630 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:59.365984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe639c98-7adf-4a16-b14f-c65c44ca7a70 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:59.376956 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba482aaf-cbaf-4311-89e4-8fa80b2cdbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:59.377870 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba482aaf-cbaf-4311-89e4-8fa80b2cdbde None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:59.380710 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba482aaf-cbaf-4311-89e4-8fa80b2cdbde None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:59.380999 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba482aaf-cbaf-4311-89e4-8fa80b2cdbde None admin] PATH_INFO: `/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:59.382238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba482aaf-cbaf-4311-89e4-8fa80b2cdbde None admin] RBAC: Authorizing `identity:get_group(group_id=d6b2ea7a25da4b58ba439afbbe3a87ab)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:59.383677 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba482aaf-cbaf-4311-89e4-8fa80b2cdbde None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:59.387569 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 216/426] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jun 14 19:28:59 2022] GET /identity/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:59.391024 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba482aaf-cbaf-4311-89e4-8fa80b2cdbde None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:59.447932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5130cc9-4e91-4a57-b2b8-5fcfe67ecbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:59.448515 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5130cc9-4e91-4a57-b2b8-5fcfe67ecbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:59.448799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5130cc9-4e91-4a57-b2b8-5fcfe67ecbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:59.449069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5130cc9-4e91-4a57-b2b8-5fcfe67ecbb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:59.546987 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5130cc9-4e91-4a57-b2b8-5fcfe67ecbb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:59.549061 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5130cc9-4e91-4a57-b2b8-5fcfe67ecbb3 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:59.553344 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba482aaf-cbaf-4311-89e4-8fa80b2cdbde None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:59.598565 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f35749-d613-4324-baf6-cb4befcc5e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:59.599559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f35749-d613-4324-baf6-cb4befcc5e1c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:59.600108 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f35749-d613-4324-baf6-cb4befcc5e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:59.600578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f35749-d613-4324-baf6-cb4befcc5e1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:59.602130 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f35749-d613-4324-baf6-cb4befcc5e1c None admin] RBAC: Adding query filter params (group.id=d6b2ea7a25da4b58ba439afbbe3a87ab, role.id=bf1733d36314409c80cd50b2268834b1, scope.project.id=2a169bbfc64d4c459ba54854d70678e7) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:28:59.602721 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f35749-d613-4324-baf6-cb4befcc5e1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:59.604800 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f35749-d613-4324-baf6-cb4befcc5e1c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:59.609756 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:59.614554 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 217/427] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jun 14 19:28:59 2022] GET /identity/v3/role_assignments?group.id=d6b2ea7a25da4b58ba439afbbe3a87ab&scope.project.id=2a169bbfc64d4c459ba54854d70678e7&role.id=bf1733d36314409c80cd50b2268834b1 => generated 611 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:59.616623 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91ff9b-a808-4882-aec0-daf5da82e8e4 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:59.617366 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91ff9b-a808-4882-aec0-daf5da82e8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:59.617849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91ff9b-a808-4882-aec0-daf5da82e8e4 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:59.620808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 218/428] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:28:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:28:59.631738 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf2bf4-9386-44ff-ac94-526029b6421b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:59.632368 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf2bf4-9386-44ff-ac94-526029b6421b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:59.632869 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf2bf4-9386-44ff-ac94-526029b6421b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:59.653331 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a9cf2bf4-9386-44ff-ac94-526029b6421b None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:28:59.655496 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a9cf2bf4-9386-44ff-ac94-526029b6421b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:28:59.703198 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:59.709143 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 211/429] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:28:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 14 19:28:59.715529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5130cc9-4e91-4a57-b2b8-5fcfe67ecbb3 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:59.763519 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 219/430] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:28:59.800937 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf2bf4-9386-44ff-ac94-526029b6421b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:59.884669 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5130cc9-4e91-4a57-b2b8-5fcfe67ecbb3 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:59.908728 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:28:59.934127 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a844233-2bc1-43ae-b34f-316b28587eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:59.935226 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a844233-2bc1-43ae-b34f-316b28587eeb None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:59.935680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a844233-2bc1-43ae-b34f-316b28587eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:59.936084 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a844233-2bc1-43ae-b34f-316b28587eeb None admin] PATH_INFO: `/v3/projects/2a169bbfc64d4c459ba54854d70678e7` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:28:59.937461 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a844233-2bc1-43ae-b34f-316b28587eeb None admin] RBAC: Authorizing `identity:get_project(project_id=2a169bbfc64d4c459ba54854d70678e7)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:28:59.939045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a844233-2bc1-43ae-b34f-316b28587eeb None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:28:59.941401 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 212/431] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:28:59 2022] GET /identity/v3/projects/2a169bbfc64d4c459ba54854d70678e7 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:28:59.943683 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf2bf4-9386-44ff-ac94-526029b6421b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:28:59.947374 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a844233-2bc1-43ae-b34f-316b28587eeb None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:28:59.997089 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cacdf-5e60-4d64-ba5b-602a188e0f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:28:59.998285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cacdf-5e60-4d64-ba5b-602a188e0f19 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:28:59.998779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cacdf-5e60-4d64-ba5b-602a188e0f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:28:59.999257 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cacdf-5e60-4d64-ba5b-602a188e0f19 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:00.016080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cacdf-5e60-4d64-ba5b-602a188e0f19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:00.028212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-e77cacdf-5e60-4d64-ba5b-602a188e0f19 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:29:00.028212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:00.028212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:00.028212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:00.028212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:00.028212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:00.028212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:00.028212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:00.028212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:00.028212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:00.028212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:00.028212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:00.028212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:00.028212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:00.028212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:00.028212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:00.029143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:00.029143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:00.029143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:00.029143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:00.029143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:00.029143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:00.029143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:00.029143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:00.029143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:00.029143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:00.029143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:00.029143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:00.029143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:00.029143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:00.029143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:00.029143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:00.029989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:00.029989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:00.029989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:00.029989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:00.029989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:00.029989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:00.029989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:00.029989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:00.029989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:00.029989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:00.029989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:29:00.029989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:00.029989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 220/432] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:28:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:00.035404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cacdf-5e60-4d64-ba5b-602a188e0f19 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:00.070495 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:00.105454 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a844233-2bc1-43ae-b34f-316b28587eeb None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:00.161037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da124e8a-0f06-4276-a7a5-cae9403fbb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:00.162366 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da124e8a-0f06-4276-a7a5-cae9403fbb41 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:00.162655 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da124e8a-0f06-4276-a7a5-cae9403fbb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:00.162937 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da124e8a-0f06-4276-a7a5-cae9403fbb41 None admin] PATH_INFO: `/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:00.164147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da124e8a-0f06-4276-a7a5-cae9403fbb41 None admin] RBAC: Authorizing `identity:get_group(group_id=d6b2ea7a25da4b58ba439afbbe3a87ab)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:00.168774 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da124e8a-0f06-4276-a7a5-cae9403fbb41 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:00.171029 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 213/433] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jun 14 19:28:59 2022] GET /identity/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:00.178393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da124e8a-0f06-4276-a7a5-cae9403fbb41 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:00.183531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cacdf-5e60-4d64-ba5b-602a188e0f19 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:00.227729 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9d581-6a1e-41be-8531-93a3851c6155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:00.228414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9d581-6a1e-41be-8531-93a3851c6155 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:00.228707 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9d581-6a1e-41be-8531-93a3851c6155 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:00.228987 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9d581-6a1e-41be-8531-93a3851c6155 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:00.229832 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9d581-6a1e-41be-8531-93a3851c6155 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:00.230138 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9d581-6a1e-41be-8531-93a3851c6155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:00.231557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9d581-6a1e-41be-8531-93a3851c6155 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:00.242190 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 221/434] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:00.247882 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9d581-6a1e-41be-8531-93a3851c6155 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:00.248468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:00.305161 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da124e8a-0f06-4276-a7a5-cae9403fbb41 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:00.345180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f08dbb-2534-45b3-bc8f-fd4bc9ed69de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:00.345974 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f08dbb-2534-45b3-bc8f-fd4bc9ed69de None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:00.346260 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f08dbb-2534-45b3-bc8f-fd4bc9ed69de None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:00.346538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f08dbb-2534-45b3-bc8f-fd4bc9ed69de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:00.347973 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f08dbb-2534-45b3-bc8f-fd4bc9ed69de None admin] RBAC: Adding query filter params (group.id=d6b2ea7a25da4b58ba439afbbe3a87ab, role.id=1302d95e46b4422d84f581f8838d5aac, scope.project.id=2a169bbfc64d4c459ba54854d70678e7) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:00.348352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f08dbb-2534-45b3-bc8f-fd4bc9ed69de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:00.349707 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:00.350526 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f08dbb-2534-45b3-bc8f-fd4bc9ed69de None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:00.357977 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 214/435] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jun 14 19:29:00 2022] GET /identity/v3/role_assignments?group.id=d6b2ea7a25da4b58ba439afbbe3a87ab&scope.project.id=2a169bbfc64d4c459ba54854d70678e7&role.id=1302d95e46b4422d84f581f8838d5aac => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:00.362637 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9d581-6a1e-41be-8531-93a3851c6155 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:00.410224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4700ac-482b-4ac1-bd6b-ef966bd18b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:00.411593 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4700ac-482b-4ac1-bd6b-ef966bd18b54 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:00.411883 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4700ac-482b-4ac1-bd6b-ef966bd18b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:00.412170 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4700ac-482b-4ac1-bd6b-ef966bd18b54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:00.493245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4700ac-482b-4ac1-bd6b-ef966bd18b54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:00.494754 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4700ac-482b-4ac1-bd6b-ef966bd18b54 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:00.594797 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:00.610332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 222/436] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:29:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 14 19:29:00.616762 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f08dbb-2534-45b3-bc8f-fd4bc9ed69de None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:00.727149 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f08dbb-2534-45b3-bc8f-fd4bc9ed69de None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:00.747013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:00.770745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d93ad6-26fd-43db-8016-d071ef2794a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:00.772029 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d93ad6-26fd-43db-8016-d071ef2794a3 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:00.772539 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d93ad6-26fd-43db-8016-d071ef2794a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:00.773023 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d93ad6-26fd-43db-8016-d071ef2794a3 None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:00.774649 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d93ad6-26fd-43db-8016-d071ef2794a3 None admin] RBAC: Authorizing `identity:get_project(project_id=e743a4a482c24a1f88389b1830c2386e)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:00.776347 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d93ad6-26fd-43db-8016-d071ef2794a3 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:00.778794 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 215/437] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:29:00 2022] GET /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:00.784688 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4700ac-482b-4ac1-bd6b-ef966bd18b54 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:00.828262 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d49fde-c521-4d0d-a351-336a6ca802c5 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:00.828565 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d49fde-c521-4d0d-a351-336a6ca802c5 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:00.828816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d49fde-c521-4d0d-a351-336a6ca802c5 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:00.830206 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 216/438] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:29:00.835329 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba18511-50a5-4df0-9d13-4c4a19e1d226 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:00.835613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba18511-50a5-4df0-9d13-4c4a19e1d226 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:00.835894 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba18511-50a5-4df0-9d13-4c4a19e1d226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:00.854297 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-6ba18511-50a5-4df0-9d13-4c4a19e1d226 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:00.855272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-6ba18511-50a5-4df0-9d13-4c4a19e1d226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:00.902129 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4700ac-482b-4ac1-bd6b-ef966bd18b54 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:00.937193 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 217/439] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:29:00.939943 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7837bc8-a892-4f06-a00f-3554f9064c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:00.940800 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7837bc8-a892-4f06-a00f-3554f9064c9b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:00.941682 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7837bc8-a892-4f06-a00f-3554f9064c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:00.941959 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7837bc8-a892-4f06-a00f-3554f9064c9b None admin] PATH_INFO: `/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:00.943139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7837bc8-a892-4f06-a00f-3554f9064c9b None admin] RBAC: Authorizing `identity:get_group(group_id=d6b2ea7a25da4b58ba439afbbe3a87ab)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:00.944579 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7837bc8-a892-4f06-a00f-3554f9064c9b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:00.951057 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 223/440] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jun 14 19:29:00 2022] GET /identity/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:00.952047 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba18511-50a5-4df0-9d13-4c4a19e1d226 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:00.961766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7837bc8-a892-4f06-a00f-3554f9064c9b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:01.016724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:01.052023 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba18511-50a5-4df0-9d13-4c4a19e1d226 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:01.060387 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7837bc8-a892-4f06-a00f-3554f9064c9b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:01.068517 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:01.087074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008656d-88d9-4cf0-9ef4-3b2328eddf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:01.087939 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008656d-88d9-4cf0-9ef4-3b2328eddf43 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:01.088223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008656d-88d9-4cf0-9ef4-3b2328eddf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:01.088494 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008656d-88d9-4cf0-9ef4-3b2328eddf43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:01.089317 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008656d-88d9-4cf0-9ef4-3b2328eddf43 None admin] RBAC: Adding query filter params (group.id=d6b2ea7a25da4b58ba439afbbe3a87ab, role.id=1302d95e46b4422d84f581f8838d5aac, scope.project.id=e743a4a482c24a1f88389b1830c2386e) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:01.089657 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008656d-88d9-4cf0-9ef4-3b2328eddf43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:01.091078 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008656d-88d9-4cf0-9ef4-3b2328eddf43 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:01.095177 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96741c71-59c9-4248-8a18-758e21fbbebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:01.095960 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96741c71-59c9-4248-8a18-758e21fbbebd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:01.096243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96741c71-59c9-4248-8a18-758e21fbbebd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:01.096518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96741c71-59c9-4248-8a18-758e21fbbebd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:01.096764 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 218/441] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jun 14 19:29:00 2022] GET /identity/v3/role_assignments?group.id=d6b2ea7a25da4b58ba439afbbe3a87ab&scope.project.id=e743a4a482c24a1f88389b1830c2386e&role.id=1302d95e46b4422d84f581f8838d5aac => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:01.105599 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91c5eb-f197-4324-996e-cf97b7fca651 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:01.105599 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91c5eb-f197-4324-996e-cf97b7fca651 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:01.105599 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91c5eb-f197-4324-996e-cf97b7fca651 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:01.105599 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 219/442] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:01.107768 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8f82d-e2ea-4114-ab07-5b93f602fdf7 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:01.108060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8f82d-e2ea-4114-ab07-5b93f602fdf7 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:01.108344 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8f82d-e2ea-4114-ab07-5b93f602fdf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:01.115873 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96741c71-59c9-4248-8a18-758e21fbbebd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:01.123767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-96741c71-59c9-4248-8a18-758e21fbbebd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:29:01.123767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:01.123767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:01.123767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:01.123767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:01.123767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:01.123767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:01.123767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:01.123767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:01.123767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:01.123767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:01.123767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:01.123767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:01.123767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:01.123767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:01.123767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:01.124719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:01.124719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:01.124719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:01.124719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:01.124719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:01.124719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:01.124719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:01.124719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:01.124719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:01.124719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:01.124719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:01.124719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:01.124719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:01.124719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:01.124719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:01.124719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:01.130360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:01.130360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:01.130360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:01.130360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:01.130360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:01.130360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:01.130360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:01.130360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:01.130360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:01.130360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:01.130360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:29:01.130360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:01.130360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 224/443] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:29:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:01.131008 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-a6e8f82d-e2ea-4114-ab07-5b93f602fdf7 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:01.132049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-a6e8f82d-e2ea-4114-ab07-5b93f602fdf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:01.132298 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96741c71-59c9-4248-8a18-758e21fbbebd None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:01.215970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 220/444] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:29:01.240146 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8f82d-e2ea-4114-ab07-5b93f602fdf7 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:01.251630 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96741c71-59c9-4248-8a18-758e21fbbebd None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:01.270943 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:01.292318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157ec6f-e00b-4f4d-b4a7-c95c57e73721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:01.293277 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157ec6f-e00b-4f4d-b4a7-c95c57e73721 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:01.293602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157ec6f-e00b-4f4d-b4a7-c95c57e73721 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:01.293864 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157ec6f-e00b-4f4d-b4a7-c95c57e73721 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:01.294606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157ec6f-e00b-4f4d-b4a7-c95c57e73721 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:01.294912 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157ec6f-e00b-4f4d-b4a7-c95c57e73721 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:01.296284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157ec6f-e00b-4f4d-b4a7-c95c57e73721 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:01.308773 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 225/445] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:29:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:01.314020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157ec6f-e00b-4f4d-b4a7-c95c57e73721 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:01.353932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8f82d-e2ea-4114-ab07-5b93f602fdf7 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:01.365076 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:01.388520 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31dba5-54d3-4ec3-9608-ec5b3b34206e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:01.389420 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31dba5-54d3-4ec3-9608-ec5b3b34206e None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:01.389710 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31dba5-54d3-4ec3-9608-ec5b3b34206e None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:01.389990 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d31dba5-54d3-4ec3-9608-ec5b3b34206e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:01.400246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d31dba5-54d3-4ec3-9608-ec5b3b34206e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:01.407957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-4d31dba5-54d3-4ec3-9608-ec5b3b34206e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:29:01.407957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:01.407957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:01.407957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:01.407957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:01.407957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:01.407957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:01.407957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:01.407957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:01.407957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:01.407957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:01.407957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:01.407957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:01.407957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:01.407957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:01.407957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:01.408907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:01.408907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:01.408907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:01.408907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:01.408907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:01.408907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:01.408907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:01.408907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:01.408907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:01.408907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:01.408907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:01.408907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:01.408907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:01.408907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:01.408907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:01.408907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:01.410350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:01.410350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:01.410350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:01.410350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:01.410350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:01.410350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:01.410350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:01.410350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:01.410350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:01.410350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:01.410350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 14 19:29:01.410350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:01.410350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 221/446] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:29:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:01.415490 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157ec6f-e00b-4f4d-b4a7-c95c57e73721 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:01.416741 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31dba5-54d3-4ec3-9608-ec5b3b34206e None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:01.451793 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb8a07-09a1-48c6-9784-49ed9655c2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:01.452440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb8a07-09a1-48c6-9784-49ed9655c2ce None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:01.452729 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb8a07-09a1-48c6-9784-49ed9655c2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:01.453011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb8a07-09a1-48c6-9784-49ed9655c2ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:01.498264 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:01.516000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d31dba5-54d3-4ec3-9608-ec5b3b34206e None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:01.520524 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb8a07-09a1-48c6-9784-49ed9655c2ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:01.522048 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb8a07-09a1-48c6-9784-49ed9655c2ce None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:01.550781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804f412-c229-4e27-b137-5b0d1b9fdf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:01.551526 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804f412-c229-4e27-b137-5b0d1b9fdf64 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:01.551815 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804f412-c229-4e27-b137-5b0d1b9fdf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:01.552091 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804f412-c229-4e27-b137-5b0d1b9fdf64 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:01.552839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804f412-c229-4e27-b137-5b0d1b9fdf64 None admin] RBAC: Adding query filter params (name=member) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:01.553148 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804f412-c229-4e27-b137-5b0d1b9fdf64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:01.554547 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804f412-c229-4e27-b137-5b0d1b9fdf64 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:01.563144 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 222/447] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:29:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:01.569537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804f412-c229-4e27-b137-5b0d1b9fdf64 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:01.601283 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:01.621751 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 226/448] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:29:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 14 19:29:01.627232 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb8a07-09a1-48c6-9784-49ed9655c2ce None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:01.674162 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804f412-c229-4e27-b137-5b0d1b9fdf64 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:01.702895 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:01.709935 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeeb191-e734-410f-a437-3c9b3e23d9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:01.710581 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeeb191-e734-410f-a437-3c9b3e23d9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:01.710861 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeeb191-e734-410f-a437-3c9b3e23d9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:01.711134 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeeb191-e734-410f-a437-3c9b3e23d9f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:01.724682 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb8a07-09a1-48c6-9784-49ed9655c2ce None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:01.758412 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d183a-9ed3-4ff8-9621-2ba1c6a0c2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:01.759261 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d183a-9ed3-4ff8-9621-2ba1c6a0c2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:01.759553 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d183a-9ed3-4ff8-9621-2ba1c6a0c2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:01.759827 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d183a-9ed3-4ff8-9621-2ba1c6a0c2d0 None admin] PATH_INFO: `/v3/projects/782dbf52581f4a55b95487f939e373c1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:01.760999 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d183a-9ed3-4ff8-9621-2ba1c6a0c2d0 None admin] RBAC: Authorizing `identity:get_project(project_id=782dbf52581f4a55b95487f939e373c1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:01.762537 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d183a-9ed3-4ff8-9621-2ba1c6a0c2d0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:01.764371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 227/449] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:29:01 2022] GET /identity/v3/projects/782dbf52581f4a55b95487f939e373c1 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:01.769739 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d183a-9ed3-4ff8-9621-2ba1c6a0c2d0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:01.777136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeeb191-e734-410f-a437-3c9b3e23d9f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:01.778604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeeb191-e734-410f-a437-3c9b3e23d9f3 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:01.807552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:01.868012 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d183a-9ed3-4ff8-9621-2ba1c6a0c2d0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:01.877349 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 223/450] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:29:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 14 19:29:01.883489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeeb191-e734-410f-a437-3c9b3e23d9f3 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:01.901601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dec902-6ba4-4bb6-a7ba-5a5f1c9bba34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:01.902459 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dec902-6ba4-4bb6-a7ba-5a5f1c9bba34 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:01.902743 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dec902-6ba4-4bb6-a7ba-5a5f1c9bba34 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:01.903023 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dec902-6ba4-4bb6-a7ba-5a5f1c9bba34 None admin] PATH_INFO: `/v3/groups/27ecaff3aec14b62906b1e9d0d79fb88` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:01.904195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dec902-6ba4-4bb6-a7ba-5a5f1c9bba34 None admin] RBAC: Authorizing `identity:get_group(group_id=27ecaff3aec14b62906b1e9d0d79fb88)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:01.905690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dec902-6ba4-4bb6-a7ba-5a5f1c9bba34 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:01.907441 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 228/451] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jun 14 19:29:01 2022] GET /identity/v3/groups/27ecaff3aec14b62906b1e9d0d79fb88 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:01.913835 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dec902-6ba4-4bb6-a7ba-5a5f1c9bba34 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:01.928979 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:01.979877 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeeb191-e734-410f-a437-3c9b3e23d9f3 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:02.008455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:02.011836 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dec902-6ba4-4bb6-a7ba-5a5f1c9bba34 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:02.013738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da56071-cbdc-449a-9f0e-669115bb5847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:02.014587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da56071-cbdc-449a-9f0e-669115bb5847 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:02.014866 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da56071-cbdc-449a-9f0e-669115bb5847 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:02.015133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da56071-cbdc-449a-9f0e-669115bb5847 None admin] PATH_INFO: `/v3/projects/e743a4a482c24a1f88389b1830c2386e` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:02.016310 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da56071-cbdc-449a-9f0e-669115bb5847 None admin] RBAC: Authorizing `identity:get_project(project_id=e743a4a482c24a1f88389b1830c2386e)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:02.017818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da56071-cbdc-449a-9f0e-669115bb5847 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:02.019516 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 224/452] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:29:01 2022] GET /identity/v3/projects/e743a4a482c24a1f88389b1830c2386e => generated 302 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:02.025098 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da56071-cbdc-449a-9f0e-669115bb5847 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:02.046612 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d730bd-f56c-4343-81c5-a41a80592b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:02.047253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d730bd-f56c-4343-81c5-a41a80592b01 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:02.047535 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d730bd-f56c-4343-81c5-a41a80592b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:02.047813 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d730bd-f56c-4343-81c5-a41a80592b01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:02.048629 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d730bd-f56c-4343-81c5-a41a80592b01 None admin] RBAC: Adding query filter params (group.id=27ecaff3aec14b62906b1e9d0d79fb88, role.id=1e2bb0d759694428ada2b52285de933b, scope.project.id=782dbf52581f4a55b95487f939e373c1) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:02.048943 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d730bd-f56c-4343-81c5-a41a80592b01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:02.051021 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d730bd-f56c-4343-81c5-a41a80592b01 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:02.056631 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 229/453] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jun 14 19:29:01 2022] GET /identity/v3/role_assignments?group.id=27ecaff3aec14b62906b1e9d0d79fb88&scope.project.id=782dbf52581f4a55b95487f939e373c1&role.id=1e2bb0d759694428ada2b52285de933b => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:02.129316 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da56071-cbdc-449a-9f0e-669115bb5847 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:02.164672 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424e782-f27b-4aa2-8d11-2616ac0a6041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:02.165573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424e782-f27b-4aa2-8d11-2616ac0a6041 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:02.166114 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424e782-f27b-4aa2-8d11-2616ac0a6041 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:02.166388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424e782-f27b-4aa2-8d11-2616ac0a6041 None admin] PATH_INFO: `/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:02.167621 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424e782-f27b-4aa2-8d11-2616ac0a6041 None admin] RBAC: Authorizing `identity:get_group(group_id=d6b2ea7a25da4b58ba439afbbe3a87ab)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:02.169094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424e782-f27b-4aa2-8d11-2616ac0a6041 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:02.170793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 225/454] 10.222.0.44 () {56 vars in 1180 bytes} [Tue Jun 14 19:29:02 2022] GET /identity/v3/groups/d6b2ea7a25da4b58ba439afbbe3a87ab => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:02.177021 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d730bd-f56c-4343-81c5-a41a80592b01 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:02.257576 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:02.279368 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d730bd-f56c-4343-81c5-a41a80592b01 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:02.311600 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ad20b-cbcd-4678-b940-475864200dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:02.312237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ad20b-cbcd-4678-b940-475864200dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:02.312520 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ad20b-cbcd-4678-b940-475864200dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:02.312793 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ad20b-cbcd-4678-b940-475864200dc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:02.313643 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ad20b-cbcd-4678-b940-475864200dc6 None admin] RBAC: Adding query filter params (group.id=d6b2ea7a25da4b58ba439afbbe3a87ab, role.id=bf1733d36314409c80cd50b2268834b1, scope.project.id=e743a4a482c24a1f88389b1830c2386e) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:02.313956 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ad20b-cbcd-4678-b940-475864200dc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:02.315378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ad20b-cbcd-4678-b940-475864200dc6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:02.321722 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 230/455] 10.222.0.44 () {56 vars in 1376 bytes} [Tue Jun 14 19:29:02 2022] GET /identity/v3/role_assignments?group.id=d6b2ea7a25da4b58ba439afbbe3a87ab&scope.project.id=e743a4a482c24a1f88389b1830c2386e&role.id=bf1733d36314409c80cd50b2268834b1 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:05.303839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d92cd-0b58-45d4-a95e-0472fa1467a7 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:05.304691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d92cd-0b58-45d4-a95e-0472fa1467a7 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:05.305111 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d92cd-0b58-45d4-a95e-0472fa1467a7 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:05.306881 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 226/456] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:05.312465 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b943c2d-4520-48e2-aca4-4348cc665939 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:05.313252 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b943c2d-4520-48e2-aca4-4348cc665939 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:05.313698 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b943c2d-4520-48e2-aca4-4348cc665939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:05.338503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-5b943c2d-4520-48e2-aca4-4348cc665939 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:05.339956 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5b943c2d-4520-48e2-aca4-4348cc665939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:05.465603 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 231/457] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:29:05.502729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d92cd-0b58-45d4-a95e-0472fa1467a7 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:05.519446 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e613e7-336a-4de4-9ba5-b01a614a82d5 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:05.520246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e613e7-336a-4de4-9ba5-b01a614a82d5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:05.520246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e613e7-336a-4de4-9ba5-b01a614a82d5 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:05.521902 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 232/458] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:05.524559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a7488-6a29-465e-9c23-3cc86fbc6942 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:05.525060 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a7488-6a29-465e-9c23-3cc86fbc6942 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:05.525569 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a7488-6a29-465e-9c23-3cc86fbc6942 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:05.527222 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 233/459] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:29:05.528445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bf1fc-f578-42f2-83f1-e2ba571ad220 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:05.528946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bf1fc-f578-42f2-83f1-e2ba571ad220 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:05.529448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2bf1fc-f578-42f2-83f1-e2ba571ad220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:05.551583 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-cb2bf1fc-f578-42f2-83f1-e2ba571ad220 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:05.553116 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-cb2bf1fc-f578-42f2-83f1-e2ba571ad220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:05.584474 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:05.623995 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d92cd-0b58-45d4-a95e-0472fa1467a7 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:05.636897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 234/460] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:05.638622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb695b7-9bfe-4100-a7e1-22c65391de4d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:05.639098 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb695b7-9bfe-4100-a7e1-22c65391de4d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:05.639555 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb695b7-9bfe-4100-a7e1-22c65391de4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:05.644553 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:05.657080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9eb695b7-9bfe-4100-a7e1-22c65391de4d None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:05.658615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9eb695b7-9bfe-4100-a7e1-22c65391de4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:05.663994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aed0a7-b77a-493f-935c-b8c5db4fdd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:05.664802 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aed0a7-b77a-493f-935c-b8c5db4fdd93 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:05.665080 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aed0a7-b77a-493f-935c-b8c5db4fdd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:05.665350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aed0a7-b77a-493f-935c-b8c5db4fdd93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:05.677630 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aed0a7-b77a-493f-935c-b8c5db4fdd93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:05.679197 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aed0a7-b77a-493f-935c-b8c5db4fdd93 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:05.698755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-84aed0a7-b77a-493f-935c-b8c5db4fdd93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:05.698755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:05.698755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:05.698755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:05.698755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:05.698755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:05.698755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:05.698755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:05.698755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:05.698755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:05.698755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:05.698755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:05.698755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:05.698755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:05.698755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:05.699647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:05.699647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:05.699647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:05.699647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:05.699647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:05.699647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:05.699647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:05.699647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:05.699647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:05.699647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:05.699647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:05.699647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:05.699647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:05.699647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:05.699647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:05.699647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:05.699647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:05.701058 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:05.701058 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:05.701058 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:05.701058 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:05.701058 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 227/461] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:05.701058 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aed0a7-b77a-493f-935c-b8c5db4fdd93 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:05.739008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 235/462] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:05.746463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb695b7-9bfe-4100-a7e1-22c65391de4d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:05.828180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aed0a7-b77a-493f-935c-b8c5db4fdd93 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:05.856634 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:05.875827 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03f26c-a950-4c1c-8ced-a84eacd412bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:05.876639 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03f26c-a950-4c1c-8ced-a84eacd412bf None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:05.876929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03f26c-a950-4c1c-8ced-a84eacd412bf None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:05.877211 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03f26c-a950-4c1c-8ced-a84eacd412bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:05.883325 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb695b7-9bfe-4100-a7e1-22c65391de4d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:05.887779 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03f26c-a950-4c1c-8ced-a84eacd412bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:05.889242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03f26c-a950-4c1c-8ced-a84eacd412bf None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:05.907814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-bb03f26c-a950-4c1c-8ced-a84eacd412bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:05.907814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:05.907814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:05.907814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:05.907814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:05.907814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:05.907814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:05.907814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:05.907814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:05.907814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:05.907814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:05.907814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:05.907814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:05.907814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:05.907814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:05.908676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:05.908676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:05.908676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:05.908676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:05.908676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:05.908676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:05.908676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:05.908676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:05.908676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:05.908676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:05.908676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:05.908676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:05.908676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:05.908676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:05.908676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:05.908676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:05.908676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:05.910182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:05.910182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:05.910182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:05.910182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:05.910182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 228/463] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:05.910436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03f26c-a950-4c1c-8ced-a84eacd412bf None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:05.918206 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:05.923944 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d21017-f01c-4402-bdba-5e8e2ef7272b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:05.924614 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d21017-f01c-4402-bdba-5e8e2ef7272b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:05.924901 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d21017-f01c-4402-bdba-5e8e2ef7272b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:05.925862 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d21017-f01c-4402-bdba-5e8e2ef7272b None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:05.926696 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d21017-f01c-4402-bdba-5e8e2ef7272b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:05.927008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d21017-f01c-4402-bdba-5e8e2ef7272b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:05.928401 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d21017-f01c-4402-bdba-5e8e2ef7272b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:05.944958 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 236/464] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:05.946490 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f82c6-9127-429f-a6bf-b2a9f9d56071 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:05.946978 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f82c6-9127-429f-a6bf-b2a9f9d56071 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:05.947408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f82c6-9127-429f-a6bf-b2a9f9d56071 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:05.948860 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 237/465] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:05.949749 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f82c6-9127-429f-a6bf-b2a9f9d56071 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:06.017410 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03f26c-a950-4c1c-8ced-a84eacd412bf None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:06.057839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310b551-9971-4ae4-8ae3-f597f3ae49f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:06.058640 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310b551-9971-4ae4-8ae3-f597f3ae49f1 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:06.058929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310b551-9971-4ae4-8ae3-f597f3ae49f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:06.059208 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310b551-9971-4ae4-8ae3-f597f3ae49f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:06.064184 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f82c6-9127-429f-a6bf-b2a9f9d56071 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:06.070097 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310b551-9971-4ae4-8ae3-f597f3ae49f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:06.071573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310b551-9971-4ae4-8ae3-f597f3ae49f1 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:06.090217 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-3310b551-9971-4ae4-8ae3-f597f3ae49f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:06.090217 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:06.090217 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:06.090217 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:06.090217 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:06.090217 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:06.090217 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:06.090217 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:06.090217 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:06.090217 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:06.090217 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:06.090217 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:06.090217 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:06.090217 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:06.090217 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:06.091272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:06.091272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:06.091272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:06.091272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:06.091272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:06.091272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:06.091272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:06.091272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:06.091272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:06.091272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:06.091272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:06.091272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:06.091272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:06.091272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:06.091272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:06.091272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:06.091272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:06.092317 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:06.092317 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:06.092317 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:06.092317 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:06.094155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 229/466] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:06.094984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310b551-9971-4ae4-8ae3-f597f3ae49f1 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:06.106721 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf2b626-c399-4630-a4a5-a1d02cb1fd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:06.107320 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2b626-c399-4630-a4a5-a1d02cb1fd13 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:06.107612 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2b626-c399-4630-a4a5-a1d02cb1fd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:06.107890 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf2b626-c399-4630-a4a5-a1d02cb1fd13 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:06.108616 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2b626-c399-4630-a4a5-a1d02cb1fd13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:06.108926 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2b626-c399-4630-a4a5-a1d02cb1fd13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:06.110361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf2b626-c399-4630-a4a5-a1d02cb1fd13 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:06.122145 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 238/467] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:06.123445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a71c8-621a-40d9-9df0-3b2f5130fda3 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:06.123741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a71c8-621a-40d9-9df0-3b2f5130fda3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:06.124022 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a71c8-621a-40d9-9df0-3b2f5130fda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:06.129658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:06.141020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b74a71c8-621a-40d9-9df0-3b2f5130fda3 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:06.142244 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b74a71c8-621a-40d9-9df0-3b2f5130fda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:06.194122 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:06.210906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310b551-9971-4ae4-8ae3-f597f3ae49f1 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:06.217460 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 239/468] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:06.221415 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a71c8-621a-40d9-9df0-3b2f5130fda3 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:06.253159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25ace4-7707-47d6-a13f-175199be4ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:06.253892 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25ace4-7707-47d6-a13f-175199be4ae2 None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:06.254195 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25ace4-7707-47d6-a13f-175199be4ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:06.254746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25ace4-7707-47d6-a13f-175199be4ae2 None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:06.255230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25ace4-7707-47d6-a13f-175199be4ae2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:06.256666 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25ace4-7707-47d6-a13f-175199be4ae2 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:06.277098 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 230/469] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jun 14 19:29:06 2022] POST /identity/v3/users => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:29:06.277955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25ace4-7707-47d6-a13f-175199be4ae2 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:06.378460 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:06.379159 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a71c8-621a-40d9-9df0-3b2f5130fda3 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:06.407074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25ace4-7707-47d6-a13f-175199be4ae2 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:06.420844 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12b3ef-e01a-4186-9f7c-39a51ebb6c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:06.421743 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12b3ef-e01a-4186-9f7c-39a51ebb6c5f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:06.421887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12b3ef-e01a-4186-9f7c-39a51ebb6c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:06.422102 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12b3ef-e01a-4186-9f7c-39a51ebb6c5f None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:06.422929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12b3ef-e01a-4186-9f7c-39a51ebb6c5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:06.423387 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12b3ef-e01a-4186-9f7c-39a51ebb6c5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:06.424775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12b3ef-e01a-4186-9f7c-39a51ebb6c5f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:06.442952 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 240/470] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:06.443864 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12b3ef-e01a-4186-9f7c-39a51ebb6c5f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:06.450995 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36033de6-57f5-4344-8d02-462947cf8606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:06.451945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36033de6-57f5-4344-8d02-462947cf8606 None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:06.452448 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36033de6-57f5-4344-8d02-462947cf8606 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:06.452767 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36033de6-57f5-4344-8d02-462947cf8606 None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:06.453830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36033de6-57f5-4344-8d02-462947cf8606 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:06.456075 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36033de6-57f5-4344-8d02-462947cf8606 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:06.478750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 231/471] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jun 14 19:29:06 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:29:06.480345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36033de6-57f5-4344-8d02-462947cf8606 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:06.509433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:06.601150 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12b3ef-e01a-4186-9f7c-39a51ebb6c5f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:06.619987 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36033de6-57f5-4344-8d02-462947cf8606 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:06.646125 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66af47f-1fb7-4076-bcb8-ed90a3c7adcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:06.646953 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66af47f-1fb7-4076-bcb8-ed90a3c7adcf None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:06.647235 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66af47f-1fb7-4076-bcb8-ed90a3c7adcf None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:06.647510 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66af47f-1fb7-4076-bcb8-ed90a3c7adcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:06.659656 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac31305-7c4e-4f73-bef3-7cad05c7e6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:06.660784 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac31305-7c4e-4f73-bef3-7cad05c7e6d1 None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:06.660902 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66af47f-1fb7-4076-bcb8-ed90a3c7adcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:06.661334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac31305-7c4e-4f73-bef3-7cad05c7e6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:06.661789 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac31305-7c4e-4f73-bef3-7cad05c7e6d1 None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:06.662285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66af47f-1fb7-4076-bcb8-ed90a3c7adcf None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:06.662831 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac31305-7c4e-4f73-bef3-7cad05c7e6d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:06.664438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac31305-7c4e-4f73-bef3-7cad05c7e6d1 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:06.673456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:06.686782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-d66af47f-1fb7-4076-bcb8-ed90a3c7adcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:06.686782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:06.686782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:06.686782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:06.686782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:06.686782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:06.686782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:06.686782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:06.686782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:06.686782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:06.686782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:06.686782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:06.686782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:06.686782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:06.686782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:06.688004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:06.688004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:06.688004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:06.688004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:06.688004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:06.688004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:06.688004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:06.688004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:06.688004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:06.688004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:06.688004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:06.688004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:06.688004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:06.688004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:06.688004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:06.688004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:06.688004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:06.689025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:06.689025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:06.689025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:06.689025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:06.689025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 241/472] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:06.689292 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef234dd-2ef1-471b-96a9-a18e9674fc3a None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:06.689560 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef234dd-2ef1-471b-96a9-a18e9674fc3a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:06.689841 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef234dd-2ef1-471b-96a9-a18e9674fc3a None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:06.692148 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 242/473] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:06.695159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 232/474] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jun 14 19:29:06 2022] POST /identity/v3/users => generated 248 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:29:06.697751 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef234dd-2ef1-471b-96a9-a18e9674fc3a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:06.698486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51036747-9f72-427f-a7aa-c4b6cba39b90 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:06.698926 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51036747-9f72-427f-a7aa-c4b6cba39b90 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:06.699353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51036747-9f72-427f-a7aa-c4b6cba39b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:06.719823 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-51036747-9f72-427f-a7aa-c4b6cba39b90 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:06.721512 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-51036747-9f72-427f-a7aa-c4b6cba39b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:06.808820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 233/475] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:06.824093 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:06.834437 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef234dd-2ef1-471b-96a9-a18e9674fc3a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:06.836534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51036747-9f72-427f-a7aa-c4b6cba39b90 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:06.888301 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68af333-4680-4fa4-9389-85c238a7bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:06.889214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68af333-4680-4fa4-9389-85c238a7bbcf None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:06.889678 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68af333-4680-4fa4-9389-85c238a7bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:06.890103 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68af333-4680-4fa4-9389-85c238a7bbcf None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:06.890978 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68af333-4680-4fa4-9389-85c238a7bbcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:06.891454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68af333-4680-4fa4-9389-85c238a7bbcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:06.894159 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68af333-4680-4fa4-9389-85c238a7bbcf None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:06.912287 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 243/476] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:06.917306 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68af333-4680-4fa4-9389-85c238a7bbcf None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:06.980722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51036747-9f72-427f-a7aa-c4b6cba39b90 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:07.005004 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:07.020648 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a4fa6-671b-48e1-be5d-7e7546e71790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:07.021471 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a4fa6-671b-48e1-be5d-7e7546e71790 None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:07.021764 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a4fa6-671b-48e1-be5d-7e7546e71790 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:07.022045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a4fa6-671b-48e1-be5d-7e7546e71790 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:07.022871 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a4fa6-671b-48e1-be5d-7e7546e71790 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:07.024380 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a4fa6-671b-48e1-be5d-7e7546e71790 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:07.033503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.sql.core [None req-de4a4fa6-671b-48e1-be5d-7e7546e71790 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 14 19:29:07.033503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 14 19:29:07.033503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [parameters: {'id': 'bf9c8bfc2dbf4bbab16b800b7ada67af', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 14 19:29:07.033503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80346) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 14 19:29:07.043498 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68af333-4680-4fa4-9389-85c238a7bbcf None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:07.052455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-de4a4fa6-671b-48e1-be5d-7e7546e71790 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 14 19:29:07.052455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:07.052455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 14 19:29:07.052455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 14 19:29:07.052455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 14 19:29:07.052455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 14 19:29:07.052455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 14 19:29:07.052455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application result = self._query(query) Jun 14 19:29:07.052455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 14 19:29:07.052455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application conn.query(q) Jun 14 19:29:07.052455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 14 19:29:07.052455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 14 19:29:07.052455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 14 19:29:07.052455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application result.read() Jun 14 19:29:07.052455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 14 19:29:07.053318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 14 19:29:07.053318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 14 19:29:07.053318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 14 19:29:07.053318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 14 19:29:07.053318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 14 19:29:07.053318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 14 19:29:07.053318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 14 19:29:07.053318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 14 19:29:07.053318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:07.053318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 14 19:29:07.053318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:07.053318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:07.053318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 14 19:29:07.053318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 14 19:29:07.053318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 14 19:29:07.053318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return ref.to_dict() Jun 14 19:29:07.053318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 14 19:29:07.053318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application next(self.gen) Jun 14 19:29:07.054246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 14 19:29:07.054246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application yield resource Jun 14 19:29:07.054246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 14 19:29:07.054246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application next(self.gen) Jun 14 19:29:07.054246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 14 19:29:07.054246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self.session.rollback() Jun 14 19:29:07.054246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 14 19:29:07.054246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self.force_reraise() Jun 14 19:29:07.054246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 14 19:29:07.054246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise self.value Jun 14 19:29:07.054246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 14 19:29:07.054246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 14 19:29:07.054246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 14 19:29:07.054246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application session.commit() Jun 14 19:29:07.054246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 14 19:29:07.054246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 14 19:29:07.054246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 14 19:29:07.055117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._prepare_impl() Jun 14 19:29:07.055117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 14 19:29:07.055117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self.session.flush() Jun 14 19:29:07.055117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 14 19:29:07.055117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._flush(objects) Jun 14 19:29:07.055117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 14 19:29:07.055117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 14 19:29:07.055117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 14 19:29:07.055117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application compat.raise_( Jun 14 19:29:07.055117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 14 19:29:07.055117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception Jun 14 19:29:07.055117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 14 19:29:07.055117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application flush_context.execute() Jun 14 19:29:07.055117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 14 19:29:07.055117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rec.execute(self) Jun 14 19:29:07.055117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 14 19:29:07.055117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 14 19:29:07.056745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 14 19:29:07.056745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 14 19:29:07.056745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 14 19:29:07.056745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 14 19:29:07.056745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 14 19:29:07.056745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 14 19:29:07.056745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 14 19:29:07.056745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 14 19:29:07.056745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 14 19:29:07.056745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 14 19:29:07.056745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 14 19:29:07.056745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 14 19:29:07.056745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 14 19:29:07.056745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 14 19:29:07.056745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 14 19:29:07.056745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception Jun 14 19:29:07.057589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 14 19:29:07.057589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 14 19:29:07.057589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 14 19:29:07.057589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 14 19:29:07.057589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 14 19:29:07.057589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application result = self._query(query) Jun 14 19:29:07.057589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 14 19:29:07.057589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application conn.query(q) Jun 14 19:29:07.057589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 14 19:29:07.057589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 14 19:29:07.057589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 14 19:29:07.057589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application result.read() Jun 14 19:29:07.057589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 14 19:29:07.057589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 14 19:29:07.057589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 14 19:29:07.057589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 14 19:29:07.058353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 14 19:29:07.058353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 14 19:29:07.058353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 14 19:29:07.058353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 14 19:29:07.058353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 14 19:29:07.058353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 14 19:29:07.058353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [parameters: {'id': 'bf9c8bfc2dbf4bbab16b800b7ada67af', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 14 19:29:07.058353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 14 19:29:07.058353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:07.058353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:29:07.058353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:07.058353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:07.058353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:07.058353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:07.058353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:07.058353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:07.060125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:07.060125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:07.060125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:07.060125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:07.060125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:07.060125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:07.060125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 14 19:29:07.060125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 14 19:29:07.060125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:07.060125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:07.060125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 14 19:29:07.060125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 14 19:29:07.060125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 14 19:29:07.060125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 14 19:29:07.060125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 14 19:29:07.060125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:07.062082 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 234/477] 10.222.0.44 () {60 vars in 1131 bytes} [Tue Jun 14 19:29:06 2022] POST /identity/v3/roles => generated 144 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:07.062082 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a4fa6-671b-48e1-be5d-7e7546e71790 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:07.089620 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eac98f-c6f8-43a5-a0b3-74251809895d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:07.090401 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eac98f-c6f8-43a5-a0b3-74251809895d None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:07.090762 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eac98f-c6f8-43a5-a0b3-74251809895d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:07.091115 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eac98f-c6f8-43a5-a0b3-74251809895d None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:07.092343 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eac98f-c6f8-43a5-a0b3-74251809895d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:07.094215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eac98f-c6f8-43a5-a0b3-74251809895d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:07.125536 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 244/478] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jun 14 19:29:06 2022] POST /identity/v3/users => generated 249 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:29:07.196708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a4fa6-671b-48e1-be5d-7e7546e71790 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:07.235693 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c046214-6ff1-4dd6-8f5b-f3f10087e235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:07.236542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c046214-6ff1-4dd6-8f5b-f3f10087e235 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:07.236790 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c046214-6ff1-4dd6-8f5b-f3f10087e235 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:07.237063 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c046214-6ff1-4dd6-8f5b-f3f10087e235 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:07.250162 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c046214-6ff1-4dd6-8f5b-f3f10087e235 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:07.259277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-7c046214-6ff1-4dd6-8f5b-f3f10087e235 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:29:07.259277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:07.259277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:07.259277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:07.259277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:07.259277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:07.259277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:07.259277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:07.259277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:07.259277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:07.259277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:07.259277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:07.259277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:07.259277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:07.259277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:07.259277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:07.260375 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:07.260375 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:07.260375 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:07.260375 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:07.260375 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:07.260375 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:07.260375 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:07.260375 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:07.260375 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:07.260375 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:07.260375 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:07.260375 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:07.260375 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:07.260375 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:07.260375 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:07.260375 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:07.261338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:07.261338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:07.261338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:07.261338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:07.261338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:07.261338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:07.261338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:07.261338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:07.261338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:07.261338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:07.261338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 14 19:29:07.261338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:07.261338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 235/479] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:29:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:07.266728 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eac98f-c6f8-43a5-a0b3-74251809895d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:07.281804 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:07.381988 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eac98f-c6f8-43a5-a0b3-74251809895d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:07.422636 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c583252-4cb3-4a64-9b21-38ec75f902ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:07.423308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c583252-4cb3-4a64-9b21-38ec75f902ac None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:07.423593 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c583252-4cb3-4a64-9b21-38ec75f902ac None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:07.423873 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c583252-4cb3-4a64-9b21-38ec75f902ac None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:07.424630 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c583252-4cb3-4a64-9b21-38ec75f902ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:07.424981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c583252-4cb3-4a64-9b21-38ec75f902ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:07.426392 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c583252-4cb3-4a64-9b21-38ec75f902ac None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:07.435230 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 245/480] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:09.092015 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212d5d3-bd8f-449c-933f-160fdb21bcf2 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:09.092519 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212d5d3-bd8f-449c-933f-160fdb21bcf2 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:09.092519 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d212d5d3-bd8f-449c-933f-160fdb21bcf2 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:09.094225 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 236/481] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:09.101026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619b69b-ac5f-4586-9f05-4d4ed776fd8e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:09.101591 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619b69b-ac5f-4586-9f05-4d4ed776fd8e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:09.101591 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619b69b-ac5f-4586-9f05-4d4ed776fd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:09.124690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a619b69b-ac5f-4586-9f05-4d4ed776fd8e None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:09.125939 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a619b69b-ac5f-4586-9f05-4d4ed776fd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:09.163319 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766815d9-efc8-40d0-a452-83cf69ba8dcf None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:09.163621 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766815d9-efc8-40d0-a452-83cf69ba8dcf None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:09.163878 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766815d9-efc8-40d0-a452-83cf69ba8dcf None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:09.165762 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 237/482] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:29:09.170663 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952beac-e6ef-4bb5-9212-9e9049ccd260 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:09.170929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952beac-e6ef-4bb5-9212-9e9049ccd260 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:09.171214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952beac-e6ef-4bb5-9212-9e9049ccd260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:09.188061 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-5952beac-e6ef-4bb5-9212-9e9049ccd260 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:09.189248 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-5952beac-e6ef-4bb5-9212-9e9049ccd260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:09.214031 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 246/483] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:29:09.240201 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619b69b-ac5f-4586-9f05-4d4ed776fd8e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:09.245773 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:09.280283 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:09.320599 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 238/484] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:29:09.356543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952beac-e6ef-4bb5-9212-9e9049ccd260 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:09.389744 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619b69b-ac5f-4586-9f05-4d4ed776fd8e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:09.426789 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e1ddf-67b8-44c2-a4d9-4f733322d456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:09.427861 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e1ddf-67b8-44c2-a4d9-4f733322d456 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:09.428292 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e1ddf-67b8-44c2-a4d9-4f733322d456 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:09.428723 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4e1ddf-67b8-44c2-a4d9-4f733322d456 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:09.460218 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4e1ddf-67b8-44c2-a4d9-4f733322d456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:09.468079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-bb4e1ddf-67b8-44c2-a4d9-4f733322d456 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:09.468079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:09.468079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:09.468079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:09.468079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:09.468079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:09.468079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:09.468079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:09.468079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:09.468079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:09.468079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:09.468079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:09.468079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:09.468079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:09.468079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:09.468079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:09.468961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:09.468961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:09.468961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:09.468961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:09.468961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:09.468961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:09.468961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:09.468961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:09.468961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:09.468961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:09.468961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:09.468961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:09.468961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:09.468961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:09.468961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:09.468961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:09.469782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:09.469782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:09.469782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:09.469782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:09.469782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:09.469782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:09.469782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:09.469782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:09.469782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:09.469782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:09.469782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:09.469782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:09.477819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 247/485] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:29:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:09.483395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e1ddf-67b8-44c2-a4d9-4f733322d456 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:09.511765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952beac-e6ef-4bb5-9212-9e9049ccd260 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:09.553294 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3057938-934f-4221-972e-5347b9bbb090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:09.554647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3057938-934f-4221-972e-5347b9bbb090 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:09.555132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3057938-934f-4221-972e-5347b9bbb090 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:09.555630 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3057938-934f-4221-972e-5347b9bbb090 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:09.569197 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3057938-934f-4221-972e-5347b9bbb090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:09.578427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-e3057938-934f-4221-972e-5347b9bbb090 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:09.578427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:09.578427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:09.578427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:09.578427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:09.578427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:09.578427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:09.578427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:09.578427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:09.578427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:09.578427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:09.578427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:09.578427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:09.578427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:09.578427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:09.578427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:09.579314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:09.579314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:09.579314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:09.579314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:09.579314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:09.579314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:09.579314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:09.579314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:09.579314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:09.579314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:09.579314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:09.579314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:09.579314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:09.579314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:09.579314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:09.579314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:09.580072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:09.580072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:09.580072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:09.580072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:09.580072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:09.580072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:09.580072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:09.580072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:09.580072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:09.580072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:09.580072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:09.580072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:09.584214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 239/486] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:29:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:09.590159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3057938-934f-4221-972e-5347b9bbb090 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:09.614064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:09.632266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:09.657789 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4e1ddf-67b8-44c2-a4d9-4f733322d456 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:09.693770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20515a-5bfe-42c0-a002-9238b1dc327e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:09.694816 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20515a-5bfe-42c0-a002-9238b1dc327e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:09.695346 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20515a-5bfe-42c0-a002-9238b1dc327e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:09.695839 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20515a-5bfe-42c0-a002-9238b1dc327e None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:09.696792 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20515a-5bfe-42c0-a002-9238b1dc327e None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:09.697302 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20515a-5bfe-42c0-a002-9238b1dc327e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:09.699072 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20515a-5bfe-42c0-a002-9238b1dc327e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:09.704424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3057938-934f-4221-972e-5347b9bbb090 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:09.709835 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 248/487] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jun 14 19:29:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:09.711452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b7fab-96e9-4499-a60a-b1ec3fe52d48 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:09.711951 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b7fab-96e9-4499-a60a-b1ec3fe52d48 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:09.712526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6b7fab-96e9-4499-a60a-b1ec3fe52d48 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:09.718576 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 249/488] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:09.719682 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b7fab-96e9-4499-a60a-b1ec3fe52d48 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:09.741964 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f41d1-3a21-4c32-94e3-c13d1e486f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:09.742642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f41d1-3a21-4c32-94e3-c13d1e486f83 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:09.742928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f41d1-3a21-4c32-94e3-c13d1e486f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:09.743208 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f41d1-3a21-4c32-94e3-c13d1e486f83 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:09.743960 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f41d1-3a21-4c32-94e3-c13d1e486f83 None admin] RBAC: Adding query filter params (name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:09.744270 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f41d1-3a21-4c32-94e3-c13d1e486f83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:09.745860 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f41d1-3a21-4c32-94e3-c13d1e486f83 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:09.756492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 240/489] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jun 14 19:29:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:09.762451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5ed4f-8fef-425e-90df-b982b4944dcf None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:09.762745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5ed4f-8fef-425e-90df-b982b4944dcf None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:09.763029 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5ed4f-8fef-425e-90df-b982b4944dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:09.782004 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-14a5ed4f-8fef-425e-90df-b982b4944dcf None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:09.783201 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-14a5ed4f-8fef-425e-90df-b982b4944dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:09.841718 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6b7fab-96e9-4499-a60a-b1ec3fe52d48 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:09.865477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 241/490] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:09.865477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5ed4f-8fef-425e-90df-b982b4944dcf None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:09.876326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:09.891687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:09.902083 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88c00a-f0db-429f-bc16-1fbdad51cc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:09.903190 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88c00a-f0db-429f-bc16-1fbdad51cc94 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:09.903684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88c00a-f0db-429f-bc16-1fbdad51cc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:09.904165 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88c00a-f0db-429f-bc16-1fbdad51cc94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:09.921857 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88c00a-f0db-429f-bc16-1fbdad51cc94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:09.923811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88c00a-f0db-429f-bc16-1fbdad51cc94 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:09.943989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-6c88c00a-f0db-429f-bc16-1fbdad51cc94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:09.943989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:09.943989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:09.943989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:09.943989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:09.943989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:09.943989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:09.943989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:09.943989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:09.943989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:09.943989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:09.943989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:09.943989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:09.943989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:09.943989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:09.944874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:09.944874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:09.944874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:09.944874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:09.944874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:09.944874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:09.944874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:09.944874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:09.944874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:09.944874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:09.944874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:09.944874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:09.944874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:09.944874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:09.944874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:09.944874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:09.944874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:09.945741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:09.945741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:09.945741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:09.945741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:09.948210 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 250/491] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:09.949278 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88c00a-f0db-429f-bc16-1fbdad51cc94 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:09.971762 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5ed4f-8fef-425e-90df-b982b4944dcf None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:10.011755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92f34c-be2c-452f-a005-62c280542f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:10.012569 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92f34c-be2c-452f-a005-62c280542f8d None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:10.013007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92f34c-be2c-452f-a005-62c280542f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:10.013240 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92f34c-be2c-452f-a005-62c280542f8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:10.026078 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92f34c-be2c-452f-a005-62c280542f8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:10.027686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92f34c-be2c-452f-a005-62c280542f8d None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:10.048051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-1d92f34c-be2c-452f-a005-62c280542f8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:10.048051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:10.048051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:10.048051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:10.048051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:10.048051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:10.048051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:10.048051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:10.048051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:10.048051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:10.048051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:10.048051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:10.048051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:10.048051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:10.048051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:10.048955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:10.048955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:10.048955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:10.048955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:10.048955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:10.048955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:10.048955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:10.048955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:10.048955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:10.048955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:10.048955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:10.048955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:10.048955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:10.048955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:10.048955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:10.048955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:10.048955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:10.050398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:10.050398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:10.050398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:10.050398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:10.050398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 242/492] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:10.050898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92f34c-be2c-452f-a005-62c280542f8d None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:10.067735 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88c00a-f0db-429f-bc16-1fbdad51cc94 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:10.102189 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671b1cd-d7e1-4921-8761-b3e6381f4e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:10.102989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671b1cd-d7e1-4921-8761-b3e6381f4e1c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:10.103281 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671b1cd-d7e1-4921-8761-b3e6381f4e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:10.103561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3671b1cd-d7e1-4921-8761-b3e6381f4e1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:10.114608 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3671b1cd-d7e1-4921-8761-b3e6381f4e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:10.122440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-3671b1cd-d7e1-4921-8761-b3e6381f4e1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:10.122440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:10.122440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:10.122440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:10.122440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:10.122440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:10.122440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:10.122440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:10.122440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:10.122440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:10.122440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:10.122440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:10.122440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:10.122440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:10.122440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:10.122440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:10.123378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:10.123378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:10.123378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:10.123378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:10.123378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:10.123378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:10.123378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:10.123378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:10.123378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:10.123378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:10.123378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:10.123378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:10.123378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:10.123378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:10.123378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:10.123378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:10.124147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:10.124147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:10.124147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:10.124147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:10.124147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:10.124147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:10.124147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:10.124147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:10.124147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:10.124147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:10.124147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:10.124147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:10.124147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 251/493] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:29:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:10.124781 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671b1cd-d7e1-4921-8761-b3e6381f4e1c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:10.154166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:10.171305 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:10.177576 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92f34c-be2c-452f-a005-62c280542f8d None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:10.213895 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d043fdf-be17-43ac-8ea9-6dd3202db25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:10.214569 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d043fdf-be17-43ac-8ea9-6dd3202db25b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:10.214852 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d043fdf-be17-43ac-8ea9-6dd3202db25b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:10.215131 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d043fdf-be17-43ac-8ea9-6dd3202db25b None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:10.215858 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d043fdf-be17-43ac-8ea9-6dd3202db25b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:10.216168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d043fdf-be17-43ac-8ea9-6dd3202db25b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:10.217560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d043fdf-be17-43ac-8ea9-6dd3202db25b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:10.229742 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 243/494] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:10.231071 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7ad8b-a6b2-4a87-99a5-957bf4f8cc99 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:10.231360 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7ad8b-a6b2-4a87-99a5-957bf4f8cc99 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:10.231701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7ad8b-a6b2-4a87-99a5-957bf4f8cc99 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:10.233094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 244/495] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:10.233693 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7ad8b-a6b2-4a87-99a5-957bf4f8cc99 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:10.260594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3671b1cd-d7e1-4921-8761-b3e6381f4e1c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:10.293738 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5716f1-cf00-4f7c-8e05-82f725a250de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:10.294393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5716f1-cf00-4f7c-8e05-82f725a250de None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:10.294681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5716f1-cf00-4f7c-8e05-82f725a250de None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:10.294960 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5716f1-cf00-4f7c-8e05-82f725a250de None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:10.295683 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5716f1-cf00-4f7c-8e05-82f725a250de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:10.296000 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5716f1-cf00-4f7c-8e05-82f725a250de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:10.297385 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5716f1-cf00-4f7c-8e05-82f725a250de None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:10.309582 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 252/496] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:10.310370 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5716f1-cf00-4f7c-8e05-82f725a250de None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:10.336074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac7ad8b-a6b2-4a87-99a5-957bf4f8cc99 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:10.369322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e7f0c-2396-444f-bfc3-063e4c6baa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:10.370007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e7f0c-2396-444f-bfc3-063e4c6baa53 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:10.370292 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e7f0c-2396-444f-bfc3-063e4c6baa53 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:10.370575 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e7f0c-2396-444f-bfc3-063e4c6baa53 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:10.371316 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e7f0c-2396-444f-bfc3-063e4c6baa53 None admin] RBAC: Adding query filter params (name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:10.371625 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e7f0c-2396-444f-bfc3-063e4c6baa53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:10.373038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e7f0c-2396-444f-bfc3-063e4c6baa53 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:10.380788 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 245/497] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jun 14 19:29:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:10.381972 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214633dc-ff88-4bfc-a9da-58f90bb1a1a9 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:10.382260 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214633dc-ff88-4bfc-a9da-58f90bb1a1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:10.382537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214633dc-ff88-4bfc-a9da-58f90bb1a1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:10.388692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:10.400984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-214633dc-ff88-4bfc-a9da-58f90bb1a1a9 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:10.402163 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-214633dc-ff88-4bfc-a9da-58f90bb1a1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:10.404824 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:10.411416 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5716f1-cf00-4f7c-8e05-82f725a250de None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:10.445015 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3f5af-9b6c-4f8f-9e26-c4d2141ecfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:10.445817 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3f5af-9b6c-4f8f-9e26-c4d2141ecfee None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:10.446098 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3f5af-9b6c-4f8f-9e26-c4d2141ecfee None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:10.446368 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3f5af-9b6c-4f8f-9e26-c4d2141ecfee None admin] PATH_INFO: `/v3/users/nova` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:10.457956 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3f5af-9b6c-4f8f-9e26-c4d2141ecfee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:10.459916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3f5af-9b6c-4f8f-9e26-c4d2141ecfee None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:10.470573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 246/498] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:10.472384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778355e-b47b-4989-b6b3-0708608e0a5c None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:10.472674 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778355e-b47b-4989-b6b3-0708608e0a5c None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:10.472954 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778355e-b47b-4989-b6b3-0708608e0a5c None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:10.474370 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 247/499] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:10.477283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-a2c3f5af-9b6c-4f8f-9e26-c4d2141ecfee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 19:29:10.477283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:10.477283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:10.477283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:10.477283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:10.477283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:10.477283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:10.477283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:10.477283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:10.477283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:10.477283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:10.477283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:10.477283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:10.477283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:10.477283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:10.477283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:10.478175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:10.478175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:10.478175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:10.478175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:10.478175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:10.478175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:10.478175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:10.478175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:10.478175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:10.478175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:10.478175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:10.478175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:10.478175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:10.478175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:10.478175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:10.478175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:10.478175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:10.478175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:10.479062 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:10.479062 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:10.479062 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:10.479062 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:10.479062 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:10.479062 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:10.479062 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:10.479062 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:10.479062 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 19:29:10.479062 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:10.479574 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778355e-b47b-4989-b6b3-0708608e0a5c None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:10.480419 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 253/500] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jun 14 19:29:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:10.481454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3f5af-9b6c-4f8f-9e26-c4d2141ecfee None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:10.579733 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778355e-b47b-4989-b6b3-0708608e0a5c None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:10.586966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3f5af-9b6c-4f8f-9e26-c4d2141ecfee None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:10.609405 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:10.614577 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cfe20-de27-424c-8ca3-0be1b006966e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:10.615451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cfe20-de27-424c-8ca3-0be1b006966e None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:10.615740 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cfe20-de27-424c-8ca3-0be1b006966e None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:10.616014 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cfe20-de27-424c-8ca3-0be1b006966e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:10.620793 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9274e91-58b8-4701-88f4-3653de9b0f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:10.621600 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9274e91-58b8-4701-88f4-3653de9b0f41 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:10.621885 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9274e91-58b8-4701-88f4-3653de9b0f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:10.622160 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9274e91-58b8-4701-88f4-3653de9b0f41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:10.623323 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cfe20-de27-424c-8ca3-0be1b006966e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:10.624717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cfe20-de27-424c-8ca3-0be1b006966e None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:10.632532 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9274e91-58b8-4701-88f4-3653de9b0f41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:10.634011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9274e91-58b8-4701-88f4-3653de9b0f41 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:10.640451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-b12cfe20-de27-424c-8ca3-0be1b006966e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 14 19:29:10.640451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:10.640451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:10.640451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:10.640451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:10.640451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:10.640451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:10.640451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:10.640451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:10.640451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:10.640451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:10.640451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:10.640451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:10.640451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:10.640451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:10.640451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:10.641306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:10.641306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:10.641306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:10.641306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:10.641306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:10.641306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:10.641306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:10.641306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:10.641306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:10.641306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:10.641306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:10.641306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:10.641306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:10.641306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:10.641306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:10.641306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:10.641306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:10.641306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:10.642229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:10.642229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:10.642229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:10.642229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:10.642229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:10.642229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:10.642229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:10.642229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:10.642229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 14 19:29:10.642229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:10.642229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 248/501] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:29:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:10.642798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e68121-297d-4227-bdb7-0326660386a3 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:10.643319 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e68121-297d-4227-bdb7-0326660386a3 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:10.643412 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e68121-297d-4227-bdb7-0326660386a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:10.652606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-b9274e91-58b8-4701-88f4-3653de9b0f41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:10.652606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:10.652606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:10.652606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:10.652606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:10.652606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:10.652606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:10.652606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:10.652606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:10.652606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:10.652606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:10.652606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:10.652606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:10.652606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:10.652606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:10.653474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:10.653474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:10.653474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:10.653474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:10.653474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:10.653474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:10.653474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:10.653474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:10.653474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:10.653474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:10.653474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:10.653474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:10.653474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:10.653474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:10.653474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:10.653474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:10.653474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:10.655028 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:10.655028 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:10.655028 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:10.655028 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:10.655028 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 254/502] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:10.655028 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9274e91-58b8-4701-88f4-3653de9b0f41 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:10.661687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-c1e68121-297d-4227-bdb7-0326660386a3 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:10.662881 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c1e68121-297d-4227-bdb7-0326660386a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:10.667862 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:10.729655 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 249/503] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:10.730481 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e68121-297d-4227-bdb7-0326660386a3 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:10.760658 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9274e91-58b8-4701-88f4-3653de9b0f41 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:10.794195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b16f9-00ee-4f60-8612-b2231a79e7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:10.794856 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b16f9-00ee-4f60-8612-b2231a79e7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:10.795138 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b16f9-00ee-4f60-8612-b2231a79e7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:10.795416 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b16f9-00ee-4f60-8612-b2231a79e7d2 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:10.796239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b16f9-00ee-4f60-8612-b2231a79e7d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:10.796926 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b16f9-00ee-4f60-8612-b2231a79e7d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:10.797992 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b16f9-00ee-4f60-8612-b2231a79e7d2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:10.834228 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 255/504] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jun 14 19:29:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:10.835054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b16f9-00ee-4f60-8612-b2231a79e7d2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:10.835159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e68121-297d-4227-bdb7-0326660386a3 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:10.860899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:10.873543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d83df8-725a-4eb2-9272-7c97b6191ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:10.874269 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d83df8-725a-4eb2-9272-7c97b6191ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:10.874550 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d83df8-725a-4eb2-9272-7c97b6191ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:10.874827 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d83df8-725a-4eb2-9272-7c97b6191ff5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:10.884839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d83df8-725a-4eb2-9272-7c97b6191ff5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:10.892584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-a4d83df8-725a-4eb2-9272-7c97b6191ff5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:10.892584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:10.892584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:10.892584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:10.892584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:10.892584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:10.892584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:10.892584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:10.892584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:10.892584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:10.892584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:10.892584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:10.892584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:10.892584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:10.892584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:10.892584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:10.894340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:10.894340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:10.894340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:10.894340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:10.894340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:10.894340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:10.894340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:10.894340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:10.894340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:10.894340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:10.894340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:10.894340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:10.894340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:10.894340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:10.894340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:10.894340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:10.895271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:10.895271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:10.895271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:10.895271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:10.895271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:10.895271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:10.895271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:10.895271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:10.895271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:10.895271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:10.895271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:10.895271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:10.895271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 250/505] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:29:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:10.895271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d83df8-725a-4eb2-9272-7c97b6191ff5 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:10.905079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:10.940806 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b16f9-00ee-4f60-8612-b2231a79e7d2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:10.974631 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75fff8-4179-4972-9135-b9c5a170d2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:10.975287 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75fff8-4179-4972-9135-b9c5a170d2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:10.975564 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75fff8-4179-4972-9135-b9c5a170d2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:10.975833 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75fff8-4179-4972-9135-b9c5a170d2f4 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:10.976657 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75fff8-4179-4972-9135-b9c5a170d2f4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:10.976960 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75fff8-4179-4972-9135-b9c5a170d2f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:10.978442 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75fff8-4179-4972-9135-b9c5a170d2f4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:10.994718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d83df8-725a-4eb2-9272-7c97b6191ff5 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:10.995115 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 256/506] 10.222.0.44 () {56 vars in 1137 bytes} [Tue Jun 14 19:29:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:10.995115 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75fff8-4179-4972-9135-b9c5a170d2f4 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:11.028720 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752cdba-731e-4b51-80b5-8e68f5d448bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:11.029393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752cdba-731e-4b51-80b5-8e68f5d448bf None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:11.029692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752cdba-731e-4b51-80b5-8e68f5d448bf None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:11.029970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752cdba-731e-4b51-80b5-8e68f5d448bf None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:11.030693 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752cdba-731e-4b51-80b5-8e68f5d448bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:11.031000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752cdba-731e-4b51-80b5-8e68f5d448bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:11.032383 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752cdba-731e-4b51-80b5-8e68f5d448bf None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:11.044486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 251/507] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:11.045268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752cdba-731e-4b51-80b5-8e68f5d448bf None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:11.091671 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:11.100121 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75fff8-4179-4972-9135-b9c5a170d2f4 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:11.122901 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:11.134324 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddca158-a233-4909-be28-8c88ccfbbb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:11.135027 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddca158-a233-4909-be28-8c88ccfbbb9b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:11.135305 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddca158-a233-4909-be28-8c88ccfbbb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:11.135575 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddca158-a233-4909-be28-8c88ccfbbb9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:11.148175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddca158-a233-4909-be28-8c88ccfbbb9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:11.149660 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddca158-a233-4909-be28-8c88ccfbbb9b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:11.150804 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752cdba-731e-4b51-80b5-8e68f5d448bf None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:11.166753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-6ddca158-a233-4909-be28-8c88ccfbbb9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:11.166753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:11.166753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:11.166753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:11.166753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:11.166753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:11.166753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:11.166753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:11.166753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:11.166753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:11.166753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:11.166753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:11.166753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:11.166753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:11.166753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:11.167567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:11.167567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:11.167567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:11.167567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:11.167567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:11.167567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:11.167567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:11.167567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:11.167567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:11.167567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:11.167567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:11.167567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:11.167567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:11.167567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:11.167567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:11.167567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:11.167567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:11.168388 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:11.168388 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:11.168388 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:11.168388 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:11.168388 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 257/508] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:11.169583 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddca158-a233-4909-be28-8c88ccfbbb9b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:11.185157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8cbad-a4cc-4b1e-8156-c980c8182885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:11.185828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8cbad-a4cc-4b1e-8156-c980c8182885 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:11.186108 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8cbad-a4cc-4b1e-8156-c980c8182885 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:11.186379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad8cbad-a4cc-4b1e-8156-c980c8182885 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:11.255004 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8cbad-a4cc-4b1e-8156-c980c8182885 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:11.256443 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad8cbad-a4cc-4b1e-8156-c980c8182885 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:11.266404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddca158-a233-4909-be28-8c88ccfbbb9b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:11.297293 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:11.299053 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20c342-33fd-4ebd-a4d0-0205d8c0c806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:11.300282 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20c342-33fd-4ebd-a4d0-0205d8c0c806 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:11.300567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20c342-33fd-4ebd-a4d0-0205d8c0c806 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:11.300926 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20c342-33fd-4ebd-a4d0-0205d8c0c806 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:11.301892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20c342-33fd-4ebd-a4d0-0205d8c0c806 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:11.302452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20c342-33fd-4ebd-a4d0-0205d8c0c806 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:11.303917 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e20c342-33fd-4ebd-a4d0-0205d8c0c806 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:11.317077 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 258/509] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jun 14 19:29:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:11.317077 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20c342-33fd-4ebd-a4d0-0205d8c0c806 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:11.351304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:11.363460 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 252/510] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:29:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:29:11.364277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8cbad-a4cc-4b1e-8156-c980c8182885 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:11.412007 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20c342-33fd-4ebd-a4d0-0205d8c0c806 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:11.445794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc49f39-1e2b-4412-bba3-58ec32ef24b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:11.446433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc49f39-1e2b-4412-bba3-58ec32ef24b9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:11.446720 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc49f39-1e2b-4412-bba3-58ec32ef24b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:11.446998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc49f39-1e2b-4412-bba3-58ec32ef24b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:11.462552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad8cbad-a4cc-4b1e-8156-c980c8182885 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:11.496501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19da4b-7943-40b0-8828-1d590e0090d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:11.497322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19da4b-7943-40b0-8828-1d590e0090d3 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:11.497658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19da4b-7943-40b0-8828-1d590e0090d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:11.497940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19da4b-7943-40b0-8828-1d590e0090d3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:11.505671 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19da4b-7943-40b0-8828-1d590e0090d3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:11.507125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19da4b-7943-40b0-8828-1d590e0090d3 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:11.521642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-7a19da4b-7943-40b0-8828-1d590e0090d3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 19:29:11.521642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:11.521642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:11.521642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:11.521642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:11.521642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:11.521642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:11.521642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:11.521642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:11.521642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:11.521642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:11.521642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:11.521642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:11.521642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:11.521642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:11.521642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:11.522691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:11.522691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:11.522691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:11.522691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:11.522691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:11.522691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:11.522691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:11.522691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:11.522691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:11.522691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:11.522691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:11.522691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:11.522691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:11.522691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:11.522691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:11.522691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:11.522691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:11.522691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:11.528505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:11.528505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:11.528505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:11.528505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:11.528505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:11.528505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:11.528505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:11.528505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:11.528505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 19:29:11.528505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:11.528505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 253/511] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:29:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:11.528505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19da4b-7943-40b0-8828-1d590e0090d3 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:11.529231 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc49f39-1e2b-4412-bba3-58ec32ef24b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:11.529330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:11.529419 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc49f39-1e2b-4412-bba3-58ec32ef24b9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:11.567548 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:11.623724 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19da4b-7943-40b0-8828-1d590e0090d3 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:11.629403 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 259/512] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:29:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:29:11.630229 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc49f39-1e2b-4412-bba3-58ec32ef24b9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:11.662686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004b13d-a9ab-41c8-b1a3-71cd2f6fd001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:11.663274 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004b13d-a9ab-41c8-b1a3-71cd2f6fd001 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:11.663559 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004b13d-a9ab-41c8-b1a3-71cd2f6fd001 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:11.663841 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004b13d-a9ab-41c8-b1a3-71cd2f6fd001 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:11.664565 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004b13d-a9ab-41c8-b1a3-71cd2f6fd001 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:11.664873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004b13d-a9ab-41c8-b1a3-71cd2f6fd001 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:11.666566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004b13d-a9ab-41c8-b1a3-71cd2f6fd001 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:11.678234 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 254/513] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:11.679026 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004b13d-a9ab-41c8-b1a3-71cd2f6fd001 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:11.732885 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc49f39-1e2b-4412-bba3-58ec32ef24b9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:11.739024 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:11.769505 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e6514-afd9-4aef-bd6d-0d45beee7165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:11.770296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e6514-afd9-4aef-bd6d-0d45beee7165 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:11.770604 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e6514-afd9-4aef-bd6d-0d45beee7165 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:11.770908 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e6514-afd9-4aef-bd6d-0d45beee7165 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:11.777526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:11.778837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004b13d-a9ab-41c8-b1a3-71cd2f6fd001 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:11.782758 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e6514-afd9-4aef-bd6d-0d45beee7165 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:11.784392 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e6514-afd9-4aef-bd6d-0d45beee7165 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:11.801854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-000e6514-afd9-4aef-bd6d-0d45beee7165 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:11.801854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:11.801854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:11.801854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:11.801854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:11.801854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:11.801854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:11.801854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:11.801854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:11.801854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:11.801854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:11.801854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:11.801854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:11.801854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:11.801854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:11.802828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:11.802828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:11.802828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:11.802828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:11.802828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:11.802828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:11.802828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:11.802828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:11.802828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:11.802828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:11.802828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:11.802828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:11.802828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:11.802828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:11.802828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:11.802828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:11.802828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:11.803795 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:11.803795 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:11.803795 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:11.803795 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:11.803795 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 260/514] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:11.804217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e6514-afd9-4aef-bd6d-0d45beee7165 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:11.821518 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486acb55-d074-4774-ad25-593cdf83e5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:11.822321 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486acb55-d074-4774-ad25-593cdf83e5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:11.822606 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486acb55-d074-4774-ad25-593cdf83e5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:11.822884 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486acb55-d074-4774-ad25-593cdf83e5d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:11.834521 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486acb55-d074-4774-ad25-593cdf83e5d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:11.835960 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486acb55-d074-4774-ad25-593cdf83e5d5 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:11.852706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-486acb55-d074-4774-ad25-593cdf83e5d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:11.852706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:11.852706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:11.852706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:11.852706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:11.852706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:11.852706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:11.852706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:11.852706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:11.852706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:11.852706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:11.852706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:11.852706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:11.852706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:11.852706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:11.853633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:11.853633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:11.853633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:11.853633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:11.853633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:11.853633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:11.853633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:11.853633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:11.853633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:11.853633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:11.853633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:11.853633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:11.853633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:11.853633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:11.853633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:11.853633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:11.853633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:11.854480 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:11.854480 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:11.854480 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:11.854480 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:11.854480 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 255/515] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:11.854729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486acb55-d074-4774-ad25-593cdf83e5d5 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:11.907643 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e6514-afd9-4aef-bd6d-0d45beee7165 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:11.940949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea9d32-aa3a-430e-a001-c8bb74076e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:11.941625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea9d32-aa3a-430e-a001-c8bb74076e0f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:11.941910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea9d32-aa3a-430e-a001-c8bb74076e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:11.942184 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea9d32-aa3a-430e-a001-c8bb74076e0f None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:11.943014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea9d32-aa3a-430e-a001-c8bb74076e0f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:11.943324 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea9d32-aa3a-430e-a001-c8bb74076e0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:11.944770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea9d32-aa3a-430e-a001-c8bb74076e0f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:11.952094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486acb55-d074-4774-ad25-593cdf83e5d5 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:11.961813 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 261/516] 10.222.0.44 () {56 vars in 1137 bytes} [Tue Jun 14 19:29:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:11.962593 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea9d32-aa3a-430e-a001-c8bb74076e0f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:11.968848 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:11.990721 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84158bf0-cc7e-43fb-b756-dcaacaf40d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:11.991642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84158bf0-cc7e-43fb-b756-dcaacaf40d12 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:11.991988 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84158bf0-cc7e-43fb-b756-dcaacaf40d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:11.992366 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84158bf0-cc7e-43fb-b756-dcaacaf40d12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:12.002699 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84158bf0-cc7e-43fb-b756-dcaacaf40d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:12.004326 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84158bf0-cc7e-43fb-b756-dcaacaf40d12 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:12.010358 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:12.021623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-84158bf0-cc7e-43fb-b756-dcaacaf40d12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:12.021623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:12.021623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:12.021623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:12.021623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:12.021623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:12.021623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:12.021623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:12.021623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:12.021623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:12.021623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:12.021623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:12.021623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:12.021623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:12.021623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:12.022465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:12.022465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:12.022465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:12.022465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:12.022465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:12.022465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:12.022465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:12.022465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:12.022465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:12.022465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:12.022465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:12.022465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:12.022465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:12.022465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:12.022465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:12.022465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:12.022465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:12.023306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:12.023306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:12.023306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:12.023306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:12.025652 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 256/517] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:12.026384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84158bf0-cc7e-43fb-b756-dcaacaf40d12 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:12.061451 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea9d32-aa3a-430e-a001-c8bb74076e0f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:12.094979 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a5b76-6387-4bbf-880f-9e0dd5072c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:12.095644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a5b76-6387-4bbf-880f-9e0dd5072c9d None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:12.095929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a5b76-6387-4bbf-880f-9e0dd5072c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:12.096207 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a5b76-6387-4bbf-880f-9e0dd5072c9d None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:12.097529 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a5b76-6387-4bbf-880f-9e0dd5072c9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:12.098968 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a5b76-6387-4bbf-880f-9e0dd5072c9d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:12.117966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 262/518] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jun 14 19:29:11 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:29:12.118820 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a5b76-6387-4bbf-880f-9e0dd5072c9d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:12.127079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84158bf0-cc7e-43fb-b756-dcaacaf40d12 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:12.168414 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d23f7e-44c0-41ce-b6dd-9b7e600e9a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:12.169089 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d23f7e-44c0-41ce-b6dd-9b7e600e9a89 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:12.169543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d23f7e-44c0-41ce-b6dd-9b7e600e9a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:12.169821 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d23f7e-44c0-41ce-b6dd-9b7e600e9a89 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:12.170780 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d23f7e-44c0-41ce-b6dd-9b7e600e9a89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:12.171086 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d23f7e-44c0-41ce-b6dd-9b7e600e9a89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:12.172573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d23f7e-44c0-41ce-b6dd-9b7e600e9a89 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:12.193305 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 257/519] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:12.194441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d23f7e-44c0-41ce-b6dd-9b7e600e9a89 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:12.227003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:12.249194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a5b76-6387-4bbf-880f-9e0dd5072c9d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:12.251929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:12.292968 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be7296-3cb8-4677-bf9d-4cec7636fc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:12.293648 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be7296-3cb8-4677-bf9d-4cec7636fc51 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:12.294585 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be7296-3cb8-4677-bf9d-4cec7636fc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:12.294585 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be7296-3cb8-4677-bf9d-4cec7636fc51 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:12.294897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be7296-3cb8-4677-bf9d-4cec7636fc51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:12.295195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be7296-3cb8-4677-bf9d-4cec7636fc51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:12.296567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be7296-3cb8-4677-bf9d-4cec7636fc51 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:12.308760 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 263/520] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:12.309519 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be7296-3cb8-4677-bf9d-4cec7636fc51 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:12.317104 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d23f7e-44c0-41ce-b6dd-9b7e600e9a89 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:12.357334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7da418-91a4-4c78-92d8-20ce6eb3eb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:12.358034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7da418-91a4-4c78-92d8-20ce6eb3eb1c None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:12.358314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7da418-91a4-4c78-92d8-20ce6eb3eb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:12.358588 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7da418-91a4-4c78-92d8-20ce6eb3eb1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:12.422918 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be7296-3cb8-4677-bf9d-4cec7636fc51 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:12.437812 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7da418-91a4-4c78-92d8-20ce6eb3eb1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:12.439251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7da418-91a4-4c78-92d8-20ce6eb3eb1c None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:12.462316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19700b-ee55-495d-9cc4-4d85652a7e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:12.462914 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19700b-ee55-495d-9cc4-4d85652a7e7c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:12.463198 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19700b-ee55-495d-9cc4-4d85652a7e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:12.463482 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19700b-ee55-495d-9cc4-4d85652a7e7c None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:12.464203 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19700b-ee55-495d-9cc4-4d85652a7e7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:12.464513 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19700b-ee55-495d-9cc4-4d85652a7e7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:12.465938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19700b-ee55-495d-9cc4-4d85652a7e7c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:12.470017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:12.478335 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 264/521] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:12.479162 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19700b-ee55-495d-9cc4-4d85652a7e7c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:12.508119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:12.561995 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 258/522] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:29:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:29:12.561995 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7da418-91a4-4c78-92d8-20ce6eb3eb1c None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:12.590068 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19700b-ee55-495d-9cc4-4d85652a7e7c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:12.624817 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058409b-b532-4184-b9dc-e2bd84d6ca75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:12.625641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058409b-b532-4184-b9dc-e2bd84d6ca75 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:12.625930 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058409b-b532-4184-b9dc-e2bd84d6ca75 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:12.626223 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1058409b-b532-4184-b9dc-e2bd84d6ca75 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:12.634153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058409b-b532-4184-b9dc-e2bd84d6ca75 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:12.635500 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1058409b-b532-4184-b9dc-e2bd84d6ca75 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:12.651617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-1058409b-b532-4184-b9dc-e2bd84d6ca75 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 14 19:29:12.651617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:12.651617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:12.651617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:12.651617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:12.651617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:12.651617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:12.651617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:12.651617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:12.651617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:12.651617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:12.651617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:12.651617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:12.651617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:12.651617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:12.651617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:12.652518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:12.652518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:12.652518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:12.652518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:12.652518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:12.652518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:12.652518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:12.652518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:12.652518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:12.652518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:12.652518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:12.652518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:12.652518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:12.652518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:12.652518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:12.652518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:12.652518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:12.652518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:12.653407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:12.653407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:12.653407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:12.653407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:12.653407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:12.653407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:12.653407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:12.653407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:12.653407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 14 19:29:12.653407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:12.653407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 265/523] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:29:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:12.653963 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058409b-b532-4184-b9dc-e2bd84d6ca75 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:12.676049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7da418-91a4-4c78-92d8-20ce6eb3eb1c None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:12.703297 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:12.714200 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2592c-7e5d-44b5-81b5-2462f22baed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:12.714928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2592c-7e5d-44b5-81b5-2462f22baed4 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:12.715220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2592c-7e5d-44b5-81b5-2462f22baed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:12.715507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2592c-7e5d-44b5-81b5-2462f22baed4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:12.722883 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2592c-7e5d-44b5-81b5-2462f22baed4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:12.724331 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2592c-7e5d-44b5-81b5-2462f22baed4 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:12.739060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-96d2592c-7e5d-44b5-81b5-2462f22baed4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:12.739060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:12.739060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:12.739060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:12.739060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:12.739060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:12.739060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:12.739060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:12.739060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:12.739060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:12.739060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:12.739060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:12.739060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:12.739060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:12.739060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:12.739930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:12.739930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:12.739930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:12.739930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:12.739930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:12.739930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:12.739930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:12.739930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:12.739930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:12.739930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:12.739930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:12.739930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:12.739930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:12.739930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:12.739930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:12.739930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:12.739930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:12.740779 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:12.740779 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:12.740779 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:12.740779 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:12.740779 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:12.740779 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:12.740779 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:12.740779 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:12.740779 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 259/524] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:12.741263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2592c-7e5d-44b5-81b5-2462f22baed4 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:12.749051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:12.767321 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1058409b-b532-4184-b9dc-e2bd84d6ca75 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:12.803923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6fdb9-cf62-4e91-8665-2d1b4b711a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:12.804706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6fdb9-cf62-4e91-8665-2d1b4b711a03 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:12.804986 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6fdb9-cf62-4e91-8665-2d1b4b711a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:12.805255 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6fdb9-cf62-4e91-8665-2d1b4b711a03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:12.813866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6fdb9-cf62-4e91-8665-2d1b4b711a03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:12.815941 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6fdb9-cf62-4e91-8665-2d1b4b711a03 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:12.839039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-f4e6fdb9-cf62-4e91-8665-2d1b4b711a03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:12.839039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:12.839039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:12.839039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:12.839039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:12.839039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:12.839039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:12.839039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:12.839039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:12.839039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:12.839039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:12.839039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:12.839039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:12.839039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:12.839039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:12.839929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:12.839929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:12.839929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:12.839929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:12.839929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:12.839929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:12.839929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:12.839929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:12.839929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:12.839929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:12.839929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:12.839929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:12.839929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:12.839929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:12.839929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:12.839929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:12.839929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:12.840750 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:12.840750 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:12.840750 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:12.840750 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:12.840750 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:12.840750 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:12.840750 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:12.840750 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:12.840750 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 266/525] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:12.841208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6fdb9-cf62-4e91-8665-2d1b4b711a03 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:12.858648 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2592c-7e5d-44b5-81b5-2462f22baed4 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:12.896696 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f5f51-7590-4d71-862a-d111beef100d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:12.897524 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f5f51-7590-4d71-862a-d111beef100d None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:12.897810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f5f51-7590-4d71-862a-d111beef100d None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:12.898086 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f5f51-7590-4d71-862a-d111beef100d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:12.909092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f5f51-7590-4d71-862a-d111beef100d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:12.910682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f5f51-7590-4d71-862a-d111beef100d None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:12.930301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-ed8f5f51-7590-4d71-862a-d111beef100d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:12.930301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:12.930301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:12.930301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:12.930301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:12.930301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:12.930301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:12.930301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:12.930301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:12.930301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:12.930301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:12.930301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:12.930301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:12.930301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:12.930301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:12.931180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:12.931180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:12.931180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:12.931180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:12.931180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:12.931180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:12.931180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:12.931180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:12.931180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:12.931180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:12.931180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:12.931180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:12.931180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:12.931180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:12.931180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:12.931180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:12.931180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:12.937460 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:12.937460 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:12.937460 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:12.937460 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:12.937460 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 260/526] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:12.937460 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f5f51-7590-4d71-862a-d111beef100d None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:12.950826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6fdb9-cf62-4e91-8665-2d1b4b711a03 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:12.978380 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:12.986330 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015bf1c-cea3-4e29-94f0-27911c535b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:12.987599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015bf1c-cea3-4e29-94f0-27911c535b9d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:12.988046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015bf1c-cea3-4e29-94f0-27911c535b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:12.988399 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015bf1c-cea3-4e29-94f0-27911c535b9d None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:12.989230 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015bf1c-cea3-4e29-94f0-27911c535b9d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:12.989572 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015bf1c-cea3-4e29-94f0-27911c535b9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:12.991005 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5015bf1c-cea3-4e29-94f0-27911c535b9d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:13.010016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 267/527] 10.222.0.44 () {56 vars in 1139 bytes} [Tue Jun 14 19:29:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:13.015152 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015bf1c-cea3-4e29-94f0-27911c535b9d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:13.017874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:13.046493 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f5f51-7590-4d71-862a-d111beef100d None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:13.082641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34838e-dc09-402a-9693-128c2703291f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:13.083298 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34838e-dc09-402a-9693-128c2703291f None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:13.083588 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34838e-dc09-402a-9693-128c2703291f None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:13.083875 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34838e-dc09-402a-9693-128c2703291f None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:13.084659 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34838e-dc09-402a-9693-128c2703291f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:13.084974 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34838e-dc09-402a-9693-128c2703291f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:13.086447 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34838e-dc09-402a-9693-128c2703291f None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:13.108502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 261/528] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:13.108502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34838e-dc09-402a-9693-128c2703291f None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:13.130949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015bf1c-cea3-4e29-94f0-27911c535b9d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:13.166561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76e84a-429b-4ade-85e3-137b4dcfeffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:13.167221 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76e84a-429b-4ade-85e3-137b4dcfeffc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:13.167505 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76e84a-429b-4ade-85e3-137b4dcfeffc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:13.167813 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76e84a-429b-4ade-85e3-137b4dcfeffc None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:13.168557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76e84a-429b-4ade-85e3-137b4dcfeffc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:13.168867 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76e84a-429b-4ade-85e3-137b4dcfeffc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:13.170328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f76e84a-429b-4ade-85e3-137b4dcfeffc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:13.188650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 268/529] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:13.194269 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76e84a-429b-4ade-85e3-137b4dcfeffc None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:13.208942 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:13.212873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34838e-dc09-402a-9693-128c2703291f None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:13.251286 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2c360-4179-402f-b71a-3143c7bf8d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:13.251872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2c360-4179-402f-b71a-3143c7bf8d42 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:13.252157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2c360-4179-402f-b71a-3143c7bf8d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:13.252432 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2c360-4179-402f-b71a-3143c7bf8d42 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:13.253648 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2c360-4179-402f-b71a-3143c7bf8d42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:13.254046 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2c360-4179-402f-b71a-3143c7bf8d42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:13.255482 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2c360-4179-402f-b71a-3143c7bf8d42 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:13.262577 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:13.272837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 262/530] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:13.272837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2c360-4179-402f-b71a-3143c7bf8d42 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:13.313702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76e84a-429b-4ade-85e3-137b4dcfeffc None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:13.367605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11621f7d-1338-4dd4-8720-6ea205a204f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:13.368516 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11621f7d-1338-4dd4-8720-6ea205a204f0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:13.368842 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11621f7d-1338-4dd4-8720-6ea205a204f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:13.369292 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11621f7d-1338-4dd4-8720-6ea205a204f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:13.405787 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2c360-4179-402f-b71a-3143c7bf8d42 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:13.443655 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd0ac2-6562-44e7-8f10-3e040ce777a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:13.444300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd0ac2-6562-44e7-8f10-3e040ce777a5 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:13.444585 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd0ac2-6562-44e7-8f10-3e040ce777a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:13.444863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd0ac2-6562-44e7-8f10-3e040ce777a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:13.445729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd0ac2-6562-44e7-8f10-3e040ce777a5 None admin] RBAC: Adding query filter params (role.id=539442ef092c4fcf9e1d0be045928c5a, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=37c521e20aea4cad9758568a4f082fbd) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:13.446043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd0ac2-6562-44e7-8f10-3e040ce777a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:13.447478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd0ac2-6562-44e7-8f10-3e040ce777a5 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:13.453209 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 263/531] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:29:13 2022] GET /identity/v3/role_assignments?user.id=37c521e20aea4cad9758568a4f082fbd&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=539442ef092c4fcf9e1d0be045928c5a => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:13.454046 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd0ac2-6562-44e7-8f10-3e040ce777a5 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:13.463365 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11621f7d-1338-4dd4-8720-6ea205a204f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:13.464981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11621f7d-1338-4dd4-8720-6ea205a204f0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:13.486416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:13.559315 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:13.587136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd0ac2-6562-44e7-8f10-3e040ce777a5 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:13.613785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 269/532] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:29:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:29:13.614848 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11621f7d-1338-4dd4-8720-6ea205a204f0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:13.636826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8257782-6362-44bc-84db-06ad0c7084cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:13.637706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8257782-6362-44bc-84db-06ad0c7084cb None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:13.637997 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8257782-6362-44bc-84db-06ad0c7084cb None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:13.638281 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8257782-6362-44bc-84db-06ad0c7084cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:13.639544 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8257782-6362-44bc-84db-06ad0c7084cb None admin] RBAC: Adding query filter params (role.id=539442ef092c4fcf9e1d0be045928c5a, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=caa134b748854fb3b4de54b04390eec9) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:13.639544 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8257782-6362-44bc-84db-06ad0c7084cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:13.641469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8257782-6362-44bc-84db-06ad0c7084cb None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:13.650452 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 264/533] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:29:13 2022] GET /identity/v3/role_assignments?user.id=caa134b748854fb3b4de54b04390eec9&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=539442ef092c4fcf9e1d0be045928c5a => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:13.651169 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8257782-6362-44bc-84db-06ad0c7084cb None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:13.756439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11621f7d-1338-4dd4-8720-6ea205a204f0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:13.773790 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:13.788501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8257782-6362-44bc-84db-06ad0c7084cb None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:13.832765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b3e85-5ac8-4a2d-b71c-afc8c5b97850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:13.833716 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b3e85-5ac8-4a2d-b71c-afc8c5b97850 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:13.834067 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b3e85-5ac8-4a2d-b71c-afc8c5b97850 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:13.834583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b3e85-5ac8-4a2d-b71c-afc8c5b97850 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:13.846652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2021a-5af6-48b5-97b1-fefaa0bb5fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:13.847654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2021a-5af6-48b5-97b1-fefaa0bb5fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:13.848104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2021a-5af6-48b5-97b1-fefaa0bb5fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:13.848659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2021a-5af6-48b5-97b1-fefaa0bb5fc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:13.848843 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b3e85-5ac8-4a2d-b71c-afc8c5b97850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:13.850614 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b3e85-5ac8-4a2d-b71c-afc8c5b97850 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:13.856519 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2021a-5af6-48b5-97b1-fefaa0bb5fc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:13.858236 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2021a-5af6-48b5-97b1-fefaa0bb5fc8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:13.873139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-02c2021a-5af6-48b5-97b1-fefaa0bb5fc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:13.873139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:13.873139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:13.873139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:13.873139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:13.873139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:13.873139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:13.873139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:13.873139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:13.873139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:13.873139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:13.873139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:13.873139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:13.873139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:13.873139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:13.874014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:13.874014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:13.874014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:13.874014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:13.874014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:13.874014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:13.874014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:13.874014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:13.874014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:13.874014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:13.874014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:13.874014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:13.874014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:13.874014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:13.874014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:13.874014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:13.874014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:13.874834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:13.874834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:13.874834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:13.874834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:13.874834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:13.874834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:13.874834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:13.874834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:13.875223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-560b3e85-5ac8-4a2d-b71c-afc8c5b97850 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:13.875223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:13.875223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:13.875223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:13.875223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:13.875223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:13.875223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:13.875223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:13.875223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:13.875223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:13.875223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:13.875223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:13.875223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:13.875223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:13.875223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:13.875934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:13.875934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:13.875934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:13.875934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:13.875934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:13.875934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:13.875934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:13.875934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:13.875934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:13.875934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:13.875934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:13.875934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:13.875934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:13.875934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:13.875934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:13.875934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:13.875934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:13.876747 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:13.876747 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:13.876747 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:13.876747 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:13.876747 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 265/534] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:13.880147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 270/535] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:13.883903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b3e85-5ac8-4a2d-b71c-afc8c5b97850 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:13.886026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2021a-5af6-48b5-97b1-fefaa0bb5fc8 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:13.921445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:14.051933 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2021a-5af6-48b5-97b1-fefaa0bb5fc8 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:14.053415 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b3e85-5ac8-4a2d-b71c-afc8c5b97850 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:14.109003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f6f9b-28ef-4a83-bbf9-ccf3fb669fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:14.109903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb49229-821b-44d1-8034-61cd903d57c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:14.110759 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb49229-821b-44d1-8034-61cd903d57c0 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:14.111212 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb49229-821b-44d1-8034-61cd903d57c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:14.111680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb49229-821b-44d1-8034-61cd903d57c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:14.113056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f6f9b-28ef-4a83-bbf9-ccf3fb669fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:14.114085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb49229-821b-44d1-8034-61cd903d57c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:14.114566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb49229-821b-44d1-8034-61cd903d57c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:14.115008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f6f9b-28ef-4a83-bbf9-ccf3fb669fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:14.116579 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb49229-821b-44d1-8034-61cd903d57c0 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:14.117058 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62f6f9b-28ef-4a83-bbf9-ccf3fb669fc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:14.118057 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f6f9b-28ef-4a83-bbf9-ccf3fb669fc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:14.118538 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f6f9b-28ef-4a83-bbf9-ccf3fb669fc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:14.120172 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62f6f9b-28ef-4a83-bbf9-ccf3fb669fc0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:14.129409 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:14.131836 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 266/536] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:14.139195 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb49229-821b-44d1-8034-61cd903d57c0 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:14.152856 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 271/537] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:14.159397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f6f9b-28ef-4a83-bbf9-ccf3fb669fc0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:14.285637 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:14.305156 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb49229-821b-44d1-8034-61cd903d57c0 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:14.344916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62f6f9b-28ef-4a83-bbf9-ccf3fb669fc0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:14.348392 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc827de2-9afa-49e1-abe2-25776e4d99e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:14.349203 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc827de2-9afa-49e1-abe2-25776e4d99e9 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:14.349513 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc827de2-9afa-49e1-abe2-25776e4d99e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:14.349794 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc827de2-9afa-49e1-abe2-25776e4d99e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:14.366766 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc827de2-9afa-49e1-abe2-25776e4d99e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:14.368155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc827de2-9afa-49e1-abe2-25776e4d99e9 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:14.387379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-cc827de2-9afa-49e1-abe2-25776e4d99e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:14.387379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:14.387379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:14.387379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:14.387379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:14.387379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:14.387379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:14.387379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:14.387379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:14.387379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:14.387379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:14.387379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:14.387379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:14.387379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:14.387379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:14.388252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:14.388252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:14.388252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:14.388252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:14.388252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:14.388252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:14.388252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:14.388252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:14.388252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:14.388252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:14.388252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:14.388252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:14.388252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:14.388252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:14.388252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:14.388252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:14.388252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:14.389048 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:14.389048 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:14.389048 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:14.389048 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:14.389048 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:14.389048 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:14.389048 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:14.389048 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:14.389756 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 267/538] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:14.391039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde47ae8-295f-4eaf-ab77-096b5f417a0a None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:14.391491 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde47ae8-295f-4eaf-ab77-096b5f417a0a None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:14.391772 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde47ae8-295f-4eaf-ab77-096b5f417a0a None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:14.397469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 268/539] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:14.398264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde47ae8-295f-4eaf-ab77-096b5f417a0a None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:14.400097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c64d74c-8b43-491a-8133-0d19f04e7d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:14.400751 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d74c-8b43-491a-8133-0d19f04e7d97 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:14.401035 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d74c-8b43-491a-8133-0d19f04e7d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:14.401314 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c64d74c-8b43-491a-8133-0d19f04e7d97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:14.402542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64d74c-8b43-491a-8133-0d19f04e7d97 None admin] RBAC: Adding query filter params (role.id=539442ef092c4fcf9e1d0be045928c5a, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=e5c2502cf1a14203bec13879a47f47ee) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:14.403798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64d74c-8b43-491a-8133-0d19f04e7d97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:14.405267 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c64d74c-8b43-491a-8133-0d19f04e7d97 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:14.413256 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 272/540] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:29:14 2022] GET /identity/v3/role_assignments?user.id=e5c2502cf1a14203bec13879a47f47ee&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=539442ef092c4fcf9e1d0be045928c5a => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:14.414891 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ee251-e1ad-471e-a12a-e28f5115cc15 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:14.415692 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ee251-e1ad-471e-a12a-e28f5115cc15 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:14.415979 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ee251-e1ad-471e-a12a-e28f5115cc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:14.446627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-8c2ee251-e1ad-471e-a12a-e28f5115cc15 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:14.449162 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8c2ee251-e1ad-471e-a12a-e28f5115cc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:14.521647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:14.584553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde47ae8-295f-4eaf-ab77-096b5f417a0a None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:14.598344 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 273/541] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:14.621128 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731ab9e-7a64-4de1-9b68-82c95f25a452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:14.621770 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731ab9e-7a64-4de1-9b68-82c95f25a452 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:14.622058 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731ab9e-7a64-4de1-9b68-82c95f25a452 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:14.622336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731ab9e-7a64-4de1-9b68-82c95f25a452 None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:14.622668 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ee251-e1ad-471e-a12a-e28f5115cc15 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:14.623135 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731ab9e-7a64-4de1-9b68-82c95f25a452 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:14.623447 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731ab9e-7a64-4de1-9b68-82c95f25a452 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:14.624945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731ab9e-7a64-4de1-9b68-82c95f25a452 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:14.638653 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 269/542] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:14.645742 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731ab9e-7a64-4de1-9b68-82c95f25a452 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:14.773962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:14.823088 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ee251-e1ad-471e-a12a-e28f5115cc15 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:14.863240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc8f99-3cb5-4fa1-b97d-f5e628d21fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:14.864680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc8f99-3cb5-4fa1-b97d-f5e628d21fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:14.865137 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc8f99-3cb5-4fa1-b97d-f5e628d21fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:14.865659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc8f99-3cb5-4fa1-b97d-f5e628d21fb2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:14.875605 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731ab9e-7a64-4de1-9b68-82c95f25a452 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:14.878918 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc8f99-3cb5-4fa1-b97d-f5e628d21fb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:14.888349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-dffc8f99-3cb5-4fa1-b97d-f5e628d21fb2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:14.888349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:14.888349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:14.888349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:14.888349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:14.888349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:14.888349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:14.888349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:14.888349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:14.888349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:14.888349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:14.888349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:14.888349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:14.888349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:14.888349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:14.888349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:14.889219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:14.889219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:14.889219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:14.889219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:14.889219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:14.889219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:14.889219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:14.889219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:14.889219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:14.889219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:14.889219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:14.889219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:14.889219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:14.889219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:14.889219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:14.889219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:14.890019 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:14.890019 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:14.890019 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:14.890019 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:14.890019 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:14.890019 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:14.890019 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:14.890019 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:14.890019 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:14.890019 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:14.890019 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:14.890019 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:14.892275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 274/543] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:29:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:14.898546 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc8f99-3cb5-4fa1-b97d-f5e628d21fb2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:14.919822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:14.948242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc64994-4987-4682-a1ba-072e4c410594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:14.948896 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc64994-4987-4682-a1ba-072e4c410594 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:14.949179 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc64994-4987-4682-a1ba-072e4c410594 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:14.949478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc64994-4987-4682-a1ba-072e4c410594 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:14.950315 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc64994-4987-4682-a1ba-072e4c410594 None admin] RBAC: Adding query filter params (role.id=539442ef092c4fcf9e1d0be045928c5a, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=791ed0f433834b4599d6bc825440279d) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:14.950627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc64994-4987-4682-a1ba-072e4c410594 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:14.952053 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc64994-4987-4682-a1ba-072e4c410594 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:14.960055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 270/544] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:29:14 2022] GET /identity/v3/role_assignments?user.id=791ed0f433834b4599d6bc825440279d&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=539442ef092c4fcf9e1d0be045928c5a => generated 259 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:15.093619 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc8f99-3cb5-4fa1-b97d-f5e628d21fb2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:15.141657 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef72a17-4a88-4167-ae19-ae022a7cba59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:15.142263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef72a17-4a88-4167-ae19-ae022a7cba59 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:15.142550 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef72a17-4a88-4167-ae19-ae022a7cba59 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:15.142830 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef72a17-4a88-4167-ae19-ae022a7cba59 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:15.144302 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef72a17-4a88-4167-ae19-ae022a7cba59 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:15.144798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef72a17-4a88-4167-ae19-ae022a7cba59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:15.145925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef72a17-4a88-4167-ae19-ae022a7cba59 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:15.155368 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:15.155648 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 275/545] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jun 14 19:29:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:15.161732 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc64994-4987-4682-a1ba-072e4c410594 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:15.291412 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc64994-4987-4682-a1ba-072e4c410594 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:15.327410 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7a3d1-4ef1-4c5b-a2ed-fbc0305685a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:15.328201 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7a3d1-4ef1-4c5b-a2ed-fbc0305685a7 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:15.328484 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7a3d1-4ef1-4c5b-a2ed-fbc0305685a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:15.328761 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7a3d1-4ef1-4c5b-a2ed-fbc0305685a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:15.347276 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7a3d1-4ef1-4c5b-a2ed-fbc0305685a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:15.348775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7a3d1-4ef1-4c5b-a2ed-fbc0305685a7 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:15.376501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-98a7a3d1-4ef1-4c5b-a2ed-fbc0305685a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:15.376501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:15.376501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:15.376501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:15.376501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:15.376501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:15.376501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:15.376501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:15.376501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:15.376501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:15.376501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:15.376501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:15.376501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:15.376501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:15.376501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:15.377390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:15.377390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:15.377390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:15.377390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:15.377390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:15.377390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:15.377390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:15.377390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:15.377390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:15.377390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:15.377390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:15.377390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:15.377390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:15.377390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:15.377390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:15.377390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:15.377390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:15.378650 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:15.378650 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:15.378650 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:15.378650 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:15.378650 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 271/546] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:15.383520 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef72a17-4a88-4167-ae19-ae022a7cba59 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:15.490343 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef72a17-4a88-4167-ae19-ae022a7cba59 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:15.530519 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784334c-7048-4021-ace3-78ce153c6def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:15.531190 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784334c-7048-4021-ace3-78ce153c6def None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:15.531470 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784334c-7048-4021-ace3-78ce153c6def None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:15.531746 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784334c-7048-4021-ace3-78ce153c6def None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:15.532471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784334c-7048-4021-ace3-78ce153c6def None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:15.532777 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784334c-7048-4021-ace3-78ce153c6def None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:15.534698 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784334c-7048-4021-ace3-78ce153c6def None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:15.547299 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 276/547] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:15.554474 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7a3d1-4ef1-4c5b-a2ed-fbc0305685a7 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:15.598167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:15.681452 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7a3d1-4ef1-4c5b-a2ed-fbc0305685a7 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:15.718988 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f732738-fbc6-47a8-b027-55e5d42e9ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:15.720128 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f732738-fbc6-47a8-b027-55e5d42e9ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:15.720605 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f732738-fbc6-47a8-b027-55e5d42e9ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:15.721092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f732738-fbc6-47a8-b027-55e5d42e9ee1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:15.730011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f732738-fbc6-47a8-b027-55e5d42e9ee1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:15.731804 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f732738-fbc6-47a8-b027-55e5d42e9ee1 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:15.747510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-9f732738-fbc6-47a8-b027-55e5d42e9ee1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 14 19:29:15.747510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:15.747510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:15.747510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:15.747510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:15.747510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:15.747510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:15.747510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:15.747510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:15.747510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:15.747510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:15.747510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:15.747510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:15.747510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:15.747510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:15.747510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:15.748388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:15.748388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:15.748388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:15.748388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:15.748388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:15.748388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:15.748388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:15.748388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:15.748388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:15.748388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:15.748388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:15.748388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:15.748388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:15.748388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:15.748388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:15.748388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:15.748388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:15.748388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:15.749798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:15.749798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:15.749798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:15.749798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:15.749798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:15.749798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:15.749798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:15.749798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:15.749798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 14 19:29:15.749798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:15.753227 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 272/548] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:29:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:15.758614 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784334c-7048-4021-ace3-78ce153c6def None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:15.850515 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:15.910059 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784334c-7048-4021-ace3-78ce153c6def None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:15.945804 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465f0ed-460b-44c0-99be-431e2a2e8572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:15.946473 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465f0ed-460b-44c0-99be-431e2a2e8572 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:15.946764 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465f0ed-460b-44c0-99be-431e2a2e8572 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:15.947041 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465f0ed-460b-44c0-99be-431e2a2e8572 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:15.947883 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465f0ed-460b-44c0-99be-431e2a2e8572 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:15.948189 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465f0ed-460b-44c0-99be-431e2a2e8572 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:15.949648 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465f0ed-460b-44c0-99be-431e2a2e8572 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:15.968088 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 277/549] 10.222.0.44 () {56 vars in 1135 bytes} [Tue Jun 14 19:29:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:15.974108 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f732738-fbc6-47a8-b027-55e5d42e9ee1 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:16.008524 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f2a59-f729-4406-a620-9b98d190c5b4 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:16.008714 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f2a59-f729-4406-a620-9b98d190c5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:16.009000 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f2a59-f729-4406-a620-9b98d190c5b4 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:16.010408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 278/550] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:16.017456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baf82c-bf28-4705-9d5c-58340f25e139 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:16.017735 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baf82c-bf28-4705-9d5c-58340f25e139 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:16.018022 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76baf82c-bf28-4705-9d5c-58340f25e139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:16.051365 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-76baf82c-bf28-4705-9d5c-58340f25e139 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:16.052700 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-76baf82c-bf28-4705-9d5c-58340f25e139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:16.092198 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:16.102086 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f732738-fbc6-47a8-b027-55e5d42e9ee1 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:16.137617 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be03687-1852-48ac-98e7-202334c3ceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:16.138628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be03687-1852-48ac-98e7-202334c3ceb1 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:16.139134 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be03687-1852-48ac-98e7-202334c3ceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:16.139610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be03687-1852-48ac-98e7-202334c3ceb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:16.198735 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 279/551] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:29:16.213943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be03687-1852-48ac-98e7-202334c3ceb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:16.215681 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be03687-1852-48ac-98e7-202334c3ceb1 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:16.244034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76baf82c-bf28-4705-9d5c-58340f25e139 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:16.320457 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:16.330529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 273/552] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:29:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:29:16.332719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb1b26-d7b6-4e3e-81dd-dceb1224ddc0 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:16.333224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb1b26-d7b6-4e3e-81dd-dceb1224ddc0 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:16.333738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb1b26-d7b6-4e3e-81dd-dceb1224ddc0 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:16.335506 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 274/553] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:16.336407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb1b26-d7b6-4e3e-81dd-dceb1224ddc0 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:16.339294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:16.409705 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76baf82c-bf28-4705-9d5c-58340f25e139 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:16.449318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be759333-5644-49c3-85aa-f992a56522ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:16.450758 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be759333-5644-49c3-85aa-f992a56522ce None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:16.451237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be759333-5644-49c3-85aa-f992a56522ce None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:16.451973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be759333-5644-49c3-85aa-f992a56522ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:16.462867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb1b26-d7b6-4e3e-81dd-dceb1224ddc0 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:16.467283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be759333-5644-49c3-85aa-f992a56522ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:16.478011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-be759333-5644-49c3-85aa-f992a56522ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:16.478011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:16.478011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:16.478011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:16.478011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:16.478011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:16.478011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:16.478011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:16.478011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:16.478011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:16.478011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:16.478011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:16.478011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:16.478011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:16.478011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:16.478011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:16.479020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:16.479020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:16.479020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:16.479020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:16.479020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:16.479020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:16.479020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:16.479020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:16.479020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:16.479020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:16.479020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:16.479020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:16.479020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:16.479020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:16.479020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:16.479020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:16.479819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:16.479819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:16.479819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:16.479819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:16.479819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:16.479819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:16.479819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:16.479819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:16.479819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:16.479819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:16.479819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:16.479819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:16.482953 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 280/554] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:29:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:16.484383 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88576e-3ce0-461a-8755-7e62971f26cb None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:16.484867 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88576e-3ce0-461a-8755-7e62971f26cb None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:16.485353 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88576e-3ce0-461a-8755-7e62971f26cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:16.504267 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-de88576e-3ce0-461a-8755-7e62971f26cb None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:16.505689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-de88576e-3ce0-461a-8755-7e62971f26cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:16.515648 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cba47c-1fda-48a2-878c-c325fd25fef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:16.517124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cba47c-1fda-48a2-878c-c325fd25fef1 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:16.517673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cba47c-1fda-48a2-878c-c325fd25fef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:16.518590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cba47c-1fda-48a2-878c-c325fd25fef1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:16.532933 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cba47c-1fda-48a2-878c-c325fd25fef1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:16.535444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cba47c-1fda-48a2-878c-c325fd25fef1 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:16.559677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-f9cba47c-1fda-48a2-878c-c325fd25fef1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:16.559677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:16.559677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:16.559677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:16.559677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:16.559677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:16.559677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:16.559677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:16.559677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:16.559677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:16.559677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:16.559677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:16.559677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:16.559677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:16.559677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:16.560680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:16.560680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:16.560680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:16.560680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:16.560680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:16.560680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:16.560680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:16.560680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:16.560680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:16.560680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:16.560680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:16.560680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:16.560680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:16.560680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:16.560680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:16.560680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:16.560680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:16.561574 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:16.561574 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:16.561574 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:16.561574 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:16.565469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 275/555] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:16.566817 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cba47c-1fda-48a2-878c-c325fd25fef1 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:16.592140 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 281/556] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:16.593368 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88576e-3ce0-461a-8755-7e62971f26cb None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:16.641771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:16.642883 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:16.712660 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cba47c-1fda-48a2-878c-c325fd25fef1 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:16.727954 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88576e-3ce0-461a-8755-7e62971f26cb None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:16.755996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce929f3-6e18-4eee-8ff2-00acb4a9115f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:16.757008 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce929f3-6e18-4eee-8ff2-00acb4a9115f None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:16.757543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce929f3-6e18-4eee-8ff2-00acb4a9115f None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:16.758093 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce929f3-6e18-4eee-8ff2-00acb4a9115f None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:16.759024 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce929f3-6e18-4eee-8ff2-00acb4a9115f None admin] RBAC: Adding query filter params (name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:16.759519 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce929f3-6e18-4eee-8ff2-00acb4a9115f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:16.761099 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce929f3-6e18-4eee-8ff2-00acb4a9115f None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:16.771655 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 276/557] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jun 14 19:29:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:16.772712 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce929f3-6e18-4eee-8ff2-00acb4a9115f None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:16.777644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5d5ba-654c-4319-b5d2-62250fb6f1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:16.778575 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5d5ba-654c-4319-b5d2-62250fb6f1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:16.780065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5d5ba-654c-4319-b5d2-62250fb6f1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:16.781151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5d5ba-654c-4319-b5d2-62250fb6f1c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:16.782205 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5d5ba-654c-4319-b5d2-62250fb6f1c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:16.782715 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5d5ba-654c-4319-b5d2-62250fb6f1c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:16.785473 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5d5ba-654c-4319-b5d2-62250fb6f1c5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:16.802046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 282/558] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:16.803207 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5d5ba-654c-4319-b5d2-62250fb6f1c5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:16.895372 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce929f3-6e18-4eee-8ff2-00acb4a9115f None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:16.905251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:16.931508 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:16.936066 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35eec62-766a-452c-8849-d8eba0bae4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:16.936894 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35eec62-766a-452c-8849-d8eba0bae4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:16.937177 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35eec62-766a-452c-8849-d8eba0bae4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:16.937483 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35eec62-766a-452c-8849-d8eba0bae4e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:16.943363 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5d5ba-654c-4319-b5d2-62250fb6f1c5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:16.951147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35eec62-766a-452c-8849-d8eba0bae4e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:16.960285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-c35eec62-766a-452c-8849-d8eba0bae4e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:16.960285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:16.960285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:16.960285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:16.960285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:16.960285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:16.960285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:16.960285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:16.960285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:16.960285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:16.960285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:16.960285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:16.960285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:16.960285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:16.960285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:16.960285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:16.961351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:16.961351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:16.961351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:16.961351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:16.961351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:16.961351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:16.961351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:16.961351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:16.961351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:16.961351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:16.961351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:16.961351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:16.961351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:16.961351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:16.961351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:16.961351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:16.962492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:16.962492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:16.962492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:16.962492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:16.962492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:16.962492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:16.962492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:16.962492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:16.962492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:16.962492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:16.962492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:16.962492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:16.966633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 277/559] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:29:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:16.967596 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35eec62-766a-452c-8849-d8eba0bae4e7 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:16.994429 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e1e1c-393b-4af5-9acb-a0f7503a5ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:16.996221 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e1e1c-393b-4af5-9acb-a0f7503a5ffd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:16.996707 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e1e1c-393b-4af5-9acb-a0f7503a5ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:16.997474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e1e1c-393b-4af5-9acb-a0f7503a5ffd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:17.010561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e1e1c-393b-4af5-9acb-a0f7503a5ffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:17.012264 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e1e1c-393b-4af5-9acb-a0f7503a5ffd None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:17.031211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-772e1e1c-393b-4af5-9acb-a0f7503a5ffd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:17.031211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:17.031211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:17.031211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:17.031211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:17.031211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:17.031211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:17.031211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:17.031211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:17.031211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:17.031211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:17.031211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:17.031211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:17.031211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:17.031211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:17.032200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:17.032200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:17.032200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:17.032200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:17.032200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:17.032200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:17.032200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:17.032200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:17.032200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:17.032200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:17.032200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:17.032200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:17.032200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:17.032200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:17.032200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:17.032200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:17.032200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:17.033064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:17.033064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:17.033064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:17.033064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:17.033064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 283/560] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:17.038082 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e1e1c-393b-4af5-9acb-a0f7503a5ffd None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:17.075454 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35eec62-766a-452c-8849-d8eba0bae4e7 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:17.111233 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fb48e-6b5a-4d69-abaa-7f02b4f5be51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:17.112581 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fb48e-6b5a-4d69-abaa-7f02b4f5be51 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:17.112882 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fb48e-6b5a-4d69-abaa-7f02b4f5be51 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:17.113147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fb48e-6b5a-4d69-abaa-7f02b4f5be51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:17.120132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fb48e-6b5a-4d69-abaa-7f02b4f5be51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:17.121616 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fb48e-6b5a-4d69-abaa-7f02b4f5be51 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:17.136903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-a62fb48e-6b5a-4d69-abaa-7f02b4f5be51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:17.136903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:17.136903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:17.136903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:17.136903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:17.136903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:17.136903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:17.136903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:17.136903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:17.136903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:17.136903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:17.136903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:17.136903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:17.136903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:17.136903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:17.137845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:17.137845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:17.137845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:17.137845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:17.137845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:17.137845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:17.137845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:17.137845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:17.137845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:17.137845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:17.137845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:17.137845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:17.137845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:17.137845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:17.137845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:17.137845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:17.137845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:17.138798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:17.138798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:17.138798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:17.138798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:17.138798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:17.138798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:17.138798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:17.138798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:17.138798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 278/561] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:17.139324 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e9a2b-9d74-4573-a80c-728f132616d2 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:17.139970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e9a2b-9d74-4573-a80c-728f132616d2 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:17.139970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e9a2b-9d74-4573-a80c-728f132616d2 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:17.141277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 279/562] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:17.145851 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e9a2b-9d74-4573-a80c-728f132616d2 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:17.150357 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e1e1c-393b-4af5-9acb-a0f7503a5ffd None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:17.179218 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:17.187890 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3860a-14cd-491d-80e5-61be0620b154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:17.188904 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3860a-14cd-491d-80e5-61be0620b154 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:17.188904 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3860a-14cd-491d-80e5-61be0620b154 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:17.189169 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3860a-14cd-491d-80e5-61be0620b154 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:17.190017 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3860a-14cd-491d-80e5-61be0620b154 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:17.190320 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3860a-14cd-491d-80e5-61be0620b154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:17.191821 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3860a-14cd-491d-80e5-61be0620b154 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:17.200268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 284/563] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jun 14 19:29:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:17.202225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3860a-14cd-491d-80e5-61be0620b154 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:17.216938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:17.263124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e9a2b-9d74-4573-a80c-728f132616d2 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:17.300390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9aa432-f924-4d35-9c5f-3dd40ebd808a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:17.301162 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9aa432-f924-4d35-9c5f-3dd40ebd808a None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:17.301465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9aa432-f924-4d35-9c5f-3dd40ebd808a None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:17.301738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9aa432-f924-4d35-9c5f-3dd40ebd808a None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:17.302458 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9aa432-f924-4d35-9c5f-3dd40ebd808a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:17.302760 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9aa432-f924-4d35-9c5f-3dd40ebd808a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:17.304366 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9aa432-f924-4d35-9c5f-3dd40ebd808a None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:17.309796 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3860a-14cd-491d-80e5-61be0620b154 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:17.320373 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 280/564] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:17.320373 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514896c9-4f03-488d-ae1d-2ae604740cc3 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:17.320373 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514896c9-4f03-488d-ae1d-2ae604740cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:17.320373 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514896c9-4f03-488d-ae1d-2ae604740cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:17.335114 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-514896c9-4f03-488d-ae1d-2ae604740cc3 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:17.336298 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-514896c9-4f03-488d-ae1d-2ae604740cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:17.353046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc9bd1-ddc0-46a2-8fe7-31eabfe50353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:17.354604 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc9bd1-ddc0-46a2-8fe7-31eabfe50353 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:17.354604 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc9bd1-ddc0-46a2-8fe7-31eabfe50353 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:17.354604 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc9bd1-ddc0-46a2-8fe7-31eabfe50353 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:17.356232 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc9bd1-ddc0-46a2-8fe7-31eabfe50353 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:17.356510 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc9bd1-ddc0-46a2-8fe7-31eabfe50353 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:17.357981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc9bd1-ddc0-46a2-8fe7-31eabfe50353 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:17.370471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 285/565] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:17.375957 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc9bd1-ddc0-46a2-8fe7-31eabfe50353 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:17.407903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 281/566] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:17.409677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514896c9-4f03-488d-ae1d-2ae604740cc3 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:17.429217 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:17.470718 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:17.506671 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc9bd1-ddc0-46a2-8fe7-31eabfe50353 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:17.515451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514896c9-4f03-488d-ae1d-2ae604740cc3 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:17.551776 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80945ad-769c-49bf-bc4f-9031529916b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:17.552802 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80945ad-769c-49bf-bc4f-9031529916b0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:17.553151 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a30f1-3916-4b25-a5af-a84a62f139f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:17.553445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80945ad-769c-49bf-bc4f-9031529916b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:17.553859 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80945ad-769c-49bf-bc4f-9031529916b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:17.554001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a30f1-3916-4b25-a5af-a84a62f139f9 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:17.554253 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a30f1-3916-4b25-a5af-a84a62f139f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:17.554613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a30f1-3916-4b25-a5af-a84a62f139f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:17.562282 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a30f1-3916-4b25-a5af-a84a62f139f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:17.563765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a30f1-3916-4b25-a5af-a84a62f139f9 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:17.566272 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80945ad-769c-49bf-bc4f-9031529916b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:17.568054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80945ad-769c-49bf-bc4f-9031529916b0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:17.579428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-fd8a30f1-3916-4b25-a5af-a84a62f139f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 19:29:17.579428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:17.579428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:17.579428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:17.579428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:17.579428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:17.579428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:17.579428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:17.579428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:17.579428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:17.579428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:17.579428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:17.579428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:17.579428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:17.579428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:17.579428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:17.581170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:17.581170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:17.581170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:17.581170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:17.581170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:17.581170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:17.581170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:17.581170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:17.581170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:17.581170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:17.581170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:17.581170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:17.581170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:17.581170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:17.581170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:17.581170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:17.581170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:17.581170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:17.582751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:17.582751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:17.582751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:17.582751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:17.582751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:17.582751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:17.582751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:17.582751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:17.582751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 19:29:17.582751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:17.582751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 282/567] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jun 14 19:29:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:17.582751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a30f1-3916-4b25-a5af-a84a62f139f9 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:17.593161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-c80945ad-769c-49bf-bc4f-9031529916b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:17.593161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:17.593161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:17.593161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:17.593161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:17.593161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:17.593161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:17.593161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:17.593161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:17.593161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:17.593161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:17.593161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:17.593161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:17.593161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:17.593161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:17.594290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:17.594290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:17.594290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:17.594290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:17.594290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:17.594290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:17.594290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:17.594290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:17.594290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:17.594290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:17.594290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:17.594290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:17.594290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:17.594290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:17.594290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:17.594290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:17.594290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:17.595338 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:17.595338 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:17.595338 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:17.595338 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:17.597739 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 286/568] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:17.599195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80945ad-769c-49bf-bc4f-9031529916b0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:17.671602 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:17.693811 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a30f1-3916-4b25-a5af-a84a62f139f9 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:17.708652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80945ad-769c-49bf-bc4f-9031529916b0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:17.728652 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe901ddc-90c0-458c-afd1-0201e7d63996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:17.729300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe901ddc-90c0-458c-afd1-0201e7d63996 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:17.729630 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe901ddc-90c0-458c-afd1-0201e7d63996 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:17.729910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe901ddc-90c0-458c-afd1-0201e7d63996 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:17.730737 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe901ddc-90c0-458c-afd1-0201e7d63996 None admin] RBAC: Adding query filter params (role.id=539442ef092c4fcf9e1d0be045928c5a, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=7fff5414195f4873bcc8752c914b6b49) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:17.731048 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe901ddc-90c0-458c-afd1-0201e7d63996 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:17.731138 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:17.732481 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe901ddc-90c0-458c-afd1-0201e7d63996 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:17.739132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 283/569] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:29:17 2022] GET /identity/v3/role_assignments?user.id=7fff5414195f4873bcc8752c914b6b49&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=539442ef092c4fcf9e1d0be045928c5a => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:17.739911 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe901ddc-90c0-458c-afd1-0201e7d63996 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:17.743622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ad2aa-52fd-484a-af10-df5295012692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:17.744443 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ad2aa-52fd-484a-af10-df5295012692 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:17.744727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ad2aa-52fd-484a-af10-df5295012692 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:17.745002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ad2aa-52fd-484a-af10-df5295012692 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:17.757884 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ad2aa-52fd-484a-af10-df5295012692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:17.766769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-2f7ad2aa-52fd-484a-af10-df5295012692 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:17.766769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:17.766769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:17.766769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:17.766769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:17.766769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:17.766769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:17.766769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:17.766769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:17.766769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:17.766769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:17.766769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:17.766769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:17.766769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:17.766769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:17.766769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:17.767770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:17.767770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:17.767770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:17.767770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:17.767770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:17.767770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:17.767770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:17.767770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:17.767770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:17.767770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:17.767770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:17.767770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:17.767770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:17.767770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:17.767770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:17.767770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:17.768645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:17.768645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:17.768645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:17.768645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:17.768645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:17.768645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:17.768645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:17.768645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:17.768645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:17.768645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:17.768645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:17.768645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:17.768645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 287/570] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:29:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:17.769334 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ad2aa-52fd-484a-af10-df5295012692 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:17.866108 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe901ddc-90c0-458c-afd1-0201e7d63996 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:17.897533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ad2aa-52fd-484a-af10-df5295012692 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:17.903739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14521d-e614-4d4d-84be-7e1218bf9ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:17.905121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14521d-e614-4d4d-84be-7e1218bf9ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:17.905121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14521d-e614-4d4d-84be-7e1218bf9ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:17.905121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14521d-e614-4d4d-84be-7e1218bf9ed4 None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:17.905797 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14521d-e614-4d4d-84be-7e1218bf9ed4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:17.906105 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14521d-e614-4d4d-84be-7e1218bf9ed4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:17.908058 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14521d-e614-4d4d-84be-7e1218bf9ed4 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:17.938714 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819150bb-7fdb-4992-87c5-55db4180a998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:17.939301 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819150bb-7fdb-4992-87c5-55db4180a998 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:17.939582 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819150bb-7fdb-4992-87c5-55db4180a998 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:17.939854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819150bb-7fdb-4992-87c5-55db4180a998 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:17.941242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819150bb-7fdb-4992-87c5-55db4180a998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:17.941567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819150bb-7fdb-4992-87c5-55db4180a998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:17.942931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819150bb-7fdb-4992-87c5-55db4180a998 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:17.944121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:17.953838 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 284/571] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jun 14 19:29:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:17.955249 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bd19f-3a23-4c80-b6f4-f0fdc529c41a None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:17.955771 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bd19f-3a23-4c80-b6f4-f0fdc529c41a None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:17.956586 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351bd19f-3a23-4c80-b6f4-f0fdc529c41a None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:17.963343 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 285/572] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:17.963343 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bd19f-3a23-4c80-b6f4-f0fdc529c41a None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:17.963569 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 288/573] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:17.963569 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819150bb-7fdb-4992-87c5-55db4180a998 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:18.007432 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:18.069263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819150bb-7fdb-4992-87c5-55db4180a998 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:18.070065 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351bd19f-3a23-4c80-b6f4-f0fdc529c41a None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:18.107026 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b8191-ff1d-42f4-8f6d-582f790236e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:18.107231 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4fbca-920c-4ff1-8b4a-5208e3e564cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:18.107692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b8191-ff1d-42f4-8f6d-582f790236e2 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:18.107815 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4fbca-920c-4ff1-8b4a-5208e3e564cd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:18.107970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b8191-ff1d-42f4-8f6d-582f790236e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:18.108067 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4fbca-920c-4ff1-8b4a-5208e3e564cd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:18.108250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b8191-ff1d-42f4-8f6d-582f790236e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:18.108345 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4fbca-920c-4ff1-8b4a-5208e3e564cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:18.108995 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b8191-ff1d-42f4-8f6d-582f790236e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:18.109304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b8191-ff1d-42f4-8f6d-582f790236e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:18.110691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b8191-ff1d-42f4-8f6d-582f790236e2 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:18.123116 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 286/574] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jun 14 19:29:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:18.123272 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4fbca-920c-4ff1-8b4a-5208e3e564cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:18.123365 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b8191-ff1d-42f4-8f6d-582f790236e2 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:18.123469 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4fbca-920c-4ff1-8b4a-5208e3e564cd None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:18.142308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-c6b4fbca-920c-4ff1-8b4a-5208e3e564cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:18.142308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:18.142308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:18.142308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:18.142308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:18.142308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:18.142308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:18.142308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:18.142308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:18.142308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:18.142308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:18.142308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:18.142308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:18.142308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:18.142308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:18.143768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:18.143768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:18.143768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:18.143768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:18.143768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:18.143768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:18.143768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:18.143768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:18.143768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:18.143768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:18.143768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:18.143768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:18.143768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:18.143768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:18.143768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:18.143768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:18.143768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:18.144650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:18.144650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:18.144650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:18.144650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:18.148904 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 289/575] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:18.150229 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a9c75-c5e6-4379-8a6d-a5b359384dde None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:18.150519 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a9c75-c5e6-4379-8a6d-a5b359384dde None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:18.150798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a9c75-c5e6-4379-8a6d-a5b359384dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:18.168274 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e84a9c75-c5e6-4379-8a6d-a5b359384dde None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:18.169484 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e84a9c75-c5e6-4379-8a6d-a5b359384dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:18.188417 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:18.238064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 290/576] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:18.239234 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a9c75-c5e6-4379-8a6d-a5b359384dde None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:18.239341 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b8191-ff1d-42f4-8f6d-582f790236e2 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:18.266556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:18.284345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705b6ed-03e4-47ae-bd93-92e14a8f00e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:18.285821 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705b6ed-03e4-47ae-bd93-92e14a8f00e7 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:18.286171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705b6ed-03e4-47ae-bd93-92e14a8f00e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:18.286514 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705b6ed-03e4-47ae-bd93-92e14a8f00e7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:18.296879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705b6ed-03e4-47ae-bd93-92e14a8f00e7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:18.298500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705b6ed-03e4-47ae-bd93-92e14a8f00e7 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:18.313363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-e705b6ed-03e4-47ae-bd93-92e14a8f00e7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 14 19:29:18.313363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:18.313363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:18.313363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:18.313363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:18.313363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:18.313363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:18.313363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:18.313363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:18.313363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:18.313363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:18.313363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:18.313363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:18.313363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:18.313363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:18.313363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:18.314442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:18.314442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:18.314442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:18.314442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:18.314442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:18.314442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:18.314442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:18.314442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:18.314442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:18.314442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:18.314442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:18.314442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:18.314442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:18.314442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:18.314442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:18.314442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:18.314442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:18.314442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:18.315535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:18.315535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:18.315535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:18.315535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:18.315535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:18.315535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:18.315535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:18.315535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:18.315535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 14 19:29:18.315535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:18.321143 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 287/577] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:29:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:18.321143 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705b6ed-03e4-47ae-bd93-92e14a8f00e7 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:18.353281 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84a9c75-c5e6-4379-8a6d-a5b359384dde None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:18.388111 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31dec5-a193-4430-a11a-46c5df2b17a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:18.388899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31dec5-a193-4430-a11a-46c5df2b17a1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:18.389181 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31dec5-a193-4430-a11a-46c5df2b17a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:18.389482 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31dec5-a193-4430-a11a-46c5df2b17a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:18.401627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31dec5-a193-4430-a11a-46c5df2b17a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:18.403083 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31dec5-a193-4430-a11a-46c5df2b17a1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:18.421567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-8f31dec5-a193-4430-a11a-46c5df2b17a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:18.421567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:18.421567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:18.421567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:18.421567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:18.421567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:18.421567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:18.421567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:18.421567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:18.421567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:18.421567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:18.421567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:18.421567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:18.421567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:18.421567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:18.422467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:18.422467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:18.422467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:18.422467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:18.422467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:18.422467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:18.422467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:18.422467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:18.422467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:18.422467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:18.422467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:18.422467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:18.422467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:18.422467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:18.422467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:18.422467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:18.422467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:18.423323 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:18.423323 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:18.423323 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:18.423323 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:18.423323 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 291/578] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:18.424158 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31dec5-a193-4430-a11a-46c5df2b17a1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:18.434676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705b6ed-03e4-47ae-bd93-92e14a8f00e7 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:18.459686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:18.473830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce9156-599c-48bc-a217-4e19e51d0913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:18.474380 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce9156-599c-48bc-a217-4e19e51d0913 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:18.474661 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce9156-599c-48bc-a217-4e19e51d0913 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:18.474978 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ce9156-599c-48bc-a217-4e19e51d0913 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:18.475646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce9156-599c-48bc-a217-4e19e51d0913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:18.475949 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce9156-599c-48bc-a217-4e19e51d0913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:18.477407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ce9156-599c-48bc-a217-4e19e51d0913 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:18.490036 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 288/579] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:18.490667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce9156-599c-48bc-a217-4e19e51d0913 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:18.512346 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:18.538487 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31dec5-a193-4430-a11a-46c5df2b17a1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:18.576309 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b48214-c284-4081-946e-b5f513c36b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:18.577338 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b48214-c284-4081-946e-b5f513c36b72 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:18.577824 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b48214-c284-4081-946e-b5f513c36b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:18.578101 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b48214-c284-4081-946e-b5f513c36b72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:18.590252 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b48214-c284-4081-946e-b5f513c36b72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:18.598318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-a0b48214-c284-4081-946e-b5f513c36b72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:18.598318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:18.598318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:18.598318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:18.598318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:18.598318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:18.598318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:18.598318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:18.598318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:18.598318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:18.598318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:18.598318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:18.598318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:18.598318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:18.598318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:18.598318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:18.599224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:18.599224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:18.599224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:18.599224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:18.599224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:18.599224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:18.599224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:18.599224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:18.599224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:18.599224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:18.599224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:18.599224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:18.599224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:18.599224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:18.599224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:18.599224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:18.605054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:18.605054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:18.605054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:18.605054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:18.605054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:18.605054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:18.605054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:18.605054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:18.605054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:18.605054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:18.605054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:18.605054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:18.605727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ce9156-599c-48bc-a217-4e19e51d0913 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:18.605802 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 292/580] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:29:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:18.605802 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b48214-c284-4081-946e-b5f513c36b72 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:18.640220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838739d-61c2-4611-860e-7565bd56b777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:18.640886 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838739d-61c2-4611-860e-7565bd56b777 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:18.641168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838739d-61c2-4611-860e-7565bd56b777 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:18.641468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838739d-61c2-4611-860e-7565bd56b777 None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:18.642303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838739d-61c2-4611-860e-7565bd56b777 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:18.642612 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838739d-61c2-4611-860e-7565bd56b777 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:18.644801 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838739d-61c2-4611-860e-7565bd56b777 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:18.666773 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 289/581] 10.222.0.44 () {56 vars in 1137 bytes} [Tue Jun 14 19:29:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:18.666773 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838739d-61c2-4611-860e-7565bd56b777 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:18.705468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:18.714750 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b48214-c284-4081-946e-b5f513c36b72 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:18.749319 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1cbad-87a8-4115-8b41-338eb470ee81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:18.749941 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1cbad-87a8-4115-8b41-338eb470ee81 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:18.750226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1cbad-87a8-4115-8b41-338eb470ee81 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:18.750503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1cbad-87a8-4115-8b41-338eb470ee81 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:18.751220 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1cbad-87a8-4115-8b41-338eb470ee81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:18.751527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1cbad-87a8-4115-8b41-338eb470ee81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:18.753436 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1cbad-87a8-4115-8b41-338eb470ee81 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:18.756234 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:18.767507 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 293/582] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:18.769807 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1cbad-87a8-4115-8b41-338eb470ee81 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:18.773159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838739d-61c2-4611-860e-7565bd56b777 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:18.821267 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e1130-820c-477e-883b-8f68dc4d9961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:18.822413 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e1130-820c-477e-883b-8f68dc4d9961 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:18.822887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e1130-820c-477e-883b-8f68dc4d9961 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:18.823239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e1130-820c-477e-883b-8f68dc4d9961 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:18.830707 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e1130-820c-477e-883b-8f68dc4d9961 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:18.832296 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e1130-820c-477e-883b-8f68dc4d9961 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:18.846223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-355e1130-820c-477e-883b-8f68dc4d9961 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:18.846223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:18.846223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:18.846223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:18.846223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:18.846223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:18.846223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:18.846223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:18.846223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:18.846223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:18.846223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:18.846223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:18.846223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:18.846223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:18.846223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:18.847328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:18.847328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:18.847328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:18.847328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:18.847328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:18.847328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:18.847328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:18.847328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:18.847328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:18.847328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:18.847328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:18.847328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:18.847328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:18.847328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:18.847328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:18.847328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:18.847328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:18.848299 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:18.848299 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:18.848299 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:18.848299 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:18.848299 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:18.848299 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:18.848299 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:18.848299 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:18.848299 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 290/583] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:18.853022 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e1130-820c-477e-883b-8f68dc4d9961 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:18.886068 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1cbad-87a8-4115-8b41-338eb470ee81 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:18.925400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905f569-5988-4445-acde-62854dacbf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:18.926324 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905f569-5988-4445-acde-62854dacbf71 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:18.926608 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905f569-5988-4445-acde-62854dacbf71 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:18.926884 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905f569-5988-4445-acde-62854dacbf71 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:18.927634 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905f569-5988-4445-acde-62854dacbf71 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:18.927950 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905f569-5988-4445-acde-62854dacbf71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:18.929345 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905f569-5988-4445-acde-62854dacbf71 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:18.937969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 294/584] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jun 14 19:29:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:18.938767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905f569-5988-4445-acde-62854dacbf71 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:18.964441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:18.968220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e1130-820c-477e-883b-8f68dc4d9961 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:19.002593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5227bd-df2e-4821-a454-549f73be7d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:19.003586 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5227bd-df2e-4821-a454-549f73be7d7c None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:19.003867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5227bd-df2e-4821-a454-549f73be7d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:19.004141 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5227bd-df2e-4821-a454-549f73be7d7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:19.008093 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:19.015240 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5227bd-df2e-4821-a454-549f73be7d7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:19.016683 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5227bd-df2e-4821-a454-549f73be7d7c None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:19.036335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-9d5227bd-df2e-4821-a454-549f73be7d7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:19.036335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:19.036335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:19.036335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:19.036335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:19.036335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:19.036335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:19.036335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:19.036335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:19.036335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:19.036335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:19.036335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:19.036335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:19.036335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:19.036335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:19.037247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:19.037247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:19.037247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:19.037247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:19.037247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:19.037247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:19.037247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:19.037247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:19.037247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:19.037247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:19.037247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:19.037247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:19.037247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:19.037247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:19.037247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:19.037247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:19.037247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:19.038133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:19.038133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:19.038133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:19.038133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:19.038133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 291/585] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:19.038409 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5227bd-df2e-4821-a454-549f73be7d7c None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:19.058705 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905f569-5988-4445-acde-62854dacbf71 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:19.094570 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798dcb9-f53d-432f-8a5f-30e9a279352f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:19.095411 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798dcb9-f53d-432f-8a5f-30e9a279352f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:19.095632 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798dcb9-f53d-432f-8a5f-30e9a279352f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:19.095903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798dcb9-f53d-432f-8a5f-30e9a279352f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:19.106222 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798dcb9-f53d-432f-8a5f-30e9a279352f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:19.107813 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798dcb9-f53d-432f-8a5f-30e9a279352f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:19.122865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-1798dcb9-f53d-432f-8a5f-30e9a279352f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 19:29:19.122865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:19.122865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:19.122865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:19.122865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:19.122865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:19.122865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:19.122865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:19.122865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:19.122865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:19.122865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:19.122865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:19.122865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:19.122865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:19.122865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:19.122865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:19.123794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:19.123794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:19.123794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:19.123794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:19.123794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:19.123794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:19.123794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:19.123794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:19.123794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:19.123794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:19.123794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:19.123794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:19.123794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:19.123794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:19.123794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:19.123794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:19.123794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:19.123794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:19.124702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:19.124702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:19.124702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:19.124702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:19.124702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:19.124702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:19.124702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:19.124702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:19.124702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 19:29:19.124702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:19.128717 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 295/586] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:29:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:19.129562 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798dcb9-f53d-432f-8a5f-30e9a279352f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:19.146630 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5227bd-df2e-4821-a454-549f73be7d7c None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:19.187344 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3b797-aca9-4be5-a191-41a934890be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:19.187995 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3b797-aca9-4be5-a191-41a934890be4 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:19.188287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3b797-aca9-4be5-a191-41a934890be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:19.188553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3b797-aca9-4be5-a191-41a934890be4 None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:19.189334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3b797-aca9-4be5-a191-41a934890be4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:19.189670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3b797-aca9-4be5-a191-41a934890be4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:19.191859 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3b797-aca9-4be5-a191-41a934890be4 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:19.209404 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 292/587] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:19.209404 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3b797-aca9-4be5-a191-41a934890be4 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:19.225689 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:19.235299 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798dcb9-f53d-432f-8a5f-30e9a279352f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:19.259130 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:19.275193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcc704-6bd1-4e0b-9626-3d091977c8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:19.275977 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcc704-6bd1-4e0b-9626-3d091977c8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:19.276265 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcc704-6bd1-4e0b-9626-3d091977c8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:19.276547 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fcc704-6bd1-4e0b-9626-3d091977c8e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:19.288783 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fcc704-6bd1-4e0b-9626-3d091977c8e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:19.290259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fcc704-6bd1-4e0b-9626-3d091977c8e7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:19.308531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-81fcc704-6bd1-4e0b-9626-3d091977c8e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:19.308531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:19.308531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:19.308531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:19.308531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:19.308531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:19.308531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:19.308531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:19.308531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:19.308531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:19.308531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:19.308531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:19.308531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:19.308531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:19.308531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:19.309454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:19.309454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:19.309454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:19.309454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:19.309454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:19.309454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:19.309454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:19.309454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:19.309454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:19.309454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:19.309454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:19.309454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:19.309454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:19.309454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:19.309454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:19.309454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:19.309454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:19.310352 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:19.310352 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:19.310352 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:19.310352 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:19.310352 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 296/588] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:19.310851 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcc704-6bd1-4e0b-9626-3d091977c8e7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:19.327848 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3b797-aca9-4be5-a191-41a934890be4 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:19.366552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e6b04-d364-4707-b1a0-ec4285254414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:19.367298 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e6b04-d364-4707-b1a0-ec4285254414 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:19.367573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e6b04-d364-4707-b1a0-ec4285254414 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:19.367848 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e6b04-d364-4707-b1a0-ec4285254414 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:19.368564 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e6b04-d364-4707-b1a0-ec4285254414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:19.369108 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e6b04-d364-4707-b1a0-ec4285254414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:19.370244 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e6b04-d364-4707-b1a0-ec4285254414 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:19.386005 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 293/589] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:19.386005 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e6b04-d364-4707-b1a0-ec4285254414 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:19.419802 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fcc704-6bd1-4e0b-9626-3d091977c8e7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:19.458880 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7d8bd-4690-47c1-9861-ba3786a0f336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:19.459107 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7d8bd-4690-47c1-9861-ba3786a0f336 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:19.459326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7d8bd-4690-47c1-9861-ba3786a0f336 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:19.459582 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7d8bd-4690-47c1-9861-ba3786a0f336 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:19.459996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:19.460429 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7d8bd-4690-47c1-9861-ba3786a0f336 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:19.460700 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7d8bd-4690-47c1-9861-ba3786a0f336 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:19.462427 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed7d8bd-4690-47c1-9861-ba3786a0f336 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:19.481763 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 297/590] 10.222.0.44 () {56 vars in 1137 bytes} [Tue Jun 14 19:29:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:19.482393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7d8bd-4690-47c1-9861-ba3786a0f336 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:19.497583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e6b04-d364-4707-b1a0-ec4285254414 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:19.514047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:19.534382 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc1b0b-5fc5-4926-b330-253852d469d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:19.535776 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc1b0b-5fc5-4926-b330-253852d469d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:19.536209 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc1b0b-5fc5-4926-b330-253852d469d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:19.536696 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc1b0b-5fc5-4926-b330-253852d469d8 None admin] PATH_INFO: `/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/37c521e20aea4cad9758568a4f082fbd/roles/539442ef092c4fcf9e1d0be045928c5a` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:19.554805 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc1b0b-5fc5-4926-b330-253852d469d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d3e177b11504cb3b19d25ed5850ef12, user_id=37c521e20aea4cad9758568a4f082fbd, role_id=539442ef092c4fcf9e1d0be045928c5a)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:19.556330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc1b0b-5fc5-4926-b330-253852d469d8 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:19.570269 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 294/591] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:29:19 2022] PUT /identity/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/37c521e20aea4cad9758568a4f082fbd/roles/539442ef092c4fcf9e1d0be045928c5a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:29:19.571140 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc1b0b-5fc5-4926-b330-253852d469d8 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:19.609030 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7d8bd-4690-47c1-9861-ba3786a0f336 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:19.650691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e8280-adc7-40b5-b79e-a956d866e8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:19.651468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e8280-adc7-40b5-b79e-a956d866e8eb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:19.651830 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e8280-adc7-40b5-b79e-a956d866e8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:19.652182 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e8280-adc7-40b5-b79e-a956d866e8eb None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:19.652992 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e8280-adc7-40b5-b79e-a956d866e8eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:19.653396 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e8280-adc7-40b5-b79e-a956d866e8eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:19.655167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e8280-adc7-40b5-b79e-a956d866e8eb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:19.669729 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 298/592] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:19.670901 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e8280-adc7-40b5-b79e-a956d866e8eb None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:19.716262 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc1b0b-5fc5-4926-b330-253852d469d8 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:19.749699 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:19.768592 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3ffb5-41bc-4433-b85f-00163321d85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:19.770171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3ffb5-41bc-4433-b85f-00163321d85a None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:19.771032 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3ffb5-41bc-4433-b85f-00163321d85a None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:19.771525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3ffb5-41bc-4433-b85f-00163321d85a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:19.783141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:19.783938 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3ffb5-41bc-4433-b85f-00163321d85a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:19.785526 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3ffb5-41bc-4433-b85f-00163321d85a None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:19.804463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e8280-adc7-40b5-b79e-a956d866e8eb None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:19.805901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-2ea3ffb5-41bc-4433-b85f-00163321d85a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:19.805901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:19.805901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:19.805901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:19.805901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:19.805901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:19.805901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:19.805901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:19.805901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:19.805901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:19.805901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:19.805901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:19.805901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:19.805901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:19.805901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:19.806734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:19.806734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:19.806734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:19.806734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:19.806734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:19.806734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:19.806734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:19.806734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:19.806734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:19.806734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:19.806734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:19.806734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:19.806734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:19.806734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:19.806734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:19.806734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:19.806734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:19.807613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:19.807613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:19.807613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:19.807613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:19.807613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:19.807613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:19.807613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:19.807613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:19.811731 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 295/593] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:19.812952 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3ffb5-41bc-4433-b85f-00163321d85a None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:19.854759 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95186a29-ea90-4507-bbd7-0399bbeda11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:19.855546 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95186a29-ea90-4507-bbd7-0399bbeda11a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:19.855822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95186a29-ea90-4507-bbd7-0399bbeda11a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:19.856097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95186a29-ea90-4507-bbd7-0399bbeda11a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:19.867768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95186a29-ea90-4507-bbd7-0399bbeda11a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:19.869222 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95186a29-ea90-4507-bbd7-0399bbeda11a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:19.889147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-95186a29-ea90-4507-bbd7-0399bbeda11a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:19.889147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:19.889147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:19.889147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:19.889147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:19.889147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:19.889147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:19.889147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:19.889147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:19.889147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:19.889147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:19.889147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:19.889147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:19.889147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:19.889147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:19.890286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:19.890286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:19.890286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:19.890286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:19.890286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:19.890286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:19.890286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:19.890286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:19.890286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:19.890286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:19.890286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:19.890286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:19.890286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:19.890286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:19.890286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:19.890286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:19.890286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:19.891258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:19.891258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:19.891258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:19.891258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:19.891258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 299/594] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:19.891258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95186a29-ea90-4507-bbd7-0399bbeda11a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:19.955809 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3ffb5-41bc-4433-b85f-00163321d85a None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:19.991267 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d614e-127c-4a4c-ba81-474d7e95d46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:19.992067 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d614e-127c-4a4c-ba81-474d7e95d46c None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:19.992352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d614e-127c-4a4c-ba81-474d7e95d46c None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:19.992635 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d614e-127c-4a4c-ba81-474d7e95d46c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:20.001325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d614e-127c-4a4c-ba81-474d7e95d46c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:20.002891 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d614e-127c-4a4c-ba81-474d7e95d46c None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:20.004292 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95186a29-ea90-4507-bbd7-0399bbeda11a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:20.017398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-074d614e-127c-4a4c-ba81-474d7e95d46c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 14 19:29:20.017398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:20.017398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:20.017398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:20.017398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:20.017398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:20.017398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:20.017398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:20.017398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:20.017398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:20.017398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:20.017398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:20.017398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:20.017398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:20.017398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:20.017398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:20.018566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:20.018566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:20.018566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:20.018566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:20.018566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:20.018566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:20.018566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:20.018566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:20.018566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:20.018566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:20.018566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:20.018566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:20.018566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:20.018566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:20.018566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:20.018566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:20.018566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:20.018566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:20.020031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:20.020031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:20.020031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:20.020031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:20.020031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:20.020031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:20.020031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:20.020031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:20.020031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 14 19:29:20.020031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:20.023164 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 296/595] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:29:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:20.024442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128c4d5-6a7a-4607-bb6b-8ba57cbef06f None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:20.024731 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128c4d5-6a7a-4607-bb6b-8ba57cbef06f None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:20.025005 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128c4d5-6a7a-4607-bb6b-8ba57cbef06f None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:20.026298 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 297/596] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:20.026971 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128c4d5-6a7a-4607-bb6b-8ba57cbef06f None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:20.046691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c84b1-12ab-41c0-a71a-0361313c8792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:20.047687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c84b1-12ab-41c0-a71a-0361313c8792 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:20.048171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c84b1-12ab-41c0-a71a-0361313c8792 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:20.048632 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c84b1-12ab-41c0-a71a-0361313c8792 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:20.050842 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c84b1-12ab-41c0-a71a-0361313c8792 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:20.051332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c84b1-12ab-41c0-a71a-0361313c8792 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:20.053038 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c84b1-12ab-41c0-a71a-0361313c8792 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:20.063065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:20.073141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 300/597] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:20.074601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c84b1-12ab-41c0-a71a-0361313c8792 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:20.076151 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:20.142897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128c4d5-6a7a-4607-bb6b-8ba57cbef06f None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:20.179234 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2c47d-fc9b-4152-8149-8fca79f3b263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:20.179895 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2c47d-fc9b-4152-8149-8fca79f3b263 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:20.180180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2c47d-fc9b-4152-8149-8fca79f3b263 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:20.180463 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2c47d-fc9b-4152-8149-8fca79f3b263 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:20.181184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2c47d-fc9b-4152-8149-8fca79f3b263 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:20.181526 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2c47d-fc9b-4152-8149-8fca79f3b263 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:20.182908 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2c47d-fc9b-4152-8149-8fca79f3b263 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:20.183575 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c84b1-12ab-41c0-a71a-0361313c8792 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:20.207465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 298/598] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:20.207465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb258965-38df-4d4f-a6e9-6f3c8f13e1f4 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:20.207465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb258965-38df-4d4f-a6e9-6f3c8f13e1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:20.207465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb258965-38df-4d4f-a6e9-6f3c8f13e1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:20.221041 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-cb258965-38df-4d4f-a6e9-6f3c8f13e1f4 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:20.222882 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-cb258965-38df-4d4f-a6e9-6f3c8f13e1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:20.233817 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a83da-ee58-4744-908c-47445cc1edfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:20.234491 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a83da-ee58-4744-908c-47445cc1edfd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:20.234778 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a83da-ee58-4744-908c-47445cc1edfd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:20.235057 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a83da-ee58-4744-908c-47445cc1edfd None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:20.235889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a83da-ee58-4744-908c-47445cc1edfd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:20.236206 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a83da-ee58-4744-908c-47445cc1edfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:20.238438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a83da-ee58-4744-908c-47445cc1edfd None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:20.260312 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 301/599] 10.222.0.44 () {56 vars in 1139 bytes} [Tue Jun 14 19:29:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:20.260312 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a83da-ee58-4744-908c-47445cc1edfd None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:20.301166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 299/600] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:20.302238 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb258965-38df-4d4f-a6e9-6f3c8f13e1f4 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:20.326309 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:20.336205 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:20.375079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a83da-ee58-4744-908c-47445cc1edfd None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:20.412068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb258965-38df-4d4f-a6e9-6f3c8f13e1f4 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:20.413674 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62202c-c715-4dc0-9d37-e93d0c41e664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:20.414565 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62202c-c715-4dc0-9d37-e93d0c41e664 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:20.414848 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62202c-c715-4dc0-9d37-e93d0c41e664 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:20.415124 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b62202c-c715-4dc0-9d37-e93d0c41e664 None admin] PATH_INFO: `/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/caa134b748854fb3b4de54b04390eec9/roles/539442ef092c4fcf9e1d0be045928c5a` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:20.430346 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62202c-c715-4dc0-9d37-e93d0c41e664 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d3e177b11504cb3b19d25ed5850ef12, user_id=caa134b748854fb3b4de54b04390eec9, role_id=539442ef092c4fcf9e1d0be045928c5a)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:20.431813 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b62202c-c715-4dc0-9d37-e93d0c41e664 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:20.446177 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 302/601] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:29:20 2022] PUT /identity/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/caa134b748854fb3b4de54b04390eec9/roles/539442ef092c4fcf9e1d0be045928c5a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:29:20.449024 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d0fc2-c57a-419e-a3bb-8dceb51c4d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:20.449877 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d0fc2-c57a-419e-a3bb-8dceb51c4d06 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:20.450162 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d0fc2-c57a-419e-a3bb-8dceb51c4d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:20.450438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d0fc2-c57a-419e-a3bb-8dceb51c4d06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:20.458423 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62202c-c715-4dc0-9d37-e93d0c41e664 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:20.458882 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d0fc2-c57a-419e-a3bb-8dceb51c4d06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:20.460353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d0fc2-c57a-419e-a3bb-8dceb51c4d06 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:20.478000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-e72d0fc2-c57a-419e-a3bb-8dceb51c4d06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:20.478000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:20.478000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:20.478000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:20.478000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:20.478000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:20.478000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:20.478000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:20.478000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:20.478000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:20.478000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:20.478000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:20.478000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:20.478000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:20.478000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:20.479050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:20.479050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:20.479050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:20.479050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:20.479050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:20.479050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:20.479050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:20.479050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:20.479050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:20.479050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:20.479050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:20.479050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:20.479050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:20.479050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:20.479050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:20.479050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:20.479050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:20.479965 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:20.479965 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:20.479965 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:20.479965 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:20.479965 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:20.479965 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:20.479965 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:20.479965 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:20.484185 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 300/602] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:20.485160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d0fc2-c57a-419e-a3bb-8dceb51c4d06 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:20.593484 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:20.604932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d0fc2-c57a-419e-a3bb-8dceb51c4d06 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:20.620571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b62202c-c715-4dc0-9d37-e93d0c41e664 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:20.632984 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:20.651479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4c829-e446-4483-9c65-96dbf03b28c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:20.651845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4c829-e446-4483-9c65-96dbf03b28c7 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:20.652034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4c829-e446-4483-9c65-96dbf03b28c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:20.652305 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4c829-e446-4483-9c65-96dbf03b28c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:20.670443 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4c829-e446-4483-9c65-96dbf03b28c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:20.671456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca1ea3-048c-478d-bbe7-9170010ae866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:20.672260 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca1ea3-048c-478d-bbe7-9170010ae866 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:20.672548 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca1ea3-048c-478d-bbe7-9170010ae866 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:20.672827 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca1ea3-048c-478d-bbe7-9170010ae866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:20.678901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-d4a4c829-e446-4483-9c65-96dbf03b28c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:20.678901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:20.678901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:20.678901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:20.678901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:20.678901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:20.678901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:20.678901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:20.678901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:20.678901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:20.678901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:20.678901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:20.678901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:20.678901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:20.678901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:20.678901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:20.679824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:20.679824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:20.679824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:20.679824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:20.679824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:20.679824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:20.679824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:20.679824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:20.679824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:20.679824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:20.679824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:20.679824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:20.679824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:20.679824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:20.679824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:20.679824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:20.680667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:20.680667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:20.680667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:20.680667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:20.680667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:20.680667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:20.680667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:20.680667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:20.680667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:20.680667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:20.680667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:20.680667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:20.681314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 301/603] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:29:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:20.682042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4c829-e446-4483-9c65-96dbf03b28c7 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:20.683662 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca1ea3-048c-478d-bbe7-9170010ae866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:20.685153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca1ea3-048c-478d-bbe7-9170010ae866 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:20.708766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-77ca1ea3-048c-478d-bbe7-9170010ae866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:20.708766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:20.708766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:20.708766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:20.708766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:20.708766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:20.708766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:20.708766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:20.708766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:20.708766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:20.708766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:20.708766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:20.708766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:20.708766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:20.708766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:20.709733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:20.709733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:20.709733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:20.709733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:20.709733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:20.709733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:20.709733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:20.709733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:20.709733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:20.709733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:20.709733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:20.709733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:20.709733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:20.709733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:20.709733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:20.709733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:20.709733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:20.710606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:20.710606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:20.710606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:20.710606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:20.710838 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 303/604] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:20.714053 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca1ea3-048c-478d-bbe7-9170010ae866 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:20.806044 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4c829-e446-4483-9c65-96dbf03b28c7 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:20.847324 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890aa3a-cada-4505-ac3f-c548b5a4a3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:20.847911 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890aa3a-cada-4505-ac3f-c548b5a4a3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:20.848201 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890aa3a-cada-4505-ac3f-c548b5a4a3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:20.848480 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890aa3a-cada-4505-ac3f-c548b5a4a3d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:20.849280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890aa3a-cada-4505-ac3f-c548b5a4a3d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:20.849617 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890aa3a-cada-4505-ac3f-c548b5a4a3d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:20.851067 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890aa3a-cada-4505-ac3f-c548b5a4a3d0 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:20.866582 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca1ea3-048c-478d-bbe7-9170010ae866 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:20.866793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 302/605] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:20.867235 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890aa3a-cada-4505-ac3f-c548b5a4a3d0 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:20.888326 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:20.909504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a562aeb-2ad7-4892-bc73-7a8436543867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:20.910180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a562aeb-2ad7-4892-bc73-7a8436543867 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:20.910466 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a562aeb-2ad7-4892-bc73-7a8436543867 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:20.910813 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a562aeb-2ad7-4892-bc73-7a8436543867 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:20.911497 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a562aeb-2ad7-4892-bc73-7a8436543867 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:20.911808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a562aeb-2ad7-4892-bc73-7a8436543867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:20.913191 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a562aeb-2ad7-4892-bc73-7a8436543867 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:20.922381 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 304/606] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jun 14 19:29:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:20.923360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a562aeb-2ad7-4892-bc73-7a8436543867 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:20.949281 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:21.004875 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890aa3a-cada-4505-ac3f-c548b5a4a3d0 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:21.035112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a562aeb-2ad7-4892-bc73-7a8436543867 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:21.044676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e7137-3152-48c7-a8e4-9ec79d73b5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:21.045584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e7137-3152-48c7-a8e4-9ec79d73b5be None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:21.045759 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e7137-3152-48c7-a8e4-9ec79d73b5be None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:21.046029 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e7137-3152-48c7-a8e4-9ec79d73b5be None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:21.046751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e7137-3152-48c7-a8e4-9ec79d73b5be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:21.047059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e7137-3152-48c7-a8e4-9ec79d73b5be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:21.048549 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e7137-3152-48c7-a8e4-9ec79d73b5be None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:21.067441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 303/607] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:21.067441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e7137-3152-48c7-a8e4-9ec79d73b5be None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:21.083656 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbe510-e48f-489e-8c2d-05b1d2351d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:21.084656 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbe510-e48f-489e-8c2d-05b1d2351d59 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:21.085013 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbe510-e48f-489e-8c2d-05b1d2351d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:21.085361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbe510-e48f-489e-8c2d-05b1d2351d59 None admin] PATH_INFO: `/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/e5c2502cf1a14203bec13879a47f47ee/roles/539442ef092c4fcf9e1d0be045928c5a` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:21.105931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbe510-e48f-489e-8c2d-05b1d2351d59 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d3e177b11504cb3b19d25ed5850ef12, user_id=e5c2502cf1a14203bec13879a47f47ee, role_id=539442ef092c4fcf9e1d0be045928c5a)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:21.108553 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbe510-e48f-489e-8c2d-05b1d2351d59 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:21.130173 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 305/608] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:29:20 2022] PUT /identity/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/e5c2502cf1a14203bec13879a47f47ee/roles/539442ef092c4fcf9e1d0be045928c5a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:29:21.131304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbe510-e48f-489e-8c2d-05b1d2351d59 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:21.173858 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:21.226594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:21.242130 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e7137-3152-48c7-a8e4-9ec79d73b5be None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:21.269356 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbe510-e48f-489e-8c2d-05b1d2351d59 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:21.311587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83725594-2830-4430-b1d6-4b94352771b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:21.312455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83725594-2830-4430-b1d6-4b94352771b5 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:21.312739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83725594-2830-4430-b1d6-4b94352771b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:21.313017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83725594-2830-4430-b1d6-4b94352771b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:21.313966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91458bf-da0a-4586-9ce0-2542d5eed107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:21.316084 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91458bf-da0a-4586-9ce0-2542d5eed107 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:21.317167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91458bf-da0a-4586-9ce0-2542d5eed107 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:21.317732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91458bf-da0a-4586-9ce0-2542d5eed107 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:21.326459 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91458bf-da0a-4586-9ce0-2542d5eed107 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:21.328358 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91458bf-da0a-4586-9ce0-2542d5eed107 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:21.338603 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83725594-2830-4430-b1d6-4b94352771b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:21.340085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83725594-2830-4430-b1d6-4b94352771b5 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:21.347276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-a91458bf-da0a-4586-9ce0-2542d5eed107 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:21.347276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:21.347276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:21.347276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:21.347276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:21.347276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:21.347276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:21.347276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:21.347276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:21.347276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:21.347276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:21.347276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:21.347276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:21.347276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:21.347276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:21.348285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:21.348285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:21.348285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:21.348285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:21.348285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:21.348285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:21.348285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:21.348285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:21.348285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:21.348285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:21.348285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:21.348285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:21.348285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:21.348285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:21.348285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:21.348285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:21.348285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:21.349167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:21.349167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:21.349167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:21.349167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:21.349167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:21.349167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:21.349167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:21.349167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:21.351738 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 306/609] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:21.358447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91458bf-da0a-4586-9ce0-2542d5eed107 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:21.378887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-83725594-2830-4430-b1d6-4b94352771b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:21.378887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:21.378887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:21.378887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:21.378887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:21.378887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:21.378887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:21.378887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:21.378887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:21.378887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:21.378887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:21.378887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:21.378887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:21.378887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:21.378887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:21.379868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:21.379868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:21.379868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:21.379868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:21.379868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:21.379868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:21.379868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:21.379868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:21.379868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:21.379868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:21.379868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:21.379868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:21.379868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:21.379868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:21.379868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:21.379868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:21.379868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:21.380738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:21.380738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:21.380738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:21.380738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:21.380738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 304/610] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:21.387329 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83725594-2830-4430-b1d6-4b94352771b5 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:21.481354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91458bf-da0a-4586-9ce0-2542d5eed107 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:21.520071 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104d807-6da0-438d-bfe5-2cd60e727f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:21.521414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104d807-6da0-438d-bfe5-2cd60e727f90 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:21.521969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104d807-6da0-438d-bfe5-2cd60e727f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:21.522458 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104d807-6da0-438d-bfe5-2cd60e727f90 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:21.523217 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83725594-2830-4430-b1d6-4b94352771b5 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:21.524018 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104d807-6da0-438d-bfe5-2cd60e727f90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:21.524627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104d807-6da0-438d-bfe5-2cd60e727f90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:21.529569 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:21.530057 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f104d807-6da0-438d-bfe5-2cd60e727f90 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:21.550035 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 307/611] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:21.551054 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:21.553604 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104d807-6da0-438d-bfe5-2cd60e727f90 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:21.562824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850657bb-1644-4db4-8312-fff5365d158c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:21.563497 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850657bb-1644-4db4-8312-fff5365d158c None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:21.563785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850657bb-1644-4db4-8312-fff5365d158c None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:21.564070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850657bb-1644-4db4-8312-fff5365d158c None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:21.564864 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850657bb-1644-4db4-8312-fff5365d158c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:21.565477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850657bb-1644-4db4-8312-fff5365d158c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:21.566896 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850657bb-1644-4db4-8312-fff5365d158c None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:21.579660 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 305/612] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:21.586428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850657bb-1644-4db4-8312-fff5365d158c None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:21.664055 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104d807-6da0-438d-bfe5-2cd60e727f90 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:21.707113 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62dd92-f9f0-4c05-ab2f-db938c3e9401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:21.708275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62dd92-f9f0-4c05-ab2f-db938c3e9401 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:21.708999 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62dd92-f9f0-4c05-ab2f-db938c3e9401 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:21.709485 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62dd92-f9f0-4c05-ab2f-db938c3e9401 None admin] PATH_INFO: `/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/791ed0f433834b4599d6bc825440279d/roles/539442ef092c4fcf9e1d0be045928c5a` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:21.728619 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62dd92-f9f0-4c05-ab2f-db938c3e9401 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d3e177b11504cb3b19d25ed5850ef12, user_id=791ed0f433834b4599d6bc825440279d, role_id=539442ef092c4fcf9e1d0be045928c5a)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:21.730589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62dd92-f9f0-4c05-ab2f-db938c3e9401 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:21.748151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 308/613] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:29:21 2022] PUT /identity/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/791ed0f433834b4599d6bc825440279d/roles/539442ef092c4fcf9e1d0be045928c5a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:29:21.801157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850657bb-1644-4db4-8312-fff5365d158c None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:21.852484 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51640f8f-fa35-46f5-8226-748fa2c0eef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:21.853299 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51640f8f-fa35-46f5-8226-748fa2c0eef6 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:21.853615 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51640f8f-fa35-46f5-8226-748fa2c0eef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:21.853894 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51640f8f-fa35-46f5-8226-748fa2c0eef6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:21.870372 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51640f8f-fa35-46f5-8226-748fa2c0eef6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:21.871939 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51640f8f-fa35-46f5-8226-748fa2c0eef6 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:21.885051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dff99d-f6a8-4201-98b3-4f292db5f753 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:21.885876 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dff99d-f6a8-4201-98b3-4f292db5f753 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:21.886414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dff99d-f6a8-4201-98b3-4f292db5f753 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:21.888250 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 309/614] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:21.898829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-51640f8f-fa35-46f5-8226-748fa2c0eef6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 14 19:29:21.898829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:21.898829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:21.898829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:21.898829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:21.898829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:21.898829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:21.898829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:21.898829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:21.898829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:21.898829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:21.898829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:21.898829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:21.898829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:21.898829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:21.898829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:21.899829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:21.899829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:21.899829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:21.899829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:21.899829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:21.899829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:21.899829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:21.899829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:21.899829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:21.899829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:21.899829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:21.899829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:21.899829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:21.899829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:21.899829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:21.899829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:21.899829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:21.899829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:21.900751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:21.900751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:21.900751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:21.900751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:21.900751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:21.900751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:21.900751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:21.900751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:21.900751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 14 19:29:21.900751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:21.900751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 306/615] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:29:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:21.903410 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bfc5f-2b08-42e8-863c-010698d6dcc4 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:21.903923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bfc5f-2b08-42e8-863c-010698d6dcc4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:21.904423 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bfc5f-2b08-42e8-863c-010698d6dcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:21.910597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51640f8f-fa35-46f5-8226-748fa2c0eef6 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:21.925870 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-612bfc5f-2b08-42e8-863c-010698d6dcc4 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:21.928099 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-612bfc5f-2b08-42e8-863c-010698d6dcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:21.973567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:22.004028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:22.018552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 310/616] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:22.050893 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bfc5f-2b08-42e8-863c-010698d6dcc4 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:22.070970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51640f8f-fa35-46f5-8226-748fa2c0eef6 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:22.108814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94aa061-1f6c-4b08-a25a-3f3a5e65fde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:22.109534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94aa061-1f6c-4b08-a25a-3f3a5e65fde0 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:22.109822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94aa061-1f6c-4b08-a25a-3f3a5e65fde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:22.110098 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94aa061-1f6c-4b08-a25a-3f3a5e65fde0 None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:22.110943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94aa061-1f6c-4b08-a25a-3f3a5e65fde0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:22.111254 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94aa061-1f6c-4b08-a25a-3f3a5e65fde0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:22.112733 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94aa061-1f6c-4b08-a25a-3f3a5e65fde0 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:22.141216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 307/617] 10.222.0.44 () {56 vars in 1135 bytes} [Tue Jun 14 19:29:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:22.160978 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94aa061-1f6c-4b08-a25a-3f3a5e65fde0 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:22.181492 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bfc5f-2b08-42e8-863c-010698d6dcc4 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:22.212774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870f679-faae-40b1-9a49-a33a232dc2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:22.213607 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870f679-faae-40b1-9a49-a33a232dc2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:22.213953 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870f679-faae-40b1-9a49-a33a232dc2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:22.214244 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870f679-faae-40b1-9a49-a33a232dc2c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:22.225572 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870f679-faae-40b1-9a49-a33a232dc2c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:22.233903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-e870f679-faae-40b1-9a49-a33a232dc2c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:22.233903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:22.233903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:22.233903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:22.233903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:22.233903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:22.233903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:22.233903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:22.233903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:22.233903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:22.233903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:22.233903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:22.233903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:22.233903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:22.233903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:22.233903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:22.234814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:22.234814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:22.234814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:22.234814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:22.234814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:22.234814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:22.234814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:22.234814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:22.234814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:22.234814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:22.234814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:22.234814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:22.234814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:22.234814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:22.234814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:22.234814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:22.235622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:22.235622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:22.235622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:22.235622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:22.235622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:22.235622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:22.235622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:22.235622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:22.235622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:22.235622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:22.235622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:22.235622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:22.235622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 311/618] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:29:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:22.241005 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870f679-faae-40b1-9a49-a33a232dc2c9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:22.302741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:22.351116 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94aa061-1f6c-4b08-a25a-3f3a5e65fde0 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:22.354836 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:22.411173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef92a9-e5e0-4be9-9a2a-3ac513fbb04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:22.413042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef92a9-e5e0-4be9-9a2a-3ac513fbb04e None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:22.413716 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef92a9-e5e0-4be9-9a2a-3ac513fbb04e None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:22.415492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef92a9-e5e0-4be9-9a2a-3ac513fbb04e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:22.425944 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870f679-faae-40b1-9a49-a33a232dc2c9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:22.434816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef92a9-e5e0-4be9-9a2a-3ac513fbb04e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:22.436219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef92a9-e5e0-4be9-9a2a-3ac513fbb04e None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:22.464322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-1cef92a9-e5e0-4be9-9a2a-3ac513fbb04e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:22.464322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:22.464322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:22.464322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:22.464322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:22.464322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:22.464322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:22.464322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:22.464322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:22.464322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:22.464322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:22.464322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:22.464322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:22.464322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:22.464322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:22.465428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:22.465428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:22.465428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:22.465428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:22.465428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:22.465428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:22.465428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:22.465428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:22.465428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:22.465428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:22.465428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:22.465428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:22.465428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:22.465428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:22.465428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:22.465428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:22.465428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:22.466304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:22.466304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:22.466304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:22.466304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:22.476073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 308/619] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:22.480184 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd313d11-2b04-4fee-b748-b1cf68c81f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:22.481558 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef92a9-e5e0-4be9-9a2a-3ac513fbb04e None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:22.482436 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd313d11-2b04-4fee-b748-b1cf68c81f6d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:22.483318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd313d11-2b04-4fee-b748-b1cf68c81f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:22.484167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd313d11-2b04-4fee-b748-b1cf68c81f6d None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:22.486205 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd313d11-2b04-4fee-b748-b1cf68c81f6d None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:22.487801 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd313d11-2b04-4fee-b748-b1cf68c81f6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:22.489475 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd313d11-2b04-4fee-b748-b1cf68c81f6d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:22.506655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 312/620] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jun 14 19:29:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:22.511761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd313d11-2b04-4fee-b748-b1cf68c81f6d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:22.678826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd313d11-2b04-4fee-b748-b1cf68c81f6d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:22.691851 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:22.715981 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef92a9-e5e0-4be9-9a2a-3ac513fbb04e None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:22.716791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad65de-f7e9-4e9e-88b0-c3034614c348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:22.717644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad65de-f7e9-4e9e-88b0-c3034614c348 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:22.718109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad65de-f7e9-4e9e-88b0-c3034614c348 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:22.718399 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ad65de-f7e9-4e9e-88b0-c3034614c348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:22.744106 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad65de-f7e9-4e9e-88b0-c3034614c348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:22.745638 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ad65de-f7e9-4e9e-88b0-c3034614c348 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:22.775561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-f5ad65de-f7e9-4e9e-88b0-c3034614c348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:22.775561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:22.775561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:22.775561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:22.775561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:22.775561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:22.775561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:22.775561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:22.775561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:22.775561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:22.775561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:22.775561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:22.775561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:22.775561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:22.775561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:22.776504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:22.776504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:22.776504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:22.776504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:22.776504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:22.776504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:22.776504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:22.776504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:22.776504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:22.776504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:22.776504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:22.776504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:22.776504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:22.776504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:22.776504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:22.776504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:22.776504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:22.777396 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:22.777396 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:22.777396 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:22.777396 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:22.779008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 313/621] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:22.782858 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad65de-f7e9-4e9e-88b0-c3034614c348 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:22.797761 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279eeac3-5e81-4cfd-98ce-2bf32c7da631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:22.798527 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279eeac3-5e81-4cfd-98ce-2bf32c7da631 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:22.798818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279eeac3-5e81-4cfd-98ce-2bf32c7da631 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:22.799161 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279eeac3-5e81-4cfd-98ce-2bf32c7da631 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:22.799904 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279eeac3-5e81-4cfd-98ce-2bf32c7da631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:22.800220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279eeac3-5e81-4cfd-98ce-2bf32c7da631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:22.801740 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279eeac3-5e81-4cfd-98ce-2bf32c7da631 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:22.837077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 309/622] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:22.842037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279eeac3-5e81-4cfd-98ce-2bf32c7da631 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:22.873754 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:22.924442 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ad65de-f7e9-4e9e-88b0-c3034614c348 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:22.959426 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279eeac3-5e81-4cfd-98ce-2bf32c7da631 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:22.967517 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924e0c8-4331-4fe3-9b10-b07daab90a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:22.968189 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924e0c8-4331-4fe3-9b10-b07daab90a17 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:22.968478 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924e0c8-4331-4fe3-9b10-b07daab90a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:22.968761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924e0c8-4331-4fe3-9b10-b07daab90a17 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:22.969520 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924e0c8-4331-4fe3-9b10-b07daab90a17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:22.969833 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924e0c8-4331-4fe3-9b10-b07daab90a17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:22.972225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924e0c8-4331-4fe3-9b10-b07daab90a17 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:22.991687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 314/623] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:22.991687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1893977-5e5f-4e17-a6f6-ee5a0fc1171d None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:22.991687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1893977-5e5f-4e17-a6f6-ee5a0fc1171d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:22.991687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1893977-5e5f-4e17-a6f6-ee5a0fc1171d None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:22.991687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 315/624] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:22.992128 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1893977-5e5f-4e17-a6f6-ee5a0fc1171d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:23.002805 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:23.009211 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0178d-0067-4d72-a2bc-66ad9b16c55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:23.010353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0178d-0067-4d72-a2bc-66ad9b16c55d None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:23.010815 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0178d-0067-4d72-a2bc-66ad9b16c55d None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:23.011372 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0178d-0067-4d72-a2bc-66ad9b16c55d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:23.019643 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0178d-0067-4d72-a2bc-66ad9b16c55d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:23.021335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0178d-0067-4d72-a2bc-66ad9b16c55d None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:23.037017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-07b0178d-0067-4d72-a2bc-66ad9b16c55d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:23.037017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:23.037017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:23.037017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:23.037017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:23.037017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:23.037017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:23.037017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:23.037017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:23.037017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:23.037017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:23.037017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:23.037017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:23.037017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:23.037017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:23.037976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:23.037976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:23.037976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:23.037976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:23.037976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:23.037976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:23.037976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:23.037976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:23.037976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:23.037976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:23.037976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:23.037976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:23.037976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:23.037976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:23.037976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:23.037976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:23.037976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:23.038835 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:23.038835 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:23.038835 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:23.038835 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:23.038835 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:23.038835 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:23.038835 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:23.038835 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:23.041765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 310/625] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:23.043296 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc8745-5519-47ce-b365-84272a3ce22b None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:23.044685 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc8745-5519-47ce-b365-84272a3ce22b None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:23.045185 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc8745-5519-47ce-b365-84272a3ce22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:23.062751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-e1fc8745-5519-47ce-b365-84272a3ce22b None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:23.064305 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e1fc8745-5519-47ce-b365-84272a3ce22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:23.116261 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1893977-5e5f-4e17-a6f6-ee5a0fc1171d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:23.145640 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 311/626] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:23.146451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc8745-5519-47ce-b365-84272a3ce22b None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:23.157605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66305e44-53dd-4ac9-856d-939ea9b3222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:23.158538 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66305e44-53dd-4ac9-856d-939ea9b3222d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:23.158779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66305e44-53dd-4ac9-856d-939ea9b3222d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:23.159112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66305e44-53dd-4ac9-856d-939ea9b3222d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:23.165747 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:23.167423 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66305e44-53dd-4ac9-856d-939ea9b3222d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:23.168926 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66305e44-53dd-4ac9-856d-939ea9b3222d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:23.185771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-66305e44-53dd-4ac9-856d-939ea9b3222d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 19:29:23.185771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:23.185771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:23.185771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:23.185771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:23.185771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:23.185771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:23.185771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:23.185771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:23.185771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:23.185771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:23.185771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:23.185771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:23.185771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:23.185771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:23.185771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:23.186741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:23.186741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:23.186741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:23.186741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:23.186741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:23.186741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:23.186741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:23.186741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:23.186741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:23.186741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:23.186741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:23.186741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:23.186741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:23.186741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:23.186741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:23.186741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:23.186741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:23.186741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:23.187659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:23.187659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:23.187659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:23.187659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:23.187659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:23.187659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:23.187659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:23.187659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:23.187659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 19:29:23.187659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:23.195112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 316/627] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jun 14 19:29:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:23.196201 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66305e44-53dd-4ac9-856d-939ea9b3222d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:23.266725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:23.278292 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc8745-5519-47ce-b365-84272a3ce22b None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:23.306536 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66305e44-53dd-4ac9-856d-939ea9b3222d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:23.314579 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c024a-3e82-4049-8507-d9207cf58ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:23.315936 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c024a-3e82-4049-8507-d9207cf58ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:23.316413 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c024a-3e82-4049-8507-d9207cf58ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:23.316681 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c024a-3e82-4049-8507-d9207cf58ef4 None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:23.317505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c024a-3e82-4049-8507-d9207cf58ef4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:23.317824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c024a-3e82-4049-8507-d9207cf58ef4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:23.319274 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c024a-3e82-4049-8507-d9207cf58ef4 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:23.332635 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 312/628] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:23.333557 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c024a-3e82-4049-8507-d9207cf58ef4 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:23.347145 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e1305-3f3a-4d22-8fd5-0d47bdfa9dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:23.348399 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e1305-3f3a-4d22-8fd5-0d47bdfa9dce None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:23.348926 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e1305-3f3a-4d22-8fd5-0d47bdfa9dce None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:23.349484 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e1305-3f3a-4d22-8fd5-0d47bdfa9dce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:23.360458 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e1305-3f3a-4d22-8fd5-0d47bdfa9dce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:23.368543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-3b3e1305-3f3a-4d22-8fd5-0d47bdfa9dce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:23.368543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:23.368543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:23.368543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:23.368543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:23.368543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:23.368543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:23.368543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:23.368543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:23.368543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:23.368543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:23.368543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:23.368543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:23.368543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:23.368543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:23.368543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:23.369463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:23.369463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:23.369463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:23.369463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:23.369463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:23.369463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:23.369463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:23.369463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:23.369463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:23.369463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:23.369463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:23.369463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:23.369463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:23.369463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:23.369463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:23.369463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:23.370271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:23.370271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:23.370271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:23.370271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:23.370271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:23.370271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:23.370271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:23.370271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:23.370271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:23.370271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:23.370271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:23.370271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:23.377467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 317/629] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:29:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:23.378655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e1305-3f3a-4d22-8fd5-0d47bdfa9dce None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:23.398168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:23.441003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c024a-3e82-4049-8507-d9207cf58ef4 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:23.478225 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2474db-67d3-4188-8674-9a3a9915a90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:23.478893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2474db-67d3-4188-8674-9a3a9915a90a None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:23.479424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2474db-67d3-4188-8674-9a3a9915a90a None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:23.479424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2474db-67d3-4188-8674-9a3a9915a90a None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:23.480285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2474db-67d3-4188-8674-9a3a9915a90a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:23.480590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2474db-67d3-4188-8674-9a3a9915a90a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:23.482057 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2474db-67d3-4188-8674-9a3a9915a90a None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:23.489345 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e1305-3f3a-4d22-8fd5-0d47bdfa9dce None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:23.504587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 313/630] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jun 14 19:29:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:23.504587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2474db-67d3-4188-8674-9a3a9915a90a None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:23.521974 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:23.532320 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761e03d-d347-4350-a25c-eadad0990880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:23.534234 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761e03d-d347-4350-a25c-eadad0990880 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:23.534758 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761e03d-d347-4350-a25c-eadad0990880 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:23.535182 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761e03d-d347-4350-a25c-eadad0990880 None admin] PATH_INFO: `/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/7fff5414195f4873bcc8752c914b6b49/roles/539442ef092c4fcf9e1d0be045928c5a` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:23.553278 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761e03d-d347-4350-a25c-eadad0990880 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d3e177b11504cb3b19d25ed5850ef12, user_id=7fff5414195f4873bcc8752c914b6b49, role_id=539442ef092c4fcf9e1d0be045928c5a)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:23.554986 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761e03d-d347-4350-a25c-eadad0990880 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:23.572621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 318/631] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:29:23 2022] PUT /identity/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/7fff5414195f4873bcc8752c914b6b49/roles/539442ef092c4fcf9e1d0be045928c5a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:29:23.574178 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761e03d-d347-4350-a25c-eadad0990880 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:23.639420 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2474db-67d3-4188-8674-9a3a9915a90a None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:23.670138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:23.684196 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc9c3c-c387-4902-ab21-76d0fec6b724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:23.684876 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc9c3c-c387-4902-ab21-76d0fec6b724 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:23.685156 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc9c3c-c387-4902-ab21-76d0fec6b724 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:23.685449 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc9c3c-c387-4902-ab21-76d0fec6b724 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:23.689398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc9c3c-c387-4902-ab21-76d0fec6b724 None admin] RBAC: Adding query filter params (name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:23.689398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc9c3c-c387-4902-ab21-76d0fec6b724 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:23.689398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc9c3c-c387-4902-ab21-76d0fec6b724 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:23.699663 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 314/632] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jun 14 19:29:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:23.705865 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc9c3c-c387-4902-ab21-76d0fec6b724 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:23.757934 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761e03d-d347-4350-a25c-eadad0990880 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:23.833403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc9c3c-c387-4902-ab21-76d0fec6b724 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:23.844527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f6697-3934-4c6e-aff5-ae1f4e7c9a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:23.845444 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f6697-3934-4c6e-aff5-ae1f4e7c9a20 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:23.846373 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f6697-3934-4c6e-aff5-ae1f4e7c9a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:23.846802 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f6697-3934-4c6e-aff5-ae1f4e7c9a20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:23.891396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde03b45-00b4-4bd0-b05d-f4c367e92a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:23.892210 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde03b45-00b4-4bd0-b05d-f4c367e92a54 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:23.892521 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde03b45-00b4-4bd0-b05d-f4c367e92a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:23.892844 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde03b45-00b4-4bd0-b05d-f4c367e92a54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:23.914614 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde03b45-00b4-4bd0-b05d-f4c367e92a54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:23.917030 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde03b45-00b4-4bd0-b05d-f4c367e92a54 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:23.930584 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:23.938879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-bde03b45-00b4-4bd0-b05d-f4c367e92a54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:23.938879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:23.938879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:23.938879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:23.938879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:23.938879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:23.938879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:23.938879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:23.938879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:23.938879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:23.938879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:23.938879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:23.938879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:23.938879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:23.938879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:23.940055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:23.940055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:23.940055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:23.940055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:23.940055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:23.940055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:23.940055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:23.940055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:23.940055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:23.940055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:23.940055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:23.940055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:23.940055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:23.940055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:23.940055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:23.940055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:23.940055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:23.941260 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:23.941260 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:23.941260 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:23.941260 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:23.945459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 315/633] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:23.950861 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde03b45-00b4-4bd0-b05d-f4c367e92a54 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:23.960043 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f6697-3934-4c6e-aff5-ae1f4e7c9a20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:23.961860 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f6697-3934-4c6e-aff5-ae1f4e7c9a20 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:23.991083 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:24.075569 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 319/634] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:29:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:29:24.083272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde03b45-00b4-4bd0-b05d-f4c367e92a54 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:24.083685 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8a440-7e4c-43d4-99c6-522e5a0468de None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:24.084353 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8a440-7e4c-43d4-99c6-522e5a0468de None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:24.084843 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8a440-7e4c-43d4-99c6-522e5a0468de None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:24.086466 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 320/635] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:24 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:24.087444 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8a440-7e4c-43d4-99c6-522e5a0468de None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:24.145504 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0faa7-356a-4356-a83b-e86527595bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:24.146621 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0faa7-356a-4356-a83b-e86527595bee None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:24.147121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0faa7-356a-4356-a83b-e86527595bee None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:24.147606 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0faa7-356a-4356-a83b-e86527595bee None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:24.148619 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0faa7-356a-4356-a83b-e86527595bee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:24.149164 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0faa7-356a-4356-a83b-e86527595bee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:24.151020 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0faa7-356a-4356-a83b-e86527595bee None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:24.172050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 316/636] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:24.173932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb9ba9-192d-4441-bf06-182968251a9c None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:24.175065 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb9ba9-192d-4441-bf06-182968251a9c None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:24.175636 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb9ba9-192d-4441-bf06-182968251a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:24.191526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:24.195221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-edfb9ba9-192d-4441-bf06-182968251a9c None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:24.197434 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-edfb9ba9-192d-4441-bf06-182968251a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:24.226182 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8a440-7e4c-43d4-99c6-522e5a0468de None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:24.264234 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e41e50-0930-4f4e-b65f-9be60dffd717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:24.265459 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e41e50-0930-4f4e-b65f-9be60dffd717 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:24.265958 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e41e50-0930-4f4e-b65f-9be60dffd717 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:24.266299 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e41e50-0930-4f4e-b65f-9be60dffd717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:24.278529 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e41e50-0930-4f4e-b65f-9be60dffd717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:24.279999 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e41e50-0930-4f4e-b65f-9be60dffd717 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:24.284789 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 317/637] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:24.285856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb9ba9-192d-4441-bf06-182968251a9c None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:24.305785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-74e41e50-0930-4f4e-b65f-9be60dffd717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:24.305785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:24.305785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:24.305785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:24.305785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:24.305785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:24.305785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:24.305785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:24.305785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:24.305785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:24.305785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:24.305785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:24.305785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:24.305785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:24.305785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:24.307308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:24.307308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:24.307308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:24.307308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:24.307308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:24.307308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:24.307308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:24.307308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:24.307308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:24.307308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:24.307308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:24.307308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:24.307308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:24.307308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:24.307308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:24.307308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:24.307308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:24.308547 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:24.308547 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:24.308547 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:24.308547 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:24.309776 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 321/638] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:24.311305 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3501bb-d6ad-4a72-baba-9fc86b73cd35 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:24.311695 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3501bb-d6ad-4a72-baba-9fc86b73cd35 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:24.312120 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3501bb-d6ad-4a72-baba-9fc86b73cd35 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:24.317597 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 322/639] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:24.318772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3501bb-d6ad-4a72-baba-9fc86b73cd35 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:24.332904 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:24.415575 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb9ba9-192d-4441-bf06-182968251a9c None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:24.440866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3501bb-d6ad-4a72-baba-9fc86b73cd35 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:24.452523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d05c50-b1ce-4865-b008-6a475ab1cf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:24.453328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d05c50-b1ce-4865-b008-6a475ab1cf35 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:24.453642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d05c50-b1ce-4865-b008-6a475ab1cf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:24.453920 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d05c50-b1ce-4865-b008-6a475ab1cf35 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:24.463079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d05c50-b1ce-4865-b008-6a475ab1cf35 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:24.464520 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d05c50-b1ce-4865-b008-6a475ab1cf35 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:24.469136 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:24.478606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85621393-b7fa-4b7d-95e1-69002690568b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:24.479273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85621393-b7fa-4b7d-95e1-69002690568b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:24.479562 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85621393-b7fa-4b7d-95e1-69002690568b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:24.479845 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85621393-b7fa-4b7d-95e1-69002690568b None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:24.480575 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85621393-b7fa-4b7d-95e1-69002690568b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:24.480886 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85621393-b7fa-4b7d-95e1-69002690568b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:24.481325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-47d05c50-b1ce-4865-b008-6a475ab1cf35 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 14 19:29:24.481325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:24.481325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:24.481325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:24.481325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:24.481325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:24.481325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:24.481325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:24.481325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:24.481325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:24.481325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:24.481325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:24.481325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:24.481325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:24.481325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:24.481325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:24.482221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:24.482221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:24.482221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:24.482221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:24.482221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:24.482221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:24.482221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:24.482221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:24.482221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:24.482221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:24.482221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:24.482221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:24.482221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:24.482221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:24.482221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:24.482221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:24.482221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:24.482221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:24.483129 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:24.483129 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:24.483129 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:24.483129 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:24.483129 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:24.483129 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:24.483129 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:24.483129 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:24.483129 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 14 19:29:24.483129 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:24.483837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85621393-b7fa-4b7d-95e1-69002690568b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:24.487400 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 318/640] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:29:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:24.488013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d05c50-b1ce-4865-b008-6a475ab1cf35 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:24.497821 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 323/641] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:24.499917 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff378d-8ce8-4862-92f6-268978a2bd53 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:24.500438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff378d-8ce8-4862-92f6-268978a2bd53 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:24.501204 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff378d-8ce8-4862-92f6-268978a2bd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:24.520632 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-faff378d-8ce8-4862-92f6-268978a2bd53 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:24.521875 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-faff378d-8ce8-4862-92f6-268978a2bd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:24.586640 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:24.602807 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 324/642] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:24.602807 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff378d-8ce8-4862-92f6-268978a2bd53 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:24.616960 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d05c50-b1ce-4865-b008-6a475ab1cf35 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:24.659872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9950c45-0b34-4b3c-a818-9a23da2aede8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:24.660786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9950c45-0b34-4b3c-a818-9a23da2aede8 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:24.661073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9950c45-0b34-4b3c-a818-9a23da2aede8 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:24.661347 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9950c45-0b34-4b3c-a818-9a23da2aede8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:24.674599 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9950c45-0b34-4b3c-a818-9a23da2aede8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:24.682601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-c9950c45-0b34-4b3c-a818-9a23da2aede8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:24.682601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:24.682601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:24.682601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:24.682601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:24.682601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:24.682601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:24.682601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:24.682601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:24.682601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:24.682601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:24.682601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:24.682601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:24.682601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:24.682601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:24.682601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:24.683637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:24.683637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:24.683637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:24.683637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:24.683637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:24.683637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:24.683637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:24.683637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:24.683637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:24.683637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:24.683637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:24.683637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:24.683637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:24.683637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:24.683637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:24.683637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:24.684469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:24.684469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:24.684469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:24.684469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:24.684469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:24.684469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:24.684469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:24.684469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:24.684469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:24.684469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:24.684469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:24.684469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:24.684469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 319/643] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:29:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:24.685214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9950c45-0b34-4b3c-a818-9a23da2aede8 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:24.724463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff378d-8ce8-4862-92f6-268978a2bd53 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:24.748808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:24.772939 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d4d44-2142-4968-8e7e-5239524f9f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:24.773719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d4d44-2142-4968-8e7e-5239524f9f83 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:24.774037 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d4d44-2142-4968-8e7e-5239524f9f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:24.774320 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d4d44-2142-4968-8e7e-5239524f9f83 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:24.775167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d4d44-2142-4968-8e7e-5239524f9f83 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:24.775479 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d4d44-2142-4968-8e7e-5239524f9f83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:24.777058 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d4d44-2142-4968-8e7e-5239524f9f83 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:24.798809 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 325/644] 10.222.0.44 () {56 vars in 1137 bytes} [Tue Jun 14 19:29:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:24.800188 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d4d44-2142-4968-8e7e-5239524f9f83 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:24.813825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9950c45-0b34-4b3c-a818-9a23da2aede8 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:24.858509 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce029650-d8a5-4e3b-b1a7-aa4d12070bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:24.859482 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce029650-d8a5-4e3b-b1a7-aa4d12070bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:24.859768 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce029650-d8a5-4e3b-b1a7-aa4d12070bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:24.860045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce029650-d8a5-4e3b-b1a7-aa4d12070bc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:24.867798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce029650-d8a5-4e3b-b1a7-aa4d12070bc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:24.869245 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce029650-d8a5-4e3b-b1a7-aa4d12070bc2 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:24.884543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-ce029650-d8a5-4e3b-b1a7-aa4d12070bc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:24.884543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:24.884543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:24.884543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:24.884543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:24.884543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:24.884543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:24.884543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:24.884543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:24.884543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:24.884543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:24.884543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:24.884543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:24.884543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:24.884543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:24.885473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:24.885473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:24.885473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:24.885473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:24.885473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:24.885473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:24.885473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:24.885473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:24.885473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:24.885473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:24.885473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:24.885473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:24.885473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:24.885473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:24.885473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:24.885473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:24.885473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:24.886511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:24.886511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:24.886511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:24.886511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:24.886511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:24.886511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:24.886511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:24.886511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:24.886511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 320/645] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:24.886980 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce029650-d8a5-4e3b-b1a7-aa4d12070bc2 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:24.897568 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:24.912484 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d4d44-2142-4968-8e7e-5239524f9f83 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:24.948881 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d906532-2c88-4ee7-a269-b2a2dd0812bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:24.949871 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d906532-2c88-4ee7-a269-b2a2dd0812bd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:24.950254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d906532-2c88-4ee7-a269-b2a2dd0812bd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:24.950604 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d906532-2c88-4ee7-a269-b2a2dd0812bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:24.961834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d906532-2c88-4ee7-a269-b2a2dd0812bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:24.969724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-5d906532-2c88-4ee7-a269-b2a2dd0812bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:24.969724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:24.969724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:24.969724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:24.969724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:24.969724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:24.969724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:24.969724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:24.969724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:24.969724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:24.969724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:24.969724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:24.969724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:24.969724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:24.969724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:24.969724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:24.970916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:24.970916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:24.970916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:24.970916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:24.970916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:24.970916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:24.970916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:24.970916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:24.970916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:24.970916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:24.970916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:24.970916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:24.970916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:24.970916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:24.970916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:24.970916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:24.972009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:24.972009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:24.972009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:24.972009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:24.972009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:24.972009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:24.972009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:24.972009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:24.972009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:24.972009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:24.972009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:24.972009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:24.977689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 326/646] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:29:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:24.977689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d906532-2c88-4ee7-a269-b2a2dd0812bd None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:25.002766 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce029650-d8a5-4e3b-b1a7-aa4d12070bc2 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:25.019806 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:25.041775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638d64c-5709-4ccd-9213-9106dbf219fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:25.042907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638d64c-5709-4ccd-9213-9106dbf219fc None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:25.043191 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638d64c-5709-4ccd-9213-9106dbf219fc None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:25.043471 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638d64c-5709-4ccd-9213-9106dbf219fc None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:25.044221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638d64c-5709-4ccd-9213-9106dbf219fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:25.044526 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638d64c-5709-4ccd-9213-9106dbf219fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:25.045963 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638d64c-5709-4ccd-9213-9106dbf219fc None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:25.055628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 321/647] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jun 14 19:29:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:25.056895 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638d64c-5709-4ccd-9213-9106dbf219fc None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:25.098277 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d906532-2c88-4ee7-a269-b2a2dd0812bd None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:25.128925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:25.134901 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d6eb0-a2e0-4ba2-b808-1ff5d5e5195b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:25.135611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d6eb0-a2e0-4ba2-b808-1ff5d5e5195b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:25.135894 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d6eb0-a2e0-4ba2-b808-1ff5d5e5195b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:25.136173 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d6eb0-a2e0-4ba2-b808-1ff5d5e5195b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:25.172542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638d64c-5709-4ccd-9213-9106dbf219fc None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:25.212513 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d6eb0-a2e0-4ba2-b808-1ff5d5e5195b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:25.214016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d6eb0-a2e0-4ba2-b808-1ff5d5e5195b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:25.214492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af8e9b-b2c2-4298-bc9b-4eb1e3fb5ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:25.215156 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af8e9b-b2c2-4298-bc9b-4eb1e3fb5ccb None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:25.215440 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af8e9b-b2c2-4298-bc9b-4eb1e3fb5ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:25.215886 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af8e9b-b2c2-4298-bc9b-4eb1e3fb5ccb None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:25.217463 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af8e9b-b2c2-4298-bc9b-4eb1e3fb5ccb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:25.217779 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af8e9b-b2c2-4298-bc9b-4eb1e3fb5ccb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:25.219202 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af8e9b-b2c2-4298-bc9b-4eb1e3fb5ccb None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:25.236600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 322/648] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:25.238123 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af8e9b-b2c2-4298-bc9b-4eb1e3fb5ccb None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:25.256655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:25.345454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 327/649] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:29:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:29:25.347391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d6eb0-a2e0-4ba2-b808-1ff5d5e5195b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:25.348155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af8e9b-b2c2-4298-bc9b-4eb1e3fb5ccb None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:25.378349 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:25.387696 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086b5ca-5a0d-4e07-abad-99b8b7a9ce2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:25.388305 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086b5ca-5a0d-4e07-abad-99b8b7a9ce2e None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:25.388593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086b5ca-5a0d-4e07-abad-99b8b7a9ce2e None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:25.388871 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1086b5ca-5a0d-4e07-abad-99b8b7a9ce2e None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:25.389642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086b5ca-5a0d-4e07-abad-99b8b7a9ce2e None admin] RBAC: Adding query filter params (name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:25.389951 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086b5ca-5a0d-4e07-abad-99b8b7a9ce2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:25.391348 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1086b5ca-5a0d-4e07-abad-99b8b7a9ce2e None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:25.399714 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 323/650] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jun 14 19:29:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:25.404849 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086b5ca-5a0d-4e07-abad-99b8b7a9ce2e None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:25.462286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d6eb0-a2e0-4ba2-b808-1ff5d5e5195b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:25.498485 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53a55f-1dc4-4bc3-a81b-bdfa982aa808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:25.499309 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53a55f-1dc4-4bc3-a81b-bdfa982aa808 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:25.499597 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53a55f-1dc4-4bc3-a81b-bdfa982aa808 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:25.499879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53a55f-1dc4-4bc3-a81b-bdfa982aa808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:25.502829 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:25.512214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53a55f-1dc4-4bc3-a81b-bdfa982aa808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:25.513719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53a55f-1dc4-4bc3-a81b-bdfa982aa808 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:25.516849 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1086b5ca-5a0d-4e07-abad-99b8b7a9ce2e None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:25.531391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-ac53a55f-1dc4-4bc3-a81b-bdfa982aa808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:25.531391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:25.531391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:25.531391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:25.531391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:25.531391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:25.531391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:25.531391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:25.531391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:25.531391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:25.531391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:25.531391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:25.531391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:25.531391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:25.531391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:25.532502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:25.532502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:25.532502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:25.532502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:25.532502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:25.532502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:25.532502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:25.532502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:25.532502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:25.532502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:25.532502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:25.532502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:25.532502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:25.532502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:25.532502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:25.532502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:25.532502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:25.533449 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:25.533449 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:25.533449 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:25.533449 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:25.533449 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 328/651] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:25.533449 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53a55f-1dc4-4bc3-a81b-bdfa982aa808 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:25.560034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d551e8-dcaa-4c5a-8e12-e2265210a5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:25.560689 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d551e8-dcaa-4c5a-8e12-e2265210a5bd None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:25.561005 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d551e8-dcaa-4c5a-8e12-e2265210a5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:25.561262 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d551e8-dcaa-4c5a-8e12-e2265210a5bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:25.562139 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d551e8-dcaa-4c5a-8e12-e2265210a5bd None admin] RBAC: Adding query filter params (role.id=539442ef092c4fcf9e1d0be045928c5a, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=37c521e20aea4cad9758568a4f082fbd) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:25.562450 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d551e8-dcaa-4c5a-8e12-e2265210a5bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:25.563880 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d551e8-dcaa-4c5a-8e12-e2265210a5bd None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:25.581508 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 324/652] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:29:25 2022] GET /identity/v3/role_assignments?user.id=37c521e20aea4cad9758568a4f082fbd&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=539442ef092c4fcf9e1d0be045928c5a => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:25.581508 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d551e8-dcaa-4c5a-8e12-e2265210a5bd None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:25.646145 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:25.654933 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53a55f-1dc4-4bc3-a81b-bdfa982aa808 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:25.695078 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4332c17-abb6-40f5-b80b-5d990417c05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:25.695975 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4332c17-abb6-40f5-b80b-5d990417c05e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:25.696339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4332c17-abb6-40f5-b80b-5d990417c05e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:25.696695 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4332c17-abb6-40f5-b80b-5d990417c05e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:25.706782 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d551e8-dcaa-4c5a-8e12-e2265210a5bd None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:25.709566 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4332c17-abb6-40f5-b80b-5d990417c05e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:25.711290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4332c17-abb6-40f5-b80b-5d990417c05e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:25.730594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-f4332c17-abb6-40f5-b80b-5d990417c05e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:25.730594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:25.730594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:25.730594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:25.730594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:25.730594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:25.730594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:25.730594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:25.730594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:25.730594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:25.730594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:25.730594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:25.730594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:25.730594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:25.730594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:25.731748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:25.731748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:25.731748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:25.731748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:25.731748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:25.731748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:25.731748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:25.731748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:25.731748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:25.731748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:25.731748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:25.731748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:25.731748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:25.731748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:25.731748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:25.731748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:25.731748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:25.732826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:25.732826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:25.732826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:25.732826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:25.738449 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 329/653] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:25.739386 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4332c17-abb6-40f5-b80b-5d990417c05e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:25.752231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23414a64-2252-4178-8c33-898abfba12c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:25.753778 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23414a64-2252-4178-8c33-898abfba12c2 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:25.754362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23414a64-2252-4178-8c33-898abfba12c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:25.754705 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23414a64-2252-4178-8c33-898abfba12c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:25.771907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23414a64-2252-4178-8c33-898abfba12c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:25.773970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23414a64-2252-4178-8c33-898abfba12c2 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:25.787061 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:25.800765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-23414a64-2252-4178-8c33-898abfba12c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:25.800765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:25.800765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:25.800765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:25.800765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:25.800765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:25.800765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:25.800765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:25.800765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:25.800765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:25.800765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:25.800765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:25.800765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:25.800765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:25.800765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:25.801913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:25.801913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:25.801913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:25.801913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:25.801913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:25.801913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:25.801913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:25.801913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:25.801913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:25.801913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:25.801913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:25.801913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:25.801913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:25.801913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:25.801913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:25.801913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:25.801913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:25.803045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:25.803045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:25.803045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:25.803045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:25.808109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 325/654] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:25.809078 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23414a64-2252-4178-8c33-898abfba12c2 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:25.858112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4332c17-abb6-40f5-b80b-5d990417c05e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:25.901218 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bea46-e57e-4934-baaa-72e14005e5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:25.901899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bea46-e57e-4934-baaa-72e14005e5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:25.902183 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bea46-e57e-4934-baaa-72e14005e5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:25.902516 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bea46-e57e-4934-baaa-72e14005e5c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:25.903199 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bea46-e57e-4934-baaa-72e14005e5c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:25.903508 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bea46-e57e-4934-baaa-72e14005e5c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:25.904924 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bea46-e57e-4934-baaa-72e14005e5c7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:25.921703 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 330/655] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:25.922470 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bea46-e57e-4934-baaa-72e14005e5c7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:25.943337 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23414a64-2252-4178-8c33-898abfba12c2 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:25.952768 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:25.998101 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380270e2-6981-494f-a349-5f6e87fff75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:25.999414 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380270e2-6981-494f-a349-5f6e87fff75c None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:26.000458 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380270e2-6981-494f-a349-5f6e87fff75c None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:26.000945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380270e2-6981-494f-a349-5f6e87fff75c None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:26.002781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380270e2-6981-494f-a349-5f6e87fff75c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:26.003627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380270e2-6981-494f-a349-5f6e87fff75c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:26.006147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380270e2-6981-494f-a349-5f6e87fff75c None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:26.020968 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 326/656] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:26.026478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380270e2-6981-494f-a349-5f6e87fff75c None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:26.048193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:26.054256 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bea46-e57e-4934-baaa-72e14005e5c7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:26.100790 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f261e-0efd-4907-bd1e-710526240d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:26.101480 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f261e-0efd-4907-bd1e-710526240d70 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:26.101766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f261e-0efd-4907-bd1e-710526240d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:26.102042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f261e-0efd-4907-bd1e-710526240d70 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:26.102763 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f261e-0efd-4907-bd1e-710526240d70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:26.103118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f261e-0efd-4907-bd1e-710526240d70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:26.104453 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f261e-0efd-4907-bd1e-710526240d70 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:26.120161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 331/657] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:26.120161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f261e-0efd-4907-bd1e-710526240d70 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:26.146665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380270e2-6981-494f-a349-5f6e87fff75c None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:26.184281 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a164320-bb78-40bc-be3f-cd4b9fd7fafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:26.185007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a164320-bb78-40bc-be3f-cd4b9fd7fafa None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:26.185290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a164320-bb78-40bc-be3f-cd4b9fd7fafa None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:26.185600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a164320-bb78-40bc-be3f-cd4b9fd7fafa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:26.192953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a164320-bb78-40bc-be3f-cd4b9fd7fafa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:26.194451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a164320-bb78-40bc-be3f-cd4b9fd7fafa None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:26.209171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-1a164320-bb78-40bc-be3f-cd4b9fd7fafa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 19:29:26.209171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:26.209171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:26.209171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:26.209171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:26.209171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:26.209171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:26.209171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:26.209171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:26.209171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:26.209171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:26.209171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:26.209171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:26.209171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:26.209171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:26.209171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:26.210182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:26.210182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:26.210182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:26.210182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:26.210182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:26.210182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:26.210182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:26.210182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:26.210182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:26.210182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:26.210182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:26.210182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:26.210182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:26.210182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:26.210182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:26.210182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:26.210182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:26.210182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:26.211088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:26.211088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:26.211088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:26.211088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:26.211088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:26.211088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:26.211088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:26.211088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:26.211088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 19:29:26.211088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:26.211088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 327/658] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:29:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:26.212325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fad308-e5af-4447-8b45-3740db87013e None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:26.212325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fad308-e5af-4447-8b45-3740db87013e None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:26.212520 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fad308-e5af-4447-8b45-3740db87013e None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:26.213948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 328/659] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:26.218193 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fad308-e5af-4447-8b45-3740db87013e None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:26.236087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f261e-0efd-4907-bd1e-710526240d70 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:26.251897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:26.276240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d910472-ed57-4a1b-81a8-182636b718d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:26.277034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d910472-ed57-4a1b-81a8-182636b718d9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:26.277511 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d910472-ed57-4a1b-81a8-182636b718d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:26.277792 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d910472-ed57-4a1b-81a8-182636b718d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:26.285783 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d910472-ed57-4a1b-81a8-182636b718d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:26.287235 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d910472-ed57-4a1b-81a8-182636b718d9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:26.302759 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-6d910472-ed57-4a1b-81a8-182636b718d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:26.302759 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:26.302759 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:26.302759 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:26.302759 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:26.302759 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:26.302759 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:26.302759 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:26.302759 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:26.302759 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:26.302759 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:26.302759 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:26.302759 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:26.302759 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:26.302759 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:26.303661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:26.303661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:26.303661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:26.303661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:26.303661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:26.303661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:26.303661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:26.303661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:26.303661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:26.303661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:26.303661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:26.303661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:26.303661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:26.303661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:26.303661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:26.303661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:26.303661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:26.304526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:26.304526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:26.304526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:26.304526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:26.304526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:26.304526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:26.304526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:26.304526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:26.304526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 332/660] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:26.305710 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d910472-ed57-4a1b-81a8-182636b718d9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:26.327498 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:26.335662 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fad308-e5af-4447-8b45-3740db87013e None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:26.370437 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d177e9-0a9f-4b9a-9dff-a5f3822f21a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:26.371237 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d177e9-0a9f-4b9a-9dff-a5f3822f21a2 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:26.371522 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d177e9-0a9f-4b9a-9dff-a5f3822f21a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:26.371804 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d177e9-0a9f-4b9a-9dff-a5f3822f21a2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:26.379021 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d177e9-0a9f-4b9a-9dff-a5f3822f21a2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:26.380474 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d177e9-0a9f-4b9a-9dff-a5f3822f21a2 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:26.395435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-65d177e9-0a9f-4b9a-9dff-a5f3822f21a2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 14 19:29:26.395435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:26.395435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:26.395435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:26.395435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:26.395435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:26.395435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:26.395435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:26.395435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:26.395435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:26.395435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:26.395435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:26.395435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:26.395435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:26.395435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:26.395435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:26.396553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:26.396553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:26.396553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:26.396553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:26.396553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:26.396553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:26.396553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:26.396553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:26.396553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:26.396553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:26.396553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:26.396553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:26.396553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:26.396553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:26.396553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:26.396553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:26.396553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:26.396553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:26.397722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:26.397722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:26.397722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:26.397722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:26.397722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:26.397722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:26.397722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:26.397722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:26.397722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 14 19:29:26.397722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:26.401513 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 329/661] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:29:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:26.402747 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232647b-6d37-4fb5-a53c-a21a12fec85c None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:26.403043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232647b-6d37-4fb5-a53c-a21a12fec85c None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:26.403328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232647b-6d37-4fb5-a53c-a21a12fec85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:26.416648 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d910472-ed57-4a1b-81a8-182636b718d9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:26.421049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-4232647b-6d37-4fb5-a53c-a21a12fec85c None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:26.422247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-4232647b-6d37-4fb5-a53c-a21a12fec85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:26.460441 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f3122-be93-4058-9073-aaee86e558a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:26.461450 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f3122-be93-4058-9073-aaee86e558a0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:26.461914 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f3122-be93-4058-9073-aaee86e558a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:26.462464 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f3122-be93-4058-9073-aaee86e558a0 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:26.463478 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f3122-be93-4058-9073-aaee86e558a0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:26.464471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f3122-be93-4058-9073-aaee86e558a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:26.466103 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f3122-be93-4058-9073-aaee86e558a0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:26.489348 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 333/662] 10.222.0.44 () {56 vars in 1137 bytes} [Tue Jun 14 19:29:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:26.490554 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f3122-be93-4058-9073-aaee86e558a0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:26.496035 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 330/663] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:26.497141 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232647b-6d37-4fb5-a53c-a21a12fec85c None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:26.522360 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:26.578466 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:26.605348 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f3122-be93-4058-9073-aaee86e558a0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:26.613238 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232647b-6d37-4fb5-a53c-a21a12fec85c None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:26.641654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9756b9-ab3f-4d15-b1e7-bb981c82d14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:26.642552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9756b9-ab3f-4d15-b1e7-bb981c82d14b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:26.643409 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9756b9-ab3f-4d15-b1e7-bb981c82d14b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:26.643786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9756b9-ab3f-4d15-b1e7-bb981c82d14b None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:26.644572 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9756b9-ab3f-4d15-b1e7-bb981c82d14b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:26.644885 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9756b9-ab3f-4d15-b1e7-bb981c82d14b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:26.646366 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9756b9-ab3f-4d15-b1e7-bb981c82d14b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:26.651308 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85a43a-2f3f-4bd7-9c4b-c3b5dcd7da14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:26.651968 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85a43a-2f3f-4bd7-9c4b-c3b5dcd7da14 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:26.652251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85a43a-2f3f-4bd7-9c4b-c3b5dcd7da14 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:26.652528 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c85a43a-2f3f-4bd7-9c4b-c3b5dcd7da14 None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:26.653847 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85a43a-2f3f-4bd7-9c4b-c3b5dcd7da14 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:26.654152 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85a43a-2f3f-4bd7-9c4b-c3b5dcd7da14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:26.656092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c85a43a-2f3f-4bd7-9c4b-c3b5dcd7da14 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:26.657750 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 334/664] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:26.663863 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9756b9-ab3f-4d15-b1e7-bb981c82d14b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:26.675896 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 331/665] 10.222.0.44 () {56 vars in 1139 bytes} [Tue Jun 14 19:29:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:26.676709 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85a43a-2f3f-4bd7-9c4b-c3b5dcd7da14 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:26.759032 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:26.774724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9756b9-ab3f-4d15-b1e7-bb981c82d14b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:26.785385 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c85a43a-2f3f-4bd7-9c4b-c3b5dcd7da14 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:26.812618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d6ae7-4519-4b56-92cb-46201205d13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:26.812618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d6ae7-4519-4b56-92cb-46201205d13f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:26.812618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d6ae7-4519-4b56-92cb-46201205d13f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:26.812618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d6ae7-4519-4b56-92cb-46201205d13f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:26.824950 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53d2c6-53f0-4208-b9df-f50226c5cad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:26.825313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:26.825925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53d2c6-53f0-4208-b9df-f50226c5cad4 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:26.826283 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53d2c6-53f0-4208-b9df-f50226c5cad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:26.826631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a53d2c6-53f0-4208-b9df-f50226c5cad4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:26.839465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a53d2c6-53f0-4208-b9df-f50226c5cad4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:26.847470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-9a53d2c6-53f0-4208-b9df-f50226c5cad4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:26.847470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:26.847470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:26.847470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:26.847470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:26.847470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:26.847470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:26.847470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:26.847470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:26.847470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:26.847470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:26.847470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:26.847470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:26.847470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:26.847470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:26.847470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:26.848384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:26.848384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:26.848384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:26.848384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:26.848384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:26.848384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:26.848384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:26.848384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:26.848384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:26.848384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:26.848384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:26.848384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:26.848384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:26.848384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:26.848384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:26.848384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:26.849251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:26.849251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:26.849251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:26.849251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:26.849251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:26.849251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:26.849251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:26.849251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:26.849251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:26.849251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:26.849251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:26.849251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:26.853565 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 332/666] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:29:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:26.854278 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53d2c6-53f0-4208-b9df-f50226c5cad4 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:26.895009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d6ae7-4519-4b56-92cb-46201205d13f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:26.896794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d6ae7-4519-4b56-92cb-46201205d13f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:26.966615 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a53d2c6-53f0-4208-b9df-f50226c5cad4 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:27.000490 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 335/667] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:29:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:29:27.001518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d6ae7-4519-4b56-92cb-46201205d13f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:27.009479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7141606-dc2a-4841-a59e-251c27c25cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:27.010079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7141606-dc2a-4841-a59e-251c27c25cf7 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:27.010597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7141606-dc2a-4841-a59e-251c27c25cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:27.010706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7141606-dc2a-4841-a59e-251c27c25cf7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:27.011516 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7141606-dc2a-4841-a59e-251c27c25cf7 None admin] RBAC: Adding query filter params (role.id=539442ef092c4fcf9e1d0be045928c5a, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=caa134b748854fb3b4de54b04390eec9) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:27.011831 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7141606-dc2a-4841-a59e-251c27c25cf7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:27.013258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7141606-dc2a-4841-a59e-251c27c25cf7 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:27.015266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:27.021290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 333/668] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:29:26 2022] GET /identity/v3/role_assignments?user.id=caa134b748854fb3b4de54b04390eec9&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=539442ef092c4fcf9e1d0be045928c5a => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:27.022329 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7141606-dc2a-4841-a59e-251c27c25cf7 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:27.059826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:27.147098 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7141606-dc2a-4841-a59e-251c27c25cf7 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:27.156592 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d6ae7-4519-4b56-92cb-46201205d13f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:27.191512 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c6e6d-8c71-4b25-83d5-3a2c611c58ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:27.192335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c6e6d-8c71-4b25-83d5-3a2c611c58ad None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:27.192624 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c6e6d-8c71-4b25-83d5-3a2c611c58ad None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:27.192902 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c6e6d-8c71-4b25-83d5-3a2c611c58ad None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:27.193683 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c6e6d-8c71-4b25-83d5-3a2c611c58ad None admin] RBAC: Adding query filter params (name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:27.193990 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c6e6d-8c71-4b25-83d5-3a2c611c58ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:27.195440 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9c6e6d-8c71-4b25-83d5-3a2c611c58ad None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:27.203855 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82095dea-c7a0-4a43-91f4-d44e2f586273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:27.204237 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 334/669] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jun 14 19:29:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:27.204947 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82095dea-c7a0-4a43-91f4-d44e2f586273 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:27.205691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c6e6d-8c71-4b25-83d5-3a2c611c58ad None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:27.206355 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82095dea-c7a0-4a43-91f4-d44e2f586273 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:27.206905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82095dea-c7a0-4a43-91f4-d44e2f586273 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:27.284174 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:27.293531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82095dea-c7a0-4a43-91f4-d44e2f586273 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:27.295195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82095dea-c7a0-4a43-91f4-d44e2f586273 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:27.337190 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c6e6d-8c71-4b25-83d5-3a2c611c58ad None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:27.348889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:27.422056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 336/670] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:29:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:29:27.423012 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82095dea-c7a0-4a43-91f4-d44e2f586273 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:27.432732 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b1074-8e81-4f1a-888e-0769b53ba649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:27.433814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b1074-8e81-4f1a-888e-0769b53ba649 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:27.433814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b1074-8e81-4f1a-888e-0769b53ba649 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:27.434112 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b1074-8e81-4f1a-888e-0769b53ba649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:27.461407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b1074-8e81-4f1a-888e-0769b53ba649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:27.461407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b1074-8e81-4f1a-888e-0769b53ba649 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:27.492678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-973b1074-8e81-4f1a-888e-0769b53ba649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:27.492678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:27.492678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:27.492678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:27.492678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:27.492678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:27.492678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:27.492678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:27.492678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:27.492678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:27.492678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:27.492678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:27.492678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:27.492678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:27.492678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:27.493898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:27.493898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:27.493898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:27.493898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:27.493898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:27.493898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:27.493898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:27.493898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:27.493898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:27.493898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:27.493898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:27.493898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:27.493898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:27.493898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:27.493898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:27.493898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:27.493898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:27.494746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:27.494746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:27.494746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:27.494746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:27.494746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 335/671] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:27.494746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b1074-8e81-4f1a-888e-0769b53ba649 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:27.537575 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82095dea-c7a0-4a43-91f4-d44e2f586273 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:27.593415 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edffdd-6985-4227-a630-5fe93314b972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:27.593415 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edffdd-6985-4227-a630-5fe93314b972 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:27.593415 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edffdd-6985-4227-a630-5fe93314b972 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:27.593415 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edffdd-6985-4227-a630-5fe93314b972 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:27.599748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:27.606395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edffdd-6985-4227-a630-5fe93314b972 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:27.608165 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edffdd-6985-4227-a630-5fe93314b972 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:27.627774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-18edffdd-6985-4227-a630-5fe93314b972 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:27.627774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:27.627774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:27.627774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:27.627774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:27.627774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:27.627774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:27.627774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:27.627774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:27.627774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:27.627774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:27.627774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:27.627774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:27.627774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:27.627774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:27.628687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:27.628687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:27.628687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:27.628687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:27.628687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:27.628687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:27.628687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:27.628687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:27.628687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:27.628687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:27.628687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:27.628687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:27.628687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:27.628687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:27.628687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:27.628687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:27.628687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:27.630109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:27.630109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:27.630109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:27.630109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:27.636725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 337/672] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:27.637865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edffdd-6985-4227-a630-5fe93314b972 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:27.719131 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b1074-8e81-4f1a-888e-0769b53ba649 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:27.743930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:27.775276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edffdd-6985-4227-a630-5fe93314b972 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:27.790007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba5661-7917-4ca6-8dff-d5d76cdf91d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:27.791429 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba5661-7917-4ca6-8dff-d5d76cdf91d0 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:27.791896 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba5661-7917-4ca6-8dff-d5d76cdf91d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:27.792354 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba5661-7917-4ca6-8dff-d5d76cdf91d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:27.804746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba5661-7917-4ca6-8dff-d5d76cdf91d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:27.806499 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba5661-7917-4ca6-8dff-d5d76cdf91d0 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:27.818778 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0921612-b488-4290-93ed-767b292fdb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:27.819321 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0921612-b488-4290-93ed-767b292fdb5e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:27.819685 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0921612-b488-4290-93ed-767b292fdb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:27.820013 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0921612-b488-4290-93ed-767b292fdb5e None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:27.820828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0921612-b488-4290-93ed-767b292fdb5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:27.821180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0921612-b488-4290-93ed-767b292fdb5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:27.822656 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0921612-b488-4290-93ed-767b292fdb5e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:27.840754 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 338/673] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:27.841768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0921612-b488-4290-93ed-767b292fdb5e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:27.844178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-58ba5661-7917-4ca6-8dff-d5d76cdf91d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:27.844178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:27.844178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:27.844178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:27.844178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:27.844178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:27.844178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:27.844178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:27.844178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:27.844178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:27.844178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:27.844178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:27.844178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:27.844178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:27.844178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:27.845039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:27.845039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:27.845039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:27.845039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:27.845039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:27.845039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:27.845039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:27.845039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:27.845039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:27.845039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:27.845039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:27.845039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:27.845039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:27.845039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:27.845039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:27.845039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:27.845039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:27.846201 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:27.846201 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:27.846201 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:27.846201 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:27.853405 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 336/674] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:27.853405 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba5661-7917-4ca6-8dff-d5d76cdf91d0 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:27.953777 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:28.020236 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0921612-b488-4290-93ed-767b292fdb5e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:28.024220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba5661-7917-4ca6-8dff-d5d76cdf91d0 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:28.058772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4f093-2c76-4f0e-ba4d-f9015c4220b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:28.059694 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4f093-2c76-4f0e-ba4d-f9015c4220b8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:28.060163 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4f093-2c76-4f0e-ba4d-f9015c4220b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:28.060638 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4f093-2c76-4f0e-ba4d-f9015c4220b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:28.061041 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe35151-368b-4ce2-925f-75f4d46316ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:28.061796 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4f093-2c76-4f0e-ba4d-f9015c4220b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:28.061904 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe35151-368b-4ce2-925f-75f4d46316ff None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:28.062127 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe35151-368b-4ce2-925f-75f4d46316ff None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:28.062405 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe35151-368b-4ce2-925f-75f4d46316ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:28.062766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4f093-2c76-4f0e-ba4d-f9015c4220b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:28.065173 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4f093-2c76-4f0e-ba4d-f9015c4220b8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:28.069675 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe35151-368b-4ce2-925f-75f4d46316ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:28.071088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe35151-368b-4ce2-925f-75f4d46316ff None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:28.082308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 339/675] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:28.082308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4f093-2c76-4f0e-ba4d-f9015c4220b8 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:28.085840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-dfe35151-368b-4ce2-925f-75f4d46316ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:28.085840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:28.085840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:28.085840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:28.085840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:28.085840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:28.085840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:28.085840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:28.085840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:28.085840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:28.085840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:28.085840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:28.085840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:28.085840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:28.085840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:28.086729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:28.086729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:28.086729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:28.086729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:28.086729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:28.086729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:28.086729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:28.086729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:28.086729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:28.086729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:28.086729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:28.086729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:28.086729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:28.086729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:28.086729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:28.086729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:28.086729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:28.087597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:28.087597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:28.087597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:28.087597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:28.087597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:28.087597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:28.087597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:28.087597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:28.087597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 337/676] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:28.088495 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2286e8-9ff8-4950-96f7-41fdbb975e3e None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:28.088743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2286e8-9ff8-4950-96f7-41fdbb975e3e None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:28.089016 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2286e8-9ff8-4950-96f7-41fdbb975e3e None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:28.094783 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 338/677] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:28.094783 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2286e8-9ff8-4950-96f7-41fdbb975e3e None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:28.117135 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:28.195587 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4f093-2c76-4f0e-ba4d-f9015c4220b8 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:28.197553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2286e8-9ff8-4950-96f7-41fdbb975e3e None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:28.206143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:28.232051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc4847-a88a-4f08-8442-e8bced6dd020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:28.232710 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc4847-a88a-4f08-8442-e8bced6dd020 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:28.232995 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc4847-a88a-4f08-8442-e8bced6dd020 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:28.233272 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc4847-a88a-4f08-8442-e8bced6dd020 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:28.233637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41c042-9bb9-426d-8ca9-88be50cc4bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:28.234031 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc4847-a88a-4f08-8442-e8bced6dd020 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:28.234341 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc4847-a88a-4f08-8442-e8bced6dd020 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:28.234435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41c042-9bb9-426d-8ca9-88be50cc4bde None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:28.234686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41c042-9bb9-426d-8ca9-88be50cc4bde None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:28.234960 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41c042-9bb9-426d-8ca9-88be50cc4bde None admin] PATH_INFO: `/v3/users/swift` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:28.235709 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febc4847-a88a-4f08-8442-e8bced6dd020 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:28.245693 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41c042-9bb9-426d-8ca9-88be50cc4bde None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:28.247177 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41c042-9bb9-426d-8ca9-88be50cc4bde None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:28.254071 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 340/678] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:28.254071 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc4847-a88a-4f08-8442-e8bced6dd020 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:28.268122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-1f41c042-9bb9-426d-8ca9-88be50cc4bde None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 14 19:29:28.268122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:28.268122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:28.268122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:28.268122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:28.268122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:28.268122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:28.268122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:28.268122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:28.268122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:28.268122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:28.268122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:28.268122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:28.268122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:28.268122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:28.268122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:28.269136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:28.269136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:28.269136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:28.269136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:28.269136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:28.269136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:28.269136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:28.269136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:28.269136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:28.269136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:28.269136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:28.269136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:28.269136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:28.269136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:28.269136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:28.269136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:28.269136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:28.269136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:28.270114 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:28.270114 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:28.270114 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:28.270114 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:28.270114 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:28.270114 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:28.270114 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:28.270114 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:28.270114 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 14 19:29:28.270114 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:28.270114 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 339/679] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:29:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:28.270691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0744d8c-e111-44f2-8d0f-40c128837e4d None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:28.271425 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0744d8c-e111-44f2-8d0f-40c128837e4d None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:28.271425 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0744d8c-e111-44f2-8d0f-40c128837e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:28.288970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-e0744d8c-e111-44f2-8d0f-40c128837e4d None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:28.290416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e0744d8c-e111-44f2-8d0f-40c128837e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:28.362128 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 340/680] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:28.363365 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0744d8c-e111-44f2-8d0f-40c128837e4d None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:28.373518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febc4847-a88a-4f08-8442-e8bced6dd020 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:28.383373 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:28.412041 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d041f11-8682-4911-a2db-0ee8290d7b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:28.412701 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d041f11-8682-4911-a2db-0ee8290d7b4f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:28.412982 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d041f11-8682-4911-a2db-0ee8290d7b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:28.413258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d041f11-8682-4911-a2db-0ee8290d7b4f None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:28.414082 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d041f11-8682-4911-a2db-0ee8290d7b4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:28.414393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d041f11-8682-4911-a2db-0ee8290d7b4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:28.416061 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d041f11-8682-4911-a2db-0ee8290d7b4f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:28.429659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 341/681] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:28.430457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d041f11-8682-4911-a2db-0ee8290d7b4f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:28.465975 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:28.484495 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0744d8c-e111-44f2-8d0f-40c128837e4d None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:28.522940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0aaf5-c6a6-4705-a5e7-ca618f81a469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:28.523749 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0aaf5-c6a6-4705-a5e7-ca618f81a469 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:28.524019 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0aaf5-c6a6-4705-a5e7-ca618f81a469 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:28.524296 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c0aaf5-c6a6-4705-a5e7-ca618f81a469 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:28.531290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0aaf5-c6a6-4705-a5e7-ca618f81a469 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:28.532716 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c0aaf5-c6a6-4705-a5e7-ca618f81a469 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:28.540046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d041f11-8682-4911-a2db-0ee8290d7b4f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:28.548309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-e2c0aaf5-c6a6-4705-a5e7-ca618f81a469 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:28.548309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:28.548309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:28.548309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:28.548309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:28.548309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:28.548309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:28.548309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:28.548309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:28.548309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:28.548309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:28.548309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:28.548309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:28.548309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:28.548309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:28.550013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:28.550013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:28.550013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:28.550013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:28.550013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:28.550013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:28.550013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:28.550013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:28.550013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:28.550013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:28.550013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:28.550013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:28.550013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:28.550013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:28.550013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:28.550013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:28.550013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:28.550981 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:28.550981 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:28.550981 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:28.550981 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:28.550981 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:28.550981 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:28.550981 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:28.550981 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:28.554625 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 341/682] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:28.555381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0aaf5-c6a6-4705-a5e7-ca618f81a469 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:28.579936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003ca5a-453d-4861-b5fe-d4edd40512df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:28.580608 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003ca5a-453d-4861-b5fe-d4edd40512df None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:28.580898 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003ca5a-453d-4861-b5fe-d4edd40512df None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:28.581194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003ca5a-453d-4861-b5fe-d4edd40512df None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:28.582070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003ca5a-453d-4861-b5fe-d4edd40512df None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:28.582384 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003ca5a-453d-4861-b5fe-d4edd40512df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:28.583820 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003ca5a-453d-4861-b5fe-d4edd40512df None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:28.605582 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 342/683] 10.222.0.44 () {56 vars in 1135 bytes} [Tue Jun 14 19:29:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:28.605582 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003ca5a-453d-4861-b5fe-d4edd40512df None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:28.641366 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:28.669887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c0aaf5-c6a6-4705-a5e7-ca618f81a469 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:28.695559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:28.709200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003ca5a-453d-4861-b5fe-d4edd40512df None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:28.710334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276eba6-b914-4375-a1bc-b3d32bf9405f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:28.711264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276eba6-b914-4375-a1bc-b3d32bf9405f None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:28.711632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276eba6-b914-4375-a1bc-b3d32bf9405f None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:28.711905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276eba6-b914-4375-a1bc-b3d32bf9405f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:28.723125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276eba6-b914-4375-a1bc-b3d32bf9405f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:28.731168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-0276eba6-b914-4375-a1bc-b3d32bf9405f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:29:28.731168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:28.731168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:28.731168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:28.731168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:28.731168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:28.731168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:28.731168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:28.731168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:28.731168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:28.731168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:28.731168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:28.731168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:28.731168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:28.731168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:28.731168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:28.732132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:28.732132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:28.732132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:28.732132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:28.732132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:28.732132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:28.732132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:28.732132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:28.732132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:28.732132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:28.732132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:28.732132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:28.732132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:28.732132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:28.732132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:28.732132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:28.732951 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:28.732951 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:28.732951 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:28.732951 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:28.732951 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:28.732951 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:28.732951 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:28.732951 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:28.732951 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:28.732951 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:28.732951 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:29:28.732951 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:28.732951 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 342/684] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:29:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:28.733700 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276eba6-b914-4375-a1bc-b3d32bf9405f None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:28.749128 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967b1c8-9cb4-4147-a433-e0cc236c7daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:28.749848 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967b1c8-9cb4-4147-a433-e0cc236c7daa None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:28.750109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967b1c8-9cb4-4147-a433-e0cc236c7daa None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:28.750386 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967b1c8-9cb4-4147-a433-e0cc236c7daa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:28.751214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967b1c8-9cb4-4147-a433-e0cc236c7daa None admin] RBAC: Adding query filter params (role.id=539442ef092c4fcf9e1d0be045928c5a, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=e5c2502cf1a14203bec13879a47f47ee) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:28.751527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967b1c8-9cb4-4147-a433-e0cc236c7daa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:28.753695 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967b1c8-9cb4-4147-a433-e0cc236c7daa None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:28.769583 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 343/685] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:29:28 2022] GET /identity/v3/role_assignments?user.id=e5c2502cf1a14203bec13879a47f47ee&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=539442ef092c4fcf9e1d0be045928c5a => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:28.770705 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967b1c8-9cb4-4147-a433-e0cc236c7daa None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:28.873719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276eba6-b914-4375-a1bc-b3d32bf9405f None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:28.921917 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc63a00-c18d-4c53-8ede-25c8b5277bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:28.923687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc63a00-c18d-4c53-8ede-25c8b5277bfe None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:28.924109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc63a00-c18d-4c53-8ede-25c8b5277bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:28.924664 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc63a00-c18d-4c53-8ede-25c8b5277bfe None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:28.925682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc63a00-c18d-4c53-8ede-25c8b5277bfe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:28.925998 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc63a00-c18d-4c53-8ede-25c8b5277bfe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:28.927001 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967b1c8-9cb4-4147-a433-e0cc236c7daa None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:28.927465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc63a00-c18d-4c53-8ede-25c8b5277bfe None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:28.931299 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:28.945212 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 343/686] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:28.946134 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc63a00-c18d-4c53-8ede-25c8b5277bfe None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:28.973419 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322f335-88c1-4f72-80c1-82834a62c5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:28.974082 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322f335-88c1-4f72-80c1-82834a62c5c8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:28.974370 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322f335-88c1-4f72-80c1-82834a62c5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:28.974644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322f335-88c1-4f72-80c1-82834a62c5c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:28.999855 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:29.062745 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322f335-88c1-4f72-80c1-82834a62c5c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:29.066076 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322f335-88c1-4f72-80c1-82834a62c5c8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:29.070398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc63a00-c18d-4c53-8ede-25c8b5277bfe None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:29.105928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de150eb-1a00-4845-8c27-5eac04c73b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:29.106618 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de150eb-1a00-4845-8c27-5eac04c73b28 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:29.106900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de150eb-1a00-4845-8c27-5eac04c73b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:29.107175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de150eb-1a00-4845-8c27-5eac04c73b28 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:29.107916 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de150eb-1a00-4845-8c27-5eac04c73b28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:29.108285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de150eb-1a00-4845-8c27-5eac04c73b28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:29.109626 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de150eb-1a00-4845-8c27-5eac04c73b28 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:29.123738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 344/687] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:29:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:29.123738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de150eb-1a00-4845-8c27-5eac04c73b28 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:29.197211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 344/688] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:29:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:29:29.197996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:29.199314 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322f335-88c1-4f72-80c1-82834a62c5c8 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:29.249669 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de150eb-1a00-4845-8c27-5eac04c73b28 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:29.270166 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:29.303920 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e352e72-e32d-48b8-a4d6-538304006dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:29.305230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e352e72-e32d-48b8-a4d6-538304006dac None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:29.306031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e352e72-e32d-48b8-a4d6-538304006dac None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:29.306555 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e352e72-e32d-48b8-a4d6-538304006dac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:29.308048 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e352e72-e32d-48b8-a4d6-538304006dac None admin] RBAC: Adding query filter params (role.id=539442ef092c4fcf9e1d0be045928c5a, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=791ed0f433834b4599d6bc825440279d) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:29.308576 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e352e72-e32d-48b8-a4d6-538304006dac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:29.310821 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e352e72-e32d-48b8-a4d6-538304006dac None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:29.318793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 345/689] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:29:29 2022] GET /identity/v3/role_assignments?user.id=791ed0f433834b4599d6bc825440279d&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=539442ef092c4fcf9e1d0be045928c5a => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:29.319828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e352e72-e32d-48b8-a4d6-538304006dac None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:29.323767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322f335-88c1-4f72-80c1-82834a62c5c8 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:29.360786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2c915-815c-403e-b392-fc68ff831005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:29.363043 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2c915-815c-403e-b392-fc68ff831005 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:29.363560 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2c915-815c-403e-b392-fc68ff831005 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:29.364038 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2c915-815c-403e-b392-fc68ff831005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:29.375446 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2c915-815c-403e-b392-fc68ff831005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:29.377920 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2c915-815c-403e-b392-fc68ff831005 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:29.397304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-1de2c915-815c-403e-b392-fc68ff831005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:29.397304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:29.397304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:29.397304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:29.397304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:29.397304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:29.397304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:29.397304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:29.397304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:29.397304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:29.397304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:29.397304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:29.397304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:29.397304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:29.397304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:29.398307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:29.398307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:29.398307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:29.398307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:29.398307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:29.398307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:29.398307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:29.398307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:29.398307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:29.398307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:29.398307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:29.398307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:29.398307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:29.398307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:29.398307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:29.398307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:29.398307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:29.399193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:29.399193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:29.399193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:29.399193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:29.401593 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 345/690] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:29.403158 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351927d7-1832-4891-af72-024ccc35d27a None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:29.403670 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351927d7-1832-4891-af72-024ccc35d27a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:29.404156 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351927d7-1832-4891-af72-024ccc35d27a None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:29.405957 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 346/691] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:29.406865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351927d7-1832-4891-af72-024ccc35d27a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:29.444613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e352e72-e32d-48b8-a4d6-538304006dac None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:29.469330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:29.491280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750366d-07ee-42ff-b43f-b6dbecfdc9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:29.492475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750366d-07ee-42ff-b43f-b6dbecfdc9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:29.492959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750366d-07ee-42ff-b43f-b6dbecfdc9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:29.493477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750366d-07ee-42ff-b43f-b6dbecfdc9c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:29.510424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750366d-07ee-42ff-b43f-b6dbecfdc9c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:29.512696 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750366d-07ee-42ff-b43f-b6dbecfdc9c0 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:29.524473 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351927d7-1832-4891-af72-024ccc35d27a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:29.527793 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:29.540708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-c750366d-07ee-42ff-b43f-b6dbecfdc9c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:29.540708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:29.540708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:29.540708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:29.540708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:29.540708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:29.540708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:29.540708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:29.540708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:29.540708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:29.540708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:29.540708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:29.540708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:29.540708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:29.540708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:29.541687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:29.541687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:29.541687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:29.541687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:29.541687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:29.541687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:29.541687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:29.541687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:29.541687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:29.541687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:29.541687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:29.541687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:29.541687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:29.541687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:29.541687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:29.541687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:29.541687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:29.542564 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:29.542564 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:29.542564 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:29.542564 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:29.543628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 346/692] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:29.544795 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfe441-b174-4360-a6dc-f030edaf9b7a None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:29.545089 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfe441-b174-4360-a6dc-f030edaf9b7a None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:29.545391 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cfe441-b174-4360-a6dc-f030edaf9b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:29.565300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-b1cfe441-b174-4360-a6dc-f030edaf9b7a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:29.566620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b1cfe441-b174-4360-a6dc-f030edaf9b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:29.578056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec697100-14b3-4fa0-8192-8dd756900666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:29.578808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec697100-14b3-4fa0-8192-8dd756900666 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:29.579197 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec697100-14b3-4fa0-8192-8dd756900666 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:29.579545 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec697100-14b3-4fa0-8192-8dd756900666 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:29.581074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec697100-14b3-4fa0-8192-8dd756900666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:29.581508 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec697100-14b3-4fa0-8192-8dd756900666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:29.582889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec697100-14b3-4fa0-8192-8dd756900666 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:29.594760 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 347/693] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:29.597409 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec697100-14b3-4fa0-8192-8dd756900666 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:29.653549 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 347/694] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:29.654404 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfe441-b174-4360-a6dc-f030edaf9b7a None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:29.737124 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec697100-14b3-4fa0-8192-8dd756900666 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:29.781940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc575ac6-c252-4f90-bbbe-670893aaa44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:29.783660 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc575ac6-c252-4f90-bbbe-670893aaa44e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:29.784225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc575ac6-c252-4f90-bbbe-670893aaa44e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:29.784703 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc575ac6-c252-4f90-bbbe-670893aaa44e None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:29.786210 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc575ac6-c252-4f90-bbbe-670893aaa44e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:29.786719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc575ac6-c252-4f90-bbbe-670893aaa44e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:29.789126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc575ac6-c252-4f90-bbbe-670893aaa44e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:29.791136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cfe441-b174-4360-a6dc-f030edaf9b7a None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:29.793231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:29.813291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 348/695] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:29.814592 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc575ac6-c252-4f90-bbbe-670893aaa44e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:29.842552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf0657-de8e-4a82-91aa-4622e2ae73cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:29.843903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf0657-de8e-4a82-91aa-4622e2ae73cd None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:29.844184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf0657-de8e-4a82-91aa-4622e2ae73cd None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:29.844455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf0657-de8e-4a82-91aa-4622e2ae73cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:29.848579 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:29.857600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf0657-de8e-4a82-91aa-4622e2ae73cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:29.859055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf0657-de8e-4a82-91aa-4622e2ae73cd None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:29.883088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-fddf0657-de8e-4a82-91aa-4622e2ae73cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 19:29:29.883088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:29.883088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:29.883088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:29.883088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:29.883088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:29.883088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:29.883088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:29.883088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:29.883088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:29.883088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:29.883088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:29.883088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:29.883088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:29.883088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:29.883088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:29.884069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:29.884069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:29.884069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:29.884069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:29.884069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:29.884069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:29.884069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:29.884069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:29.884069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:29.884069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:29.884069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:29.884069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:29.884069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:29.884069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:29.884069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:29.884069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:29.884069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:29.884069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:29.885011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:29.885011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:29.885011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:29.885011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:29.885011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:29.885011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:29.885011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:29.885011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:29.885011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 19:29:29.885011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:29.885011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 348/696] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jun 14 19:29:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:29.885632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf0657-de8e-4a82-91aa-4622e2ae73cd None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:29.951631 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc575ac6-c252-4f90-bbbe-670893aaa44e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:29.991185 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc91ac-a8d3-4323-9182-9bad7acc2e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:29.992610 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc91ac-a8d3-4323-9182-9bad7acc2e04 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:29.993368 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc91ac-a8d3-4323-9182-9bad7acc2e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:29.993946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc91ac-a8d3-4323-9182-9bad7acc2e04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:30.004814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf0657-de8e-4a82-91aa-4622e2ae73cd None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:30.008133 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc91ac-a8d3-4323-9182-9bad7acc2e04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:30.009564 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc91ac-a8d3-4323-9182-9bad7acc2e04 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:30.029311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-38fc91ac-a8d3-4323-9182-9bad7acc2e04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:30.029311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:30.029311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:30.029311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:30.029311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:30.029311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:30.029311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:30.029311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:30.029311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:30.029311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:30.029311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:30.029311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:30.029311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:30.029311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:30.029311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:30.030303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:30.030303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:30.030303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:30.030303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:30.030303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:30.030303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:30.030303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:30.030303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:30.030303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:30.030303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:30.030303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:30.030303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:30.030303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:30.030303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:30.030303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:30.030303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:30.030303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:30.031170 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:30.031170 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:30.031170 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:30.031170 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:30.031170 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 349/697] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:30.031880 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc91ac-a8d3-4323-9182-9bad7acc2e04 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:30.044542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed305d98-40c1-474e-8996-ef0f27838790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:30.045697 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed305d98-40c1-474e-8996-ef0f27838790 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:30.046205 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed305d98-40c1-474e-8996-ef0f27838790 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:30.046691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed305d98-40c1-474e-8996-ef0f27838790 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:30.055759 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed305d98-40c1-474e-8996-ef0f27838790 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:30.057502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed305d98-40c1-474e-8996-ef0f27838790 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:30.072265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-ed305d98-40c1-474e-8996-ef0f27838790 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:30.072265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:30.072265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:30.072265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:30.072265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:30.072265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:30.072265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:30.072265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:30.072265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:30.072265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:30.072265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:30.072265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:30.072265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:30.072265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:30.072265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:30.073595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:30.073595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:30.073595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:30.073595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:30.073595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:30.073595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:30.073595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:30.073595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:30.073595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:30.073595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:30.073595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:30.073595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:30.073595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:30.073595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:30.073595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:30.073595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:30.073595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:30.074456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:30.074456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:30.074456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:30.074456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:30.074456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:30.074456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:30.074456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:30.074456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:30.081280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 349/698] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:30.082421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed305d98-40c1-474e-8996-ef0f27838790 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:30.107454 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:30.122925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:30.151714 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc91ac-a8d3-4323-9182-9bad7acc2e04 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:30.189097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71483fa5-083a-4991-b936-30a61bef7655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:30.190931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71483fa5-083a-4991-b936-30a61bef7655 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:30.191044 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed305d98-40c1-474e-8996-ef0f27838790 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:30.191253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71483fa5-083a-4991-b936-30a61bef7655 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:30.191539 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71483fa5-083a-4991-b936-30a61bef7655 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:30.192374 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71483fa5-083a-4991-b936-30a61bef7655 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:30.192684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71483fa5-083a-4991-b936-30a61bef7655 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:30.194257 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71483fa5-083a-4991-b936-30a61bef7655 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:30.221483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 350/699] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jun 14 19:29:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:30.222555 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71483fa5-083a-4991-b936-30a61bef7655 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:30.227797 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba478a2-b52f-4d00-847f-586955faecdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:30.228723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba478a2-b52f-4d00-847f-586955faecdb None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:30.229202 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba478a2-b52f-4d00-847f-586955faecdb None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:30.229712 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba478a2-b52f-4d00-847f-586955faecdb None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:30.230631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba478a2-b52f-4d00-847f-586955faecdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:30.231131 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba478a2-b52f-4d00-847f-586955faecdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:30.232782 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba478a2-b52f-4d00-847f-586955faecdb None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:30.246206 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 350/700] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:30.247331 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba478a2-b52f-4d00-847f-586955faecdb None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:30.328898 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71483fa5-083a-4991-b936-30a61bef7655 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:30.332816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:30.352590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba478a2-b52f-4d00-847f-586955faecdb None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:30.367440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2b4fe-0000-446b-ae83-9b7a9a6b4ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:30.368100 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2b4fe-0000-446b-ae83-9b7a9a6b4ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:30.368390 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2b4fe-0000-446b-ae83-9b7a9a6b4ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:30.368699 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2b4fe-0000-446b-ae83-9b7a9a6b4ca9 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:30.369979 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2b4fe-0000-446b-ae83-9b7a9a6b4ca9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:30.370295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2b4fe-0000-446b-ae83-9b7a9a6b4ca9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:30.372258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2b4fe-0000-446b-ae83-9b7a9a6b4ca9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:30.391919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:30.392974 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 351/701] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:30.394056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2b4fe-0000-446b-ae83-9b7a9a6b4ca9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:30.400835 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51633d20-5355-4031-838d-f7367d3a6511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:30.401529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51633d20-5355-4031-838d-f7367d3a6511 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:30.401818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51633d20-5355-4031-838d-f7367d3a6511 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:30.402097 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51633d20-5355-4031-838d-f7367d3a6511 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:30.481484 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51633d20-5355-4031-838d-f7367d3a6511 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:30.483315 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51633d20-5355-4031-838d-f7367d3a6511 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:30.508391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2b4fe-0000-446b-ae83-9b7a9a6b4ca9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:30.546617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc337815-1a55-4de5-8fb4-35c071a14e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:30.547489 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc337815-1a55-4de5-8fb4-35c071a14e03 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:30.547720 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc337815-1a55-4de5-8fb4-35c071a14e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:30.547998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc337815-1a55-4de5-8fb4-35c071a14e03 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:30.548860 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc337815-1a55-4de5-8fb4-35c071a14e03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:30.550261 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc337815-1a55-4de5-8fb4-35c071a14e03 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:30.571131 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:30.575641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 352/702] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jun 14 19:29:30 2022] POST /identity/v3/users => generated 254 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:29:30.576641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc337815-1a55-4de5-8fb4-35c071a14e03 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:30.593766 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 351/703] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:29:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:29:30.601361 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51633d20-5355-4031-838d-f7367d3a6511 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:30.652401 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:30.712644 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51633d20-5355-4031-838d-f7367d3a6511 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:30.713497 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc337815-1a55-4de5-8fb4-35c071a14e03 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:30.748702 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ee543-eb17-495d-89bf-83905e772ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:30.749636 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ee543-eb17-495d-89bf-83905e772ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:30.749841 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ee543-eb17-495d-89bf-83905e772ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:30.750118 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ee543-eb17-495d-89bf-83905e772ed4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:30.755724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dbe04-94b4-4196-addc-e0265f3f4398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:30.756745 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dbe04-94b4-4196-addc-e0265f3f4398 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:30.757239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dbe04-94b4-4196-addc-e0265f3f4398 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:30.757775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300dbe04-94b4-4196-addc-e0265f3f4398 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:30.758987 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300dbe04-94b4-4196-addc-e0265f3f4398 None admin] RBAC: Adding query filter params (role.id=539442ef092c4fcf9e1d0be045928c5a, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=7fff5414195f4873bcc8752c914b6b49) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:30.759521 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300dbe04-94b4-4196-addc-e0265f3f4398 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:30.761444 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300dbe04-94b4-4196-addc-e0265f3f4398 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:30.762611 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ee543-eb17-495d-89bf-83905e772ed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:30.764046 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ee543-eb17-495d-89bf-83905e772ed4 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:30.770016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 353/704] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:29:30 2022] GET /identity/v3/role_assignments?user.id=7fff5414195f4873bcc8752c914b6b49&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=539442ef092c4fcf9e1d0be045928c5a => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:30.797928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-8d5ee543-eb17-495d-89bf-83905e772ed4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:30.797928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:30.797928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:30.797928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:30.797928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:30.797928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:30.797928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:30.797928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:30.797928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:30.797928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:30.797928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:30.797928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:30.797928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:30.797928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:30.797928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:30.799470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:30.799470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:30.799470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:30.799470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:30.799470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:30.799470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:30.799470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:30.799470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:30.799470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:30.799470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:30.799470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:30.799470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:30.799470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:30.799470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:30.799470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:30.799470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:30.799470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:30.800558 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:30.800558 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:30.800558 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:30.800558 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:30.809889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 352/705] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:30.811160 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dbe04-94b4-4196-addc-e0265f3f4398 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:30.971104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300dbe04-94b4-4196-addc-e0265f3f4398 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:30.985611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:31.008151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27a638-ac60-4135-a771-0e1950141e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:31.008812 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27a638-ac60-4135-a771-0e1950141e5f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:31.009140 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27a638-ac60-4135-a771-0e1950141e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:31.009360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27a638-ac60-4135-a771-0e1950141e5f None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:31.010099 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27a638-ac60-4135-a771-0e1950141e5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:31.010407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27a638-ac60-4135-a771-0e1950141e5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:31.011770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27a638-ac60-4135-a771-0e1950141e5f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:31.023305 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 354/706] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:31.028339 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ee543-eb17-495d-89bf-83905e772ed4 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:31.065904 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:31.140096 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ee543-eb17-495d-89bf-83905e772ed4 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:31.181036 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadce093-5aa0-4e84-83f5-e58ff82a121f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:31.181888 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadce093-5aa0-4e84-83f5-e58ff82a121f None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:31.182169 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadce093-5aa0-4e84-83f5-e58ff82a121f None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:31.182450 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadce093-5aa0-4e84-83f5-e58ff82a121f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:31.191606 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadce093-5aa0-4e84-83f5-e58ff82a121f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:31.193165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadce093-5aa0-4e84-83f5-e58ff82a121f None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:31.209925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-dadce093-5aa0-4e84-83f5-e58ff82a121f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:31.209925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:31.209925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:31.209925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:31.209925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:31.209925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:31.209925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:31.209925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:31.209925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:31.209925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:31.209925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:31.209925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:31.209925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:31.209925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:31.209925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:31.210953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:31.210953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:31.210953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:31.210953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:31.210953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:31.210953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:31.210953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:31.210953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:31.210953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:31.210953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:31.210953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:31.210953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:31.210953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:31.210953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:31.210953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:31.210953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:31.210953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:31.211867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:31.211867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:31.211867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:31.211867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:31.211867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:31.211867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:31.211867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:31.211867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:31.211867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 353/707] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:31.217107 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27a638-ac60-4135-a771-0e1950141e5f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:31.263728 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c5817-03d9-4edc-9f25-88a16d9d619f None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:31.263914 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c5817-03d9-4edc-9f25-88a16d9d619f None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:31.264187 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c5817-03d9-4edc-9f25-88a16d9d619f None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:31.265701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 354/708] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:29:31.271030 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666d9fd-f43b-4e99-ad7b-8546aba10652 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:31.271325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666d9fd-f43b-4e99-ad7b-8546aba10652 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:31.271610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666d9fd-f43b-4e99-ad7b-8546aba10652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:31.310454 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-b666d9fd-f43b-4e99-ad7b-8546aba10652 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:31.311664 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b666d9fd-f43b-4e99-ad7b-8546aba10652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:31.335295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27a638-ac60-4135-a771-0e1950141e5f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:31.372649 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e7d04-292c-405a-9b01-da88990f5e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:31.373510 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e7d04-292c-405a-9b01-da88990f5e03 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:31.373897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e7d04-292c-405a-9b01-da88990f5e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:31.374727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e7d04-292c-405a-9b01-da88990f5e03 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:31.375691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e7d04-292c-405a-9b01-da88990f5e03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:31.376101 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e7d04-292c-405a-9b01-da88990f5e03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:31.378330 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e7d04-292c-405a-9b01-da88990f5e03 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:31.404220 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 355/709] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:31.406375 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e7d04-292c-405a-9b01-da88990f5e03 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:31.436851 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 355/710] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:29:31.459458 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666d9fd-f43b-4e99-ad7b-8546aba10652 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:31.477781 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:31.486525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:31.543419 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e7d04-292c-405a-9b01-da88990f5e03 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:31.582960 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb18499-cc53-48cd-9b98-9093a5aff6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:31.583771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb18499-cc53-48cd-9b98-9093a5aff6be None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:31.584056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb18499-cc53-48cd-9b98-9093a5aff6be None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:31.584329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb18499-cc53-48cd-9b98-9093a5aff6be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:31.585605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb18499-cc53-48cd-9b98-9093a5aff6be None admin] RBAC: Adding query filter params (role.id=1e2bb0d759694428ada2b52285de933b, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=37c521e20aea4cad9758568a4f082fbd) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:31.585918 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb18499-cc53-48cd-9b98-9093a5aff6be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:31.587507 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb18499-cc53-48cd-9b98-9093a5aff6be None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:31.593653 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 356/711] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:29:31 2022] GET /identity/v3/role_assignments?user.id=37c521e20aea4cad9758568a4f082fbd&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=1e2bb0d759694428ada2b52285de933b => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:31.630591 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666d9fd-f43b-4e99-ad7b-8546aba10652 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:31.724081 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fbb70-be67-4ea3-9938-05ea1baad2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:31.724915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fbb70-be67-4ea3-9938-05ea1baad2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:31.725194 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fbb70-be67-4ea3-9938-05ea1baad2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:31.725493 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fbb70-be67-4ea3-9938-05ea1baad2e5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:31.726167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6fbb70-be67-4ea3-9938-05ea1baad2e5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:31.727690 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6fbb70-be67-4ea3-9938-05ea1baad2e5 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:31.743525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-ad6fbb70-be67-4ea3-9938-05ea1baad2e5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 19:29:31.743525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:31.743525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:29:31.743525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:29:31.743525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:29:31.743525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:29:31.743525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:29:31.743525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:31.743525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 19:29:31.743525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:31.743525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:29:31.743525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:31.743525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:31.743525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:31.743525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:31.743525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:31.744551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:31.744551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:31.744551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:31.744551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:31.744551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:31.744551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:31.744551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:31.744551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:29:31.744551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:29:31.744551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:29:31.744551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:29:31.744551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:31.744551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:31.744551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:31.744551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:31.744551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:31.745444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:31.745444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:31.745444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:31.745444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:31.745444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:31.745444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:31.745444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:31.745444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:31.745444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:31.745444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:31.745444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:31.745444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:29:31.745444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:31.745444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 19:29:31.745444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:31.745444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 356/712] 10.222.0.44 () {56 vars in 1129 bytes} [Tue Jun 14 19:29:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:31.754627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb18499-cc53-48cd-9b98-9093a5aff6be None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:31.892170 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:31.901755 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb18499-cc53-48cd-9b98-9093a5aff6be None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:31.945416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b28389-98af-422d-b538-52856ef1beb4 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:31.945737 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b28389-98af-422d-b538-52856ef1beb4 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:31.946027 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b28389-98af-422d-b538-52856ef1beb4 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:31.947651 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 357/713] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:29:31.950399 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e566712-dc98-4e5c-877e-9c6a4570578c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:31.951379 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e566712-dc98-4e5c-877e-9c6a4570578c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:31.951858 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e566712-dc98-4e5c-877e-9c6a4570578c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:31.952340 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e566712-dc98-4e5c-877e-9c6a4570578c None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:31.952454 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2a135-c41e-47e9-8387-384192043ed3 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:31.952715 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2a135-c41e-47e9-8387-384192043ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:31.952997 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2a135-c41e-47e9-8387-384192043ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:31.953780 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e566712-dc98-4e5c-877e-9c6a4570578c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:31.954279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e566712-dc98-4e5c-877e-9c6a4570578c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:31.956834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e566712-dc98-4e5c-877e-9c6a4570578c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:31.965032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 357/714] 10.222.0.44 () {56 vars in 1124 bytes} [Tue Jun 14 19:29:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:31.970394 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e566712-dc98-4e5c-877e-9c6a4570578c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:31.973704 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-1fb2a135-c41e-47e9-8387-384192043ed3 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:31.975003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-1fb2a135-c41e-47e9-8387-384192043ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:32.094049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 358/715] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:32.118479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2a135-c41e-47e9-8387-384192043ed3 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:32.133272 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e566712-dc98-4e5c-877e-9c6a4570578c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:32.155869 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:32.171336 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3520c9-10af-4ba4-bc15-808c66bea302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:32.172007 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3520c9-10af-4ba4-bc15-808c66bea302 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:32.172295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3520c9-10af-4ba4-bc15-808c66bea302 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:32.172575 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3520c9-10af-4ba4-bc15-808c66bea302 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:32.173284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3520c9-10af-4ba4-bc15-808c66bea302 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:32.173657 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3520c9-10af-4ba4-bc15-808c66bea302 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:32.175149 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3520c9-10af-4ba4-bc15-808c66bea302 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:32.189115 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 358/716] 10.222.0.44 () {56 vars in 1124 bytes} [Tue Jun 14 19:29:31 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:32.303183 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2a135-c41e-47e9-8387-384192043ed3 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:32.357677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8484ac8-2371-4748-b01f-fed7314043c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:32.358864 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8484ac8-2371-4748-b01f-fed7314043c5 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:32.359346 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8484ac8-2371-4748-b01f-fed7314043c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:32.359812 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8484ac8-2371-4748-b01f-fed7314043c5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:32.360689 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8484ac8-2371-4748-b01f-fed7314043c5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:32.362933 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8484ac8-2371-4748-b01f-fed7314043c5 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:32.375627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-b8484ac8-2371-4748-b01f-fed7314043c5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 19:29:32.375627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:32.375627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:29:32.375627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:29:32.375627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:29:32.375627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:29:32.375627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:29:32.375627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:32.375627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 19:29:32.375627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:32.375627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:29:32.375627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:32.375627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:32.375627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:32.375627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:32.375627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:32.375627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:32.376692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:32.376692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:32.376692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:32.376692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:32.376692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:32.376692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:32.376692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:29:32.376692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:29:32.376692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:29:32.376692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:29:32.376692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:32.376692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:32.376692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:32.376692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:32.376692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:32.376692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:32.377610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:32.377610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:32.377610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:32.377610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:32.377610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:32.377610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:32.377610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:32.377610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:32.377610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:32.377610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:32.377610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:29:32.377610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:32.377610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 19:29:32.377610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:32.380597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 359/717] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:32 2022] GET /identity/v3/services/network => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:32.386534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3520c9-10af-4ba4-bc15-808c66bea302 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:32.431537 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:32.512290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3520c9-10af-4ba4-bc15-808c66bea302 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:32.552243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbc423-8ba8-4295-9e3e-ab1336e0de3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:32.552908 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbc423-8ba8-4295-9e3e-ab1336e0de3b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:32.553190 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbc423-8ba8-4295-9e3e-ab1336e0de3b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:32.553493 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbc423-8ba8-4295-9e3e-ab1336e0de3b None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:32.554197 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbc423-8ba8-4295-9e3e-ab1336e0de3b None admin] RBAC: Adding query filter params (name=network) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:32.554499 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbc423-8ba8-4295-9e3e-ab1336e0de3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:32.555866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbc423-8ba8-4295-9e3e-ab1336e0de3b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:32.560827 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 359/718] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jun 14 19:29:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:32.566039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8484ac8-2371-4748-b01f-fed7314043c5 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:32.698932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:32.724959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8484ac8-2371-4748-b01f-fed7314043c5 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:32.765222 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829af474-1354-4256-9d7d-5ede5ba90e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:32.765922 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829af474-1354-4256-9d7d-5ede5ba90e98 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:32.766202 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829af474-1354-4256-9d7d-5ede5ba90e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:32.766475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829af474-1354-4256-9d7d-5ede5ba90e98 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:32.767236 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829af474-1354-4256-9d7d-5ede5ba90e98 None admin] RBAC: Adding query filter params (type=network) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:32.768413 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829af474-1354-4256-9d7d-5ede5ba90e98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:32.769887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829af474-1354-4256-9d7d-5ede5ba90e98 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:32.776104 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 360/719] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jun 14 19:29:32 2022] GET /identity/v3/services?type=network => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:33.541556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319e447-3826-4409-8b14-b6fe42cf7646 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:33.542614 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319e447-3826-4409-8b14-b6fe42cf7646 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:33.543119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319e447-3826-4409-8b14-b6fe42cf7646 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:33.545033 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 360/720] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:33.550368 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e7b32-416f-4d93-a3dd-f7c55ac330e7 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:33.551275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e7b32-416f-4d93-a3dd-f7c55ac330e7 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:33.551790 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e7b32-416f-4d93-a3dd-f7c55ac330e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:33.578666 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-982e7b32-416f-4d93-a3dd-f7c55ac330e7 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:33.580695 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-982e7b32-416f-4d93-a3dd-f7c55ac330e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:33.627763 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5ab66-a517-4044-b6a1-dbf44f3a2b03 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:33.628378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5ab66-a517-4044-b6a1-dbf44f3a2b03 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:33.628851 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5ab66-a517-4044-b6a1-dbf44f3a2b03 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:33.630715 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 361/721] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:33.635522 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d247a-4bee-46d6-8475-ee1ae125dbe8 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:33.635823 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d247a-4bee-46d6-8475-ee1ae125dbe8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:33.636103 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33d247a-4bee-46d6-8475-ee1ae125dbe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:33.670413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c33d247a-4bee-46d6-8475-ee1ae125dbe8 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:33.671626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c33d247a-4bee-46d6-8475-ee1ae125dbe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:33.675139 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 361/722] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:33.698058 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e7b32-416f-4d93-a3dd-f7c55ac330e7 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:33.805823 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 362/723] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:33.843233 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:33.860396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e7b32-416f-4d93-a3dd-f7c55ac330e7 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:33.879599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d247a-4bee-46d6-8475-ee1ae125dbe8 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:33.906069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401048b-a57f-4525-bb60-3cebbb947a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:33.906887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401048b-a57f-4525-bb60-3cebbb947a13 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:33.907314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401048b-a57f-4525-bb60-3cebbb947a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:33.907600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401048b-a57f-4525-bb60-3cebbb947a13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:33.919637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2401048b-a57f-4525-bb60-3cebbb947a13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:33.928472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:33.928723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-2401048b-a57f-4525-bb60-3cebbb947a13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:33.928723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:33.928723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:33.928723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:33.928723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:33.928723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:33.928723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:33.928723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:33.928723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:33.928723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:33.928723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:33.928723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:33.928723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:33.928723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:33.928723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:33.928723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:33.929682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:33.929682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:33.929682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:33.929682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:33.929682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:33.929682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:33.929682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:33.929682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:33.929682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:33.929682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:33.929682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:33.929682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:33.929682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:33.929682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:33.929682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:33.929682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:33.930523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:33.930523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:33.930523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:33.930523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:33.930523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:33.930523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:33.930523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:33.930523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:33.930523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:33.930523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:33.930523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:33.930523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:33.930523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 362/724] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:29:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:33.936069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401048b-a57f-4525-bb60-3cebbb947a13 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:34.049702 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401048b-a57f-4525-bb60-3cebbb947a13 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:34.081055 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33d247a-4bee-46d6-8475-ee1ae125dbe8 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:34.115293 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de28b9f-683c-4e82-b093-3bb164dfaa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:34.116016 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de28b9f-683c-4e82-b093-3bb164dfaa09 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:34.116307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de28b9f-683c-4e82-b093-3bb164dfaa09 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:34.116588 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de28b9f-683c-4e82-b093-3bb164dfaa09 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:34.117339 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de28b9f-683c-4e82-b093-3bb164dfaa09 None admin] RBAC: Adding query filter params (name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:34.117676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de28b9f-683c-4e82-b093-3bb164dfaa09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:34.119043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de28b9f-683c-4e82-b093-3bb164dfaa09 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:34.135562 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 363/725] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jun 14 19:29:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:34.135815 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:34.144183 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de28b9f-683c-4e82-b093-3bb164dfaa09 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:34.157289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9571da-5ad7-4fb8-baa9-254e8a615d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:34.159180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9571da-5ad7-4fb8-baa9-254e8a615d96 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:34.159472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9571da-5ad7-4fb8-baa9-254e8a615d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:34.159750 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9571da-5ad7-4fb8-baa9-254e8a615d96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:34.179201 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9571da-5ad7-4fb8-baa9-254e8a615d96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:34.187768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-6f9571da-5ad7-4fb8-baa9-254e8a615d96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:29:34.187768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:34.187768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:34.187768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:34.187768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:34.187768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:34.187768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:34.187768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:34.187768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:34.187768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:34.187768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:34.187768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:34.187768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:34.187768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:34.187768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:34.187768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:34.188910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:34.188910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:34.188910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:34.188910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:34.188910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:34.188910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:34.188910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:34.188910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:34.188910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:34.188910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:34.188910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:34.188910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:34.188910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:34.188910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:34.188910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:34.188910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:34.189981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:34.189981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:34.189981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:34.189981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:34.189981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:34.189981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:34.189981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:34.189981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:34.189981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:34.189981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:34.189981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:29:34.189981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:34.189981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 363/726] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:29:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:34.206901 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9571da-5ad7-4fb8-baa9-254e8a615d96 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:34.303311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de28b9f-683c-4e82-b093-3bb164dfaa09 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:34.316521 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:34.342456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90494d93-fbbb-4dc9-b5ff-2b959fe93878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:34.342651 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9571da-5ad7-4fb8-baa9-254e8a615d96 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:34.343174 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90494d93-fbbb-4dc9-b5ff-2b959fe93878 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:34.343459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90494d93-fbbb-4dc9-b5ff-2b959fe93878 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:34.343736 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90494d93-fbbb-4dc9-b5ff-2b959fe93878 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:34.362263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90494d93-fbbb-4dc9-b5ff-2b959fe93878 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:34.364233 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90494d93-fbbb-4dc9-b5ff-2b959fe93878 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:34.384711 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c58f34-7ca5-4bbb-8a79-44c99f9daec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:34.385055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-90494d93-fbbb-4dc9-b5ff-2b959fe93878 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:34.385055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:34.385055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:34.385055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:34.385055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:34.385055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:34.385055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:34.385055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:34.385055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:34.385055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:34.385055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:34.385055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:34.385055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:34.385055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:34.385055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:34.385929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:34.385929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:34.385929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:34.385929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:34.385929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:34.385929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:34.385929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:34.385929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:34.385929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:34.385929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:34.385929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:34.385929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:34.385929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:34.385929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:34.385929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:34.385929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:34.385929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:34.386776 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:34.386776 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:34.386776 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:34.386776 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:34.387000 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c58f34-7ca5-4bbb-8a79-44c99f9daec3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:34.387000 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c58f34-7ca5-4bbb-8a79-44c99f9daec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:34.387000 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c58f34-7ca5-4bbb-8a79-44c99f9daec3 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:34.387000 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c58f34-7ca5-4bbb-8a79-44c99f9daec3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:34.387000 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c58f34-7ca5-4bbb-8a79-44c99f9daec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:34.388361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c58f34-7ca5-4bbb-8a79-44c99f9daec3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:34.391049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 364/727] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:34.392892 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0509f8-fb90-46ad-8953-6709287d5100 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:34.393202 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0509f8-fb90-46ad-8953-6709287d5100 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:34.393487 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0509f8-fb90-46ad-8953-6709287d5100 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:34.395545 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 365/728] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:34.396328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0509f8-fb90-46ad-8953-6709287d5100 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:34.399061 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 364/729] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:29:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:34.401656 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094d7b2-0c1d-433e-a40f-8400373abdae None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:34.402062 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094d7b2-0c1d-433e-a40f-8400373abdae None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:34.402453 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094d7b2-0c1d-433e-a40f-8400373abdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:34.425056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d094d7b2-0c1d-433e-a40f-8400373abdae None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:34.427068 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d094d7b2-0c1d-433e-a40f-8400373abdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:34.452322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:34.512209 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0509f8-fb90-46ad-8953-6709287d5100 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:34.522761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 365/730] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 14 19:29:34.523906 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094d7b2-0c1d-433e-a40f-8400373abdae None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:34.560034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b3c1f-8a42-45ae-a456-a9998c1baf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:34.560708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b3c1f-8a42-45ae-a456-a9998c1baf33 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:34.561002 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b3c1f-8a42-45ae-a456-a9998c1baf33 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:34.561242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b3c1f-8a42-45ae-a456-a9998c1baf33 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:34.561991 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b3c1f-8a42-45ae-a456-a9998c1baf33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:34.562293 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b3c1f-8a42-45ae-a456-a9998c1baf33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:34.563692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b3c1f-8a42-45ae-a456-a9998c1baf33 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:34.577249 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 366/731] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:34.578176 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b3c1f-8a42-45ae-a456-a9998c1baf33 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:34.631953 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:34.676038 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094d7b2-0c1d-433e-a40f-8400373abdae None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:34.696713 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b3c1f-8a42-45ae-a456-a9998c1baf33 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:34.712716 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d7a7f-7522-4e93-8081-b85f92ab454e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:34.713041 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:34.713823 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d7a7f-7522-4e93-8081-b85f92ab454e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:34.714299 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d7a7f-7522-4e93-8081-b85f92ab454e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:34.714590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37d7a7f-7522-4e93-8081-b85f92ab454e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:34.727549 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d7a7f-7522-4e93-8081-b85f92ab454e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:34.729026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37d7a7f-7522-4e93-8081-b85f92ab454e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:34.743990 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2495a5-d5c2-410f-9447-da3aaa2f497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:34.745002 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2495a5-d5c2-410f-9447-da3aaa2f497f None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:34.745458 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2495a5-d5c2-410f-9447-da3aaa2f497f None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:34.745883 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2495a5-d5c2-410f-9447-da3aaa2f497f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:34.749126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-b37d7a7f-7522-4e93-8081-b85f92ab454e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:34.749126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:34.749126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:34.749126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:34.749126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:34.749126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:34.749126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:34.749126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:34.749126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:34.749126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:34.749126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:34.749126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:34.749126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:34.749126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:34.749126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:34.750226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:34.750226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:34.750226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:34.750226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:34.750226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:34.750226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:34.750226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:34.750226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:34.750226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:34.750226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:34.750226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:34.750226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:34.750226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:34.750226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:34.750226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:34.750226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:34.750226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:34.751354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:34.751354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:34.751354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:34.751354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:34.757309 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 366/732] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:34.758381 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d7a7f-7522-4e93-8081-b85f92ab454e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:34.761711 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2495a5-d5c2-410f-9447-da3aaa2f497f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:34.773251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-4c2495a5-d5c2-410f-9447-da3aaa2f497f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:29:34.773251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:34.773251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:34.773251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:34.773251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:34.773251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:34.773251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:34.773251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:34.773251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:34.773251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:34.773251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:34.773251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:34.773251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:34.773251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:34.773251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:34.773251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:34.774416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:34.774416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:34.774416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:34.774416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:34.774416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:34.774416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:34.774416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:34.774416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:34.774416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:34.774416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:34.774416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:34.774416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:34.774416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:34.774416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:34.774416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:34.774416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:34.775455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:34.775455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:34.775455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:34.775455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:34.775455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:34.775455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:34.775455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:34.775455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:34.775455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:34.775455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:34.775455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:29:34.775455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:34.783493 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 367/733] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:29:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:34.783493 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2495a5-d5c2-410f-9447-da3aaa2f497f None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:34.904069 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37d7a7f-7522-4e93-8081-b85f92ab454e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:34.904808 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2495a5-d5c2-410f-9447-da3aaa2f497f None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:34.932139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:34.945402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55caaf-e33b-4ed7-a5ba-8e90aab03980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:34.946299 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55caaf-e33b-4ed7-a5ba-8e90aab03980 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:34.946592 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55caaf-e33b-4ed7-a5ba-8e90aab03980 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:34.946873 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55caaf-e33b-4ed7-a5ba-8e90aab03980 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:34.948758 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41915fd1-43b2-42dc-9083-52b4a5b55655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:34.950498 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41915fd1-43b2-42dc-9083-52b4a5b55655 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:34.950962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41915fd1-43b2-42dc-9083-52b4a5b55655 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:34.951412 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41915fd1-43b2-42dc-9083-52b4a5b55655 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:34.952420 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41915fd1-43b2-42dc-9083-52b4a5b55655 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:34.952927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41915fd1-43b2-42dc-9083-52b4a5b55655 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:34.954945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41915fd1-43b2-42dc-9083-52b4a5b55655 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:34.955585 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55caaf-e33b-4ed7-a5ba-8e90aab03980 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:34.957244 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55caaf-e33b-4ed7-a5ba-8e90aab03980 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:34.968932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 368/734] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:34.970034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41915fd1-43b2-42dc-9083-52b4a5b55655 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:34.974275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-8d55caaf-e33b-4ed7-a5ba-8e90aab03980 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 19:29:34.974275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:34.974275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:34.974275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:34.974275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:34.974275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:34.974275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:34.974275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:34.974275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:34.974275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:34.974275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:34.974275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:34.974275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:34.974275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:34.974275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:34.974275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:34.975296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:34.975296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:34.975296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:34.975296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:34.975296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:34.975296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:34.975296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:34.975296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:34.975296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:34.975296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:34.975296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:34.975296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:34.975296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:34.975296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:34.975296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:34.975296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:34.975296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:34.975296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:34.976214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:34.976214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:34.976214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:34.976214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:34.976214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:34.976214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:34.976214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:34.976214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:34.976214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 19:29:34.976214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:34.980207 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 367/735] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jun 14 19:29:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:34.981103 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55caaf-e33b-4ed7-a5ba-8e90aab03980 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:35.015690 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:35.104021 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55caaf-e33b-4ed7-a5ba-8e90aab03980 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:35.109780 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41915fd1-43b2-42dc-9083-52b4a5b55655 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:35.138850 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e22f9-e80f-43f9-8efe-f4dd467199aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:35.139511 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e22f9-e80f-43f9-8efe-f4dd467199aa None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:35.139798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e22f9-e80f-43f9-8efe-f4dd467199aa None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:35.140107 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e22f9-e80f-43f9-8efe-f4dd467199aa None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:35.140904 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e22f9-e80f-43f9-8efe-f4dd467199aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:35.141217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e22f9-e80f-43f9-8efe-f4dd467199aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:35.142730 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e22f9-e80f-43f9-8efe-f4dd467199aa None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:35.145891 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3f31a-abf6-457a-8fec-33ed5e89bf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:35.146558 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3f31a-abf6-457a-8fec-33ed5e89bf6c None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:35.146846 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3f31a-abf6-457a-8fec-33ed5e89bf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:35.147128 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3f31a-abf6-457a-8fec-33ed5e89bf6c None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:35.147880 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3f31a-abf6-457a-8fec-33ed5e89bf6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:35.148190 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3f31a-abf6-457a-8fec-33ed5e89bf6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:35.149573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c3f31a-abf6-457a-8fec-33ed5e89bf6c None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:35.162884 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 369/736] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:29:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:35.162884 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3f31a-abf6-457a-8fec-33ed5e89bf6c None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:35.166182 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 368/737] 10.222.0.44 () {56 vars in 1149 bytes} [Tue Jun 14 19:29:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:35.167488 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a29c4a-903b-4a0c-b4c3-ed3c04c250d5 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:35.167786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a29c4a-903b-4a0c-b4c3-ed3c04c250d5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:35.168065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a29c4a-903b-4a0c-b4c3-ed3c04c250d5 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:35.173155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 369/738] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:35.173155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a29c4a-903b-4a0c-b4c3-ed3c04c250d5 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:35.219437 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:35.268792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:35.278821 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c3f31a-abf6-457a-8fec-33ed5e89bf6c None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:35.281448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a29c4a-903b-4a0c-b4c3-ed3c04c250d5 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:35.317908 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e06aa5-8ce5-4256-8489-e0de0088c92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:35.318719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e06aa5-8ce5-4256-8489-e0de0088c92a None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:35.319002 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e06aa5-8ce5-4256-8489-e0de0088c92a None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:35.319279 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e06aa5-8ce5-4256-8489-e0de0088c92a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:35.321474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4caa4-dc7b-4b9c-9284-1736b5f8cb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:35.322297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4caa4-dc7b-4b9c-9284-1736b5f8cb95 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:35.322585 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4caa4-dc7b-4b9c-9284-1736b5f8cb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:35.322864 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4caa4-dc7b-4b9c-9284-1736b5f8cb95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:35.328663 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e06aa5-8ce5-4256-8489-e0de0088c92a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:35.330905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e06aa5-8ce5-4256-8489-e0de0088c92a None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:35.334908 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4caa4-dc7b-4b9c-9284-1736b5f8cb95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:35.336358 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4caa4-dc7b-4b9c-9284-1736b5f8cb95 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:35.346034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-b8e06aa5-8ce5-4256-8489-e0de0088c92a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 14 19:29:35.346034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:35.346034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:35.346034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:35.346034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:35.346034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:35.346034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:35.346034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:35.346034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:35.346034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:35.346034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:35.346034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:35.346034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:35.346034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:35.346034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:35.346034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:35.347085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:35.347085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:35.347085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:35.347085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:35.347085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:35.347085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:35.347085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:35.347085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:35.347085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:35.347085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:35.347085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:35.347085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:35.347085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:35.347085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:35.347085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:35.347085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:35.347085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:35.347085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:35.348004 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:35.348004 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:35.348004 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:35.348004 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:35.348004 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:35.348004 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:35.348004 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:35.348004 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:35.348004 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 14 19:29:35.348004 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:35.348004 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 370/739] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:29:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:35.349132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e06aa5-8ce5-4256-8489-e0de0088c92a None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:35.360253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-4fe4caa4-dc7b-4b9c-9284-1736b5f8cb95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:35.360253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:35.360253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:35.360253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:35.360253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:35.360253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:35.360253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:35.360253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:35.360253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:35.360253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:35.360253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:35.360253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:35.360253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:35.360253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:35.360253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:35.361471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:35.361471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:35.361471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:35.361471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:35.361471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:35.361471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:35.361471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:35.361471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:35.361471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:35.361471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:35.361471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:35.361471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:35.361471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:35.361471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:35.361471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:35.361471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:35.361471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:35.367257 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:35.367257 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:35.367257 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:35.367257 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:35.367257 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 370/740] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:35.367257 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7c998-db90-4f09-87f3-01b9900a45b3 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:35.367257 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7c998-db90-4f09-87f3-01b9900a45b3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:35.367257 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7c998-db90-4f09-87f3-01b9900a45b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:35.380093 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-89e7c998-db90-4f09-87f3-01b9900a45b3 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:35.381281 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-89e7c998-db90-4f09-87f3-01b9900a45b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:35.447685 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 371/741] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:35.448423 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7c998-db90-4f09-87f3-01b9900a45b3 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:35.452891 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e06aa5-8ce5-4256-8489-e0de0088c92a None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:35.482923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:35.489127 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b2f22-ca97-4c8a-89dc-fdc8648979df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:35.489810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b2f22-ca97-4c8a-89dc-fdc8648979df None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:35.490095 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b2f22-ca97-4c8a-89dc-fdc8648979df None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:35.490376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b2f22-ca97-4c8a-89dc-fdc8648979df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:35.514380 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:35.564700 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7c998-db90-4f09-87f3-01b9900a45b3 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:35.565272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b2f22-ca97-4c8a-89dc-fdc8648979df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:35.566109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b2f22-ca97-4c8a-89dc-fdc8648979df None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:35.597955 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f459c92-ada1-429f-b401-d6f0abb13bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:35.598702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f459c92-ada1-429f-b401-d6f0abb13bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:35.598990 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f459c92-ada1-429f-b401-d6f0abb13bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:35.599268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f459c92-ada1-429f-b401-d6f0abb13bd3 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:35.600103 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f459c92-ada1-429f-b401-d6f0abb13bd3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:35.600410 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f459c92-ada1-429f-b401-d6f0abb13bd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:35.601868 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f459c92-ada1-429f-b401-d6f0abb13bd3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:35.619281 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 372/742] 10.222.0.44 () {56 vars in 1135 bytes} [Tue Jun 14 19:29:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:35.619986 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f459c92-ada1-429f-b401-d6f0abb13bd3 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:35.663639 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 371/743] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:29:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:29:35.664847 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f174c6-e53c-4fdb-abbc-ed908ffb0bf6 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:35.665401 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f174c6-e53c-4fdb-abbc-ed908ffb0bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:35.665684 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f174c6-e53c-4fdb-abbc-ed908ffb0bf6 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:35.672893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 372/744] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:35 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:35.674363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f174c6-e53c-4fdb-abbc-ed908ffb0bf6 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:35.713058 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:35.728200 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:35.732320 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f459c92-ada1-429f-b401-d6f0abb13bd3 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:35.766090 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db9e4b-1735-482c-b23a-9397fdb38a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:35.766739 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db9e4b-1735-482c-b23a-9397fdb38a16 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:35.767016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db9e4b-1735-482c-b23a-9397fdb38a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:35.767327 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db9e4b-1735-482c-b23a-9397fdb38a16 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:35.768205 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db9e4b-1735-482c-b23a-9397fdb38a16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:35.768510 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db9e4b-1735-482c-b23a-9397fdb38a16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:35.769916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db9e4b-1735-482c-b23a-9397fdb38a16 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:35.775619 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f174c6-e53c-4fdb-abbc-ed908ffb0bf6 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:35.780865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 373/745] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:35.781679 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db9e4b-1735-482c-b23a-9397fdb38a16 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:35.816728 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30716eb4-a220-42e0-b7bc-a59d21fe8b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:35.819999 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30716eb4-a220-42e0-b7bc-a59d21fe8b63 None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:35.819999 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30716eb4-a220-42e0-b7bc-a59d21fe8b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:35.819999 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30716eb4-a220-42e0-b7bc-a59d21fe8b63 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:35.819999 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30716eb4-a220-42e0-b7bc-a59d21fe8b63 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:35.819999 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30716eb4-a220-42e0-b7bc-a59d21fe8b63 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:35.842944 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 373/746] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jun 14 19:29:35 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:29:35.843755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30716eb4-a220-42e0-b7bc-a59d21fe8b63 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:35.921181 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db9e4b-1735-482c-b23a-9397fdb38a16 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:35.967248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b4e05-4461-4a3e-a208-988e6c6a2c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:35.967946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b4e05-4461-4a3e-a208-988e6c6a2c79 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:35.968227 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b4e05-4461-4a3e-a208-988e6c6a2c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:35.968502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b4e05-4461-4a3e-a208-988e6c6a2c79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:35.977248 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30716eb4-a220-42e0-b7bc-a59d21fe8b63 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:35.978525 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:35.991940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:36.020216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8529888b-7add-4e5c-9e14-e1d08e015ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:36.021043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529888b-7add-4e5c-9e14-e1d08e015ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:36.021331 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529888b-7add-4e5c-9e14-e1d08e015ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:36.021648 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8529888b-7add-4e5c-9e14-e1d08e015ff7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:36.034952 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529888b-7add-4e5c-9e14-e1d08e015ff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:36.036405 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8529888b-7add-4e5c-9e14-e1d08e015ff7 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:36.053972 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b4e05-4461-4a3e-a208-988e6c6a2c79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:36.055216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-8529888b-7add-4e5c-9e14-e1d08e015ff7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:36.055216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:36.055216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:36.055216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:36.055216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:36.055216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:36.055216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:36.055216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:36.055216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:36.055216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:36.055216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:36.055216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:36.055216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:36.055216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:36.055216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:36.056221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:36.056221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:36.056221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:36.056221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:36.056221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:36.056221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:36.056221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:36.056221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:36.056221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:36.056221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:36.056221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:36.056221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:36.056221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:36.056221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:36.056221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:36.056221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:36.056221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:36.057281 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:36.057281 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:36.057281 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:36.057281 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:36.057638 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b4e05-4461-4a3e-a208-988e6c6a2c79 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:36.057719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 374/747] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:36.059921 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bee565-2138-4286-843e-9e7243935337 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:36.059921 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bee565-2138-4286-843e-9e7243935337 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:36.059921 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bee565-2138-4286-843e-9e7243935337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:36.075648 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-75bee565-2138-4286-843e-9e7243935337 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:36.076831 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-75bee565-2138-4286-843e-9e7243935337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:36.149698 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 375/748] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:36 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 14 19:29:36.149698 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bee565-2138-4286-843e-9e7243935337 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:36.167439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 374/749] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:29:35 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 14 19:29:36.168167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b4e05-4461-4a3e-a208-988e6c6a2c79 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:36.210257 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:36.265308 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:36.274128 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bee565-2138-4286-843e-9e7243935337 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:36.274306 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b4e05-4461-4a3e-a208-988e6c6a2c79 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:36.309920 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cb3c1-ba09-4846-9296-929fc46a5346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:36.310583 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cb3c1-ba09-4846-9296-929fc46a5346 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:36.310871 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cb3c1-ba09-4846-9296-929fc46a5346 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:36.310995 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4e488-c349-430e-8fd5-d1bd372d585b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:36.311184 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53cb3c1-ba09-4846-9296-929fc46a5346 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:36.311664 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4e488-c349-430e-8fd5-d1bd372d585b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:36.311866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53cb3c1-ba09-4846-9296-929fc46a5346 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:36.311963 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4e488-c349-430e-8fd5-d1bd372d585b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:36.312174 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53cb3c1-ba09-4846-9296-929fc46a5346 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:36.312269 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c4e488-c349-430e-8fd5-d1bd372d585b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:36.313570 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53cb3c1-ba09-4846-9296-929fc46a5346 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:36.319839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c4e488-c349-430e-8fd5-d1bd372d585b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:36.321408 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c4e488-c349-430e-8fd5-d1bd372d585b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:36.329409 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 375/750] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:36.329409 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cb3c1-ba09-4846-9296-929fc46a5346 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:36.338953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-63c4e488-c349-430e-8fd5-d1bd372d585b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 19:29:36.338953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:36.338953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:36.338953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:36.338953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:36.338953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:36.338953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:36.338953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:36.338953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:36.338953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:36.338953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:36.338953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:36.338953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:36.338953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:36.338953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:36.338953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:36.339885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:36.339885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:36.339885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:36.339885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:36.339885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:36.339885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:36.339885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:36.339885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:36.339885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:36.339885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:36.339885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:36.339885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:36.339885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:36.339885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:36.339885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:36.339885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:36.339885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:36.339885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:36.340793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:36.340793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:36.340793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:36.340793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:36.340793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:36.340793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:36.340793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:36.340793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:36.340793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 19:29:36.340793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:36.340793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 376/751] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jun 14 19:29:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:36.341921 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4e488-c349-430e-8fd5-d1bd372d585b None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:36.436070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:36.440690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53cb3c1-ba09-4846-9296-929fc46a5346 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:36.447757 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c4e488-c349-430e-8fd5-d1bd372d585b None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:36.476729 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319d48a-2925-405a-a7c3-bec8f52bf8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:36.477408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319d48a-2925-405a-a7c3-bec8f52bf8d9 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:36.477703 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319d48a-2925-405a-a7c3-bec8f52bf8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:36.477984 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1319d48a-2925-405a-a7c3-bec8f52bf8d9 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:36.478702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319d48a-2925-405a-a7c3-bec8f52bf8d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:36.480100 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1319d48a-2925-405a-a7c3-bec8f52bf8d9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:36.487215 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1c69b-534c-410d-a22a-1686fa1edf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:36.488230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1c69b-534c-410d-a22a-1686fa1edf39 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:36.488496 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1c69b-534c-410d-a22a-1686fa1edf39 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:36.488775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1c69b-534c-410d-a22a-1686fa1edf39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:36.497769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 376/752] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jun 14 19:29:36 2022] POST /identity/v3/services => generated 240 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:29:36.503757 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319d48a-2925-405a-a7c3-bec8f52bf8d9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:36.511624 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1c69b-534c-410d-a22a-1686fa1edf39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:36.512478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1c69b-534c-410d-a22a-1686fa1edf39 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:36.540604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-75f1c69b-534c-410d-a22a-1686fa1edf39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:36.540604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:36.540604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:36.540604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:36.540604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:36.540604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:36.540604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:36.540604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:36.540604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:36.540604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:36.540604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:36.540604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:36.540604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:36.540604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:36.540604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:36.541587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:36.541587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:36.541587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:36.541587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:36.541587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:36.541587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:36.541587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:36.541587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:36.541587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:36.541587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:36.541587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:36.541587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:36.541587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:36.541587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:36.541587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:36.541587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:36.541587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:36.542626 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:36.542626 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:36.542626 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:36.542626 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:36.547080 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 377/753] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:36.548237 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1c69b-534c-410d-a22a-1686fa1edf39 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:36.559891 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:36.668821 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1c69b-534c-410d-a22a-1686fa1edf39 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:36.675474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1319d48a-2925-405a-a7c3-bec8f52bf8d9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:36.712356 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf56ec1-2b8e-4ab8-94de-c2d408e6f5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:36.713035 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf56ec1-2b8e-4ab8-94de-c2d408e6f5cd None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:36.713326 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf56ec1-2b8e-4ab8-94de-c2d408e6f5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:36.713790 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf56ec1-2b8e-4ab8-94de-c2d408e6f5cd None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:36.714504 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf56ec1-2b8e-4ab8-94de-c2d408e6f5cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:36.714817 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf56ec1-2b8e-4ab8-94de-c2d408e6f5cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:36.716239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf56ec1-2b8e-4ab8-94de-c2d408e6f5cd None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:36.718446 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8975591-3cf3-4119-ac9e-2bbed08aead3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:36.722264 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8975591-3cf3-4119-ac9e-2bbed08aead3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:36.722264 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8975591-3cf3-4119-ac9e-2bbed08aead3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:36.722264 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8975591-3cf3-4119-ac9e-2bbed08aead3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:36.728673 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8975591-3cf3-4119-ac9e-2bbed08aead3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:36.730152 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8975591-3cf3-4119-ac9e-2bbed08aead3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:36.742226 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 378/754] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jun 14 19:29:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:36.743413 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf56ec1-2b8e-4ab8-94de-c2d408e6f5cd None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:36.747940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-a8975591-3cf3-4119-ac9e-2bbed08aead3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:36.747940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:36.747940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:36.747940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:36.747940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:36.747940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:36.747940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:36.747940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:36.747940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:36.747940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:36.747940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:36.747940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:36.747940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:36.747940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:36.747940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:36.748791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:36.748791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:36.748791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:36.748791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:36.748791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:36.748791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:36.748791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:36.748791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:36.748791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:36.748791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:36.748791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:36.748791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:36.748791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:36.748791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:36.748791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:36.748791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:36.748791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:36.749789 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:36.749789 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:36.749789 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:36.749789 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:36.749789 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:36.749789 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:36.749789 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:36.749789 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:36.749789 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 377/755] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:36.750267 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8975591-3cf3-4119-ac9e-2bbed08aead3 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:36.771736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:36.841992 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:36.874996 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8975591-3cf3-4119-ac9e-2bbed08aead3 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:36.895707 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf56ec1-2b8e-4ab8-94de-c2d408e6f5cd None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:36.922388 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbeab4-db4e-476d-9964-98e0286a9b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:36.924815 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbeab4-db4e-476d-9964-98e0286a9b9c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:36.925590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbeab4-db4e-476d-9964-98e0286a9b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:36.926087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbeab4-db4e-476d-9964-98e0286a9b9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:36.932384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923bdc7-9379-4a57-bda0-b327972df0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:36.933043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923bdc7-9379-4a57-bda0-b327972df0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:36.933328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923bdc7-9379-4a57-bda0-b327972df0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:36.933649 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8923bdc7-9379-4a57-bda0-b327972df0e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:36.934373 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923bdc7-9379-4a57-bda0-b327972df0e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:36.934680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923bdc7-9379-4a57-bda0-b327972df0e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:36.936040 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8923bdc7-9379-4a57-bda0-b327972df0e6 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:36.942423 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effbeab4-db4e-476d-9964-98e0286a9b9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:36.944112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effbeab4-db4e-476d-9964-98e0286a9b9c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:36.954373 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 379/756] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:36.954373 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923bdc7-9379-4a57-bda0-b327972df0e6 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:36.972948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-effbeab4-db4e-476d-9964-98e0286a9b9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:36.972948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:36.972948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:36.972948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:36.972948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:36.972948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:36.972948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:36.972948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:36.972948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:36.972948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:36.972948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:36.972948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:36.972948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:36.972948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:36.972948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:36.973994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:36.973994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:36.973994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:36.973994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:36.973994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:36.973994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:36.973994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:36.973994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:36.973994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:36.973994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:36.973994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:36.973994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:36.973994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:36.973994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:36.973994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:36.973994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:36.973994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:36.974862 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:36.974862 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:36.974862 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:36.974862 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:36.974862 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 378/757] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:36.975600 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbeab4-db4e-476d-9964-98e0286a9b9c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:37.062150 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:37.088733 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8923bdc7-9379-4a57-bda0-b327972df0e6 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:37.104483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbeab4-db4e-476d-9964-98e0286a9b9c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:37.121926 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:37.127211 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fd406-f62e-4e70-8f92-84b7011d5196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:37.128038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fd406-f62e-4e70-8f92-84b7011d5196 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:37.128873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fd406-f62e-4e70-8f92-84b7011d5196 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:37.128873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fd406-f62e-4e70-8f92-84b7011d5196 None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:37.129803 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fd406-f62e-4e70-8f92-84b7011d5196 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:37.130199 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fd406-f62e-4e70-8f92-84b7011d5196 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:37.132046 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fd406-f62e-4e70-8f92-84b7011d5196 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:37.149647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 380/758] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:37.150729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fd406-f62e-4e70-8f92-84b7011d5196 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:37.152288 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657641e-3905-4586-8d1f-ccdb9717f9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:37.153279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657641e-3905-4586-8d1f-ccdb9717f9dc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:37.153786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657641e-3905-4586-8d1f-ccdb9717f9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:37.154247 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657641e-3905-4586-8d1f-ccdb9717f9dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:37.169966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657641e-3905-4586-8d1f-ccdb9717f9dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:37.171671 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657641e-3905-4586-8d1f-ccdb9717f9dc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:37.187626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-4657641e-3905-4586-8d1f-ccdb9717f9dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:37.187626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:37.187626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:37.187626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:37.187626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:37.187626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:37.187626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:37.187626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:37.187626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:37.187626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:37.187626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:37.187626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:37.187626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:37.187626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:37.187626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:37.188602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:37.188602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:37.188602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:37.188602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:37.188602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:37.188602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:37.188602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:37.188602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:37.188602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:37.188602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:37.188602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:37.188602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:37.188602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:37.188602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:37.188602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:37.188602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:37.188602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:37.189973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:37.189973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:37.189973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:37.189973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:37.189973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:37.189973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:37.189973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:37.189973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:37.198163 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 379/759] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:37.199336 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657641e-3905-4586-8d1f-ccdb9717f9dc None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:37.258339 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fd406-f62e-4e70-8f92-84b7011d5196 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:37.296872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb579dbc-b3af-4024-be22-d4fbe8b28160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:37.297664 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb579dbc-b3af-4024-be22-d4fbe8b28160 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:37.298016 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb579dbc-b3af-4024-be22-d4fbe8b28160 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:37.298982 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb579dbc-b3af-4024-be22-d4fbe8b28160 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:37.299768 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb579dbc-b3af-4024-be22-d4fbe8b28160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:37.300144 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb579dbc-b3af-4024-be22-d4fbe8b28160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:37.301839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb579dbc-b3af-4024-be22-d4fbe8b28160 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:37.304736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657641e-3905-4586-8d1f-ccdb9717f9dc None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:37.314264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 381/760] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:37.315296 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb579dbc-b3af-4024-be22-d4fbe8b28160 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:37.332991 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:37.342548 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc954205-0655-4e82-b4bf-339cd12e85bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:37.343579 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc954205-0655-4e82-b4bf-339cd12e85bb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:37.344379 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc954205-0655-4e82-b4bf-339cd12e85bb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:37.345092 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc954205-0655-4e82-b4bf-339cd12e85bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:37.347067 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc954205-0655-4e82-b4bf-339cd12e85bb None admin] RBAC: Adding query filter params (role.id=539442ef092c4fcf9e1d0be045928c5a, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=d16be8774cb842199cfb9e3b9965bd7c) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:37.347866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc954205-0655-4e82-b4bf-339cd12e85bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:37.350002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc954205-0655-4e82-b4bf-339cd12e85bb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:37.357984 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 380/761] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:29:37 2022] GET /identity/v3/role_assignments?user.id=d16be8774cb842199cfb9e3b9965bd7c&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=539442ef092c4fcf9e1d0be045928c5a => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:37.359026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc954205-0655-4e82-b4bf-339cd12e85bb None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:37.389421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:37.457963 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb579dbc-b3af-4024-be22-d4fbe8b28160 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:37.502784 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33162107-54fa-4c34-90a7-58b7c5e6591b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:37.503909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33162107-54fa-4c34-90a7-58b7c5e6591b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:37.504335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33162107-54fa-4c34-90a7-58b7c5e6591b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:37.504754 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33162107-54fa-4c34-90a7-58b7c5e6591b None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:37.506412 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33162107-54fa-4c34-90a7-58b7c5e6591b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:37.506868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33162107-54fa-4c34-90a7-58b7c5e6591b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:37.508742 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33162107-54fa-4c34-90a7-58b7c5e6591b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:37.526713 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 382/762] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:37.534900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33162107-54fa-4c34-90a7-58b7c5e6591b None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:37.628169 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc954205-0655-4e82-b4bf-339cd12e85bb None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:37.666079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33162107-54fa-4c34-90a7-58b7c5e6591b None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:37.669808 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:37.696064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2071a64-f112-4e0a-aa47-6be90d9a8300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:37.697030 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2071a64-f112-4e0a-aa47-6be90d9a8300 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:37.697687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2071a64-f112-4e0a-aa47-6be90d9a8300 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:37.697687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2071a64-f112-4e0a-aa47-6be90d9a8300 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:37.710546 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108b6bf-9d23-4cea-a53b-773035c1b12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:37.711442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108b6bf-9d23-4cea-a53b-773035c1b12b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:37.711865 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108b6bf-9d23-4cea-a53b-773035c1b12b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:37.712315 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108b6bf-9d23-4cea-a53b-773035c1b12b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:37.713330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108b6bf-9d23-4cea-a53b-773035c1b12b None admin] RBAC: Adding query filter params (role.id=1e2bb0d759694428ada2b52285de933b, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=7fff5414195f4873bcc8752c914b6b49) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:37.713813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108b6bf-9d23-4cea-a53b-773035c1b12b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:37.715756 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108b6bf-9d23-4cea-a53b-773035c1b12b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:37.722216 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2071a64-f112-4e0a-aa47-6be90d9a8300 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:37.723846 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2071a64-f112-4e0a-aa47-6be90d9a8300 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:37.724225 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 383/763] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:29:37 2022] GET /identity/v3/role_assignments?user.id=7fff5414195f4873bcc8752c914b6b49&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=1e2bb0d759694428ada2b52285de933b => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:37.762439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-b2071a64-f112-4e0a-aa47-6be90d9a8300 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:37.762439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:37.762439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:37.762439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:37.762439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:37.762439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:37.762439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:37.762439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:37.762439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:37.762439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:37.762439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:37.762439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:37.762439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:37.762439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:37.762439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:37.763393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:37.763393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:37.763393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:37.763393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:37.763393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:37.763393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:37.763393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:37.763393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:37.763393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:37.763393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:37.763393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:37.763393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:37.763393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:37.763393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:37.763393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:37.763393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:37.763393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:37.764295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:37.764295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:37.764295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:37.764295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:37.764295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:37.764295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:37.764295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:37.764295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:37.764295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 381/764] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:37.770436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108b6bf-9d23-4cea-a53b-773035c1b12b None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:37.949718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108b6bf-9d23-4cea-a53b-773035c1b12b None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:37.987390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbec5a-8916-4f29-8e1b-5ac27b7c3e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:37.988057 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbec5a-8916-4f29-8e1b-5ac27b7c3e68 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:37.988342 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbec5a-8916-4f29-8e1b-5ac27b7c3e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:37.988624 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbec5a-8916-4f29-8e1b-5ac27b7c3e68 None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:37.989509 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbec5a-8916-4f29-8e1b-5ac27b7c3e68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:37.989824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbec5a-8916-4f29-8e1b-5ac27b7c3e68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:37.991255 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbec5a-8916-4f29-8e1b-5ac27b7c3e68 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:38.004021 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 384/765] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:38.009745 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2071a64-f112-4e0a-aa47-6be90d9a8300 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:38.087648 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:38.154553 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2071a64-f112-4e0a-aa47-6be90d9a8300 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:38.171138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a240e-1f1b-41e6-8338-daf27c61f906 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:38.171138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a240e-1f1b-41e6-8338-daf27c61f906 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:38.171138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a240e-1f1b-41e6-8338-daf27c61f906 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:38.171826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 385/766] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:38.178510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65665644-e2e2-4170-afed-10133387caa6 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:38.178805 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65665644-e2e2-4170-afed-10133387caa6 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:38.179088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65665644-e2e2-4170-afed-10133387caa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:38.201019 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307771a-4353-41c1-bc4c-1c3131fa8438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:38.203062 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307771a-4353-41c1-bc4c-1c3131fa8438 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:38.203554 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307771a-4353-41c1-bc4c-1c3131fa8438 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:38.204029 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307771a-4353-41c1-bc4c-1c3131fa8438 None admin] PATH_INFO: `/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/37c521e20aea4cad9758568a4f082fbd/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:38.207493 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307771a-4353-41c1-bc4c-1c3131fa8438 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d3e177b11504cb3b19d25ed5850ef12, user_id=37c521e20aea4cad9758568a4f082fbd, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:38.209676 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2307771a-4353-41c1-bc4c-1c3131fa8438 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:38.221960 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-65665644-e2e2-4170-afed-10133387caa6 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:38.223152 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-65665644-e2e2-4170-afed-10133387caa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:38.226048 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 382/767] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:29:38 2022] PUT /identity/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/37c521e20aea4cad9758568a4f082fbd/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:29:38.284878 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:38.384185 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 386/768] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 19:29:38.426559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307771a-4353-41c1-bc4c-1c3131fa8438 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:38.546255 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2307771a-4353-41c1-bc4c-1c3131fa8438 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:38.558852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:38.584445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d65d51-e359-4b31-a2f2-3c4ce4565abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:38.585250 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d65d51-e359-4b31-a2f2-3c4ce4565abc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:38.585563 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d65d51-e359-4b31-a2f2-3c4ce4565abc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:38.585839 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d65d51-e359-4b31-a2f2-3c4ce4565abc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:38.586490 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d65d51-e359-4b31-a2f2-3c4ce4565abc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:38.587846 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d65d51-e359-4b31-a2f2-3c4ce4565abc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:38.602462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-63d65d51-e359-4b31-a2f2-3c4ce4565abc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 19:29:38.602462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:38.602462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:29:38.602462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:29:38.602462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:29:38.602462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:29:38.602462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:29:38.602462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:38.602462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 19:29:38.602462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:38.602462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:29:38.602462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:38.602462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:38.602462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:38.602462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:38.602462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:38.603384 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:38.603384 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:38.603384 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:38.603384 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:38.603384 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:38.603384 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:38.603384 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:38.603384 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:29:38.603384 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:29:38.603384 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:29:38.603384 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:29:38.603384 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:38.603384 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:38.603384 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:38.603384 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:38.603384 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:38.604215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:38.604215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:38.604215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:38.604215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:38.604215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:38.604215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:38.604215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:38.604215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:38.604215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:38.604215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:38.604215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:38.604215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:29:38.604215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:38.604215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 19:29:38.604215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:38.604215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 383/769] 10.222.0.44 () {56 vars in 1129 bytes} [Tue Jun 14 19:29:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:38.611916 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65665644-e2e2-4170-afed-10133387caa6 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:38.756038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65665644-e2e2-4170-afed-10133387caa6 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:38.801229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490014f-b043-4891-8fcf-f1ea0a1c2417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:38.802283 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490014f-b043-4891-8fcf-f1ea0a1c2417 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:38.802778 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490014f-b043-4891-8fcf-f1ea0a1c2417 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:38.803304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490014f-b043-4891-8fcf-f1ea0a1c2417 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:38.804227 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490014f-b043-4891-8fcf-f1ea0a1c2417 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:38.804751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490014f-b043-4891-8fcf-f1ea0a1c2417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:38.806426 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490014f-b043-4891-8fcf-f1ea0a1c2417 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:38.811965 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 387/770] 10.222.0.44 () {56 vars in 1124 bytes} [Tue Jun 14 19:29:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:38.826554 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d65d51-e359-4b31-a2f2-3c4ce4565abc None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:38.917537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13ddda-1517-463a-b329-d4dbe4ee11e2 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:38.917865 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13ddda-1517-463a-b329-d4dbe4ee11e2 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:38.918116 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13ddda-1517-463a-b329-d4dbe4ee11e2 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:38.919606 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 388/771] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:29:38.925019 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b70554-02dc-49c7-805a-ddff936c3166 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:38.925643 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b70554-02dc-49c7-805a-ddff936c3166 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:38.926245 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b70554-02dc-49c7-805a-ddff936c3166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:38.947292 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d65d51-e359-4b31-a2f2-3c4ce4565abc None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:38.948534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-39b70554-02dc-49c7-805a-ddff936c3166 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:38.949975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-39b70554-02dc-49c7-805a-ddff936c3166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:38.985928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:38.989524 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be3ec8-f898-4ea5-bef7-fd10aaace1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:38.990476 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be3ec8-f898-4ea5-bef7-fd10aaace1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:38.990966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be3ec8-f898-4ea5-bef7-fd10aaace1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:38.991593 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8be3ec8-f898-4ea5-bef7-fd10aaace1a0 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:38.992619 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be3ec8-f898-4ea5-bef7-fd10aaace1a0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:38.993128 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be3ec8-f898-4ea5-bef7-fd10aaace1a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:38.994888 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8be3ec8-f898-4ea5-bef7-fd10aaace1a0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:39.000801 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 384/772] 10.222.0.44 () {56 vars in 1124 bytes} [Tue Jun 14 19:29:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:39.007670 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be3ec8-f898-4ea5-bef7-fd10aaace1a0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:39.063299 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 389/773] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 19:29:39.101426 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b70554-02dc-49c7-805a-ddff936c3166 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:39.111613 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:39.153772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8be3ec8-f898-4ea5-bef7-fd10aaace1a0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:39.192021 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b5c2e-3bc3-403f-ad1a-190d3eaeac24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:39.192689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b5c2e-3bc3-403f-ad1a-190d3eaeac24 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:39.192978 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b5c2e-3bc3-403f-ad1a-190d3eaeac24 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:39.193263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b5c2e-3bc3-403f-ad1a-190d3eaeac24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:39.194112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b5c2e-3bc3-403f-ad1a-190d3eaeac24 None admin] RBAC: Adding query filter params (interface=public, service_id=f38fa98bcead4064a3d2ab5168e94d53, region_id=RegionOne) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:39.194428 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b5c2e-3bc3-403f-ad1a-190d3eaeac24 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:39.196206 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b5c2e-3bc3-403f-ad1a-190d3eaeac24 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:39.205935 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 385/774] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jun 14 19:29:39 2022] GET /identity/v3/endpoints?service_id=f38fa98bcead4064a3d2ab5168e94d53&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:39.214047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b5c2e-3bc3-403f-ad1a-190d3eaeac24 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:39.297042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b70554-02dc-49c7-805a-ddff936c3166 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:39.334400 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033de76-a17a-4df8-be25-7b0c66a3d7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:39.335121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033de76-a17a-4df8-be25-7b0c66a3d7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:39.335405 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033de76-a17a-4df8-be25-7b0c66a3d7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:39.335681 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033de76-a17a-4df8-be25-7b0c66a3d7d5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:39.336332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033de76-a17a-4df8-be25-7b0c66a3d7d5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:39.337704 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033de76-a17a-4df8-be25-7b0c66a3d7d5 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:39.350739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-f033de76-a17a-4df8-be25-7b0c66a3d7d5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 19:29:39.350739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:39.350739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:29:39.350739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:29:39.350739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:29:39.350739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:29:39.350739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:29:39.350739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:39.350739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 19:29:39.350739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:39.350739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:29:39.350739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:39.350739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:39.350739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:39.350739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:39.350739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:39.350739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:39.351719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:39.351719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:39.351719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:39.351719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:39.351719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:39.351719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:39.351719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:29:39.351719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:29:39.351719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:29:39.351719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:29:39.351719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:39.351719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:39.351719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:39.351719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:39.351719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:39.351719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:39.353121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:39.353121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:39.353121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:39.353121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:39.353121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:39.353121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:39.353121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:39.353121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:39.353121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:39.353121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:39.353121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:29:39.353121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:39.353121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 19:29:39.353121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:39.353121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 390/775] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:39 2022] GET /identity/v3/services/network => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:39.358428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033de76-a17a-4df8-be25-7b0c66a3d7d5 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:39.383704 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:39.473108 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b5c2e-3bc3-403f-ad1a-190d3eaeac24 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:39.474322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033de76-a17a-4df8-be25-7b0c66a3d7d5 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:39.474645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:39.510810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdb4bb-2ec0-4206-97f7-24781da60a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:39.512349 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdb4bb-2ec0-4206-97f7-24781da60a9e None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:39.512860 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdb4bb-2ec0-4206-97f7-24781da60a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:39.513364 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdb4bb-2ec0-4206-97f7-24781da60a9e None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:39.514280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdb4bb-2ec0-4206-97f7-24781da60a9e None admin] RBAC: Adding query filter params (name=network) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:39.514781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdb4bb-2ec0-4206-97f7-24781da60a9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:39.516337 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cdb4bb-2ec0-4206-97f7-24781da60a9e None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:39.522684 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 391/776] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jun 14 19:29:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:39.529259 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdb4bb-2ec0-4206-97f7-24781da60a9e None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:39.551339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c68d3-4e30-4f8c-895e-38973784ee1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:39.552021 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c68d3-4e30-4f8c-895e-38973784ee1b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:39.552308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c68d3-4e30-4f8c-895e-38973784ee1b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:39.552588 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c68d3-4e30-4f8c-895e-38973784ee1b None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:39.553276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c68d3-4e30-4f8c-895e-38973784ee1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:39.555054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c68d3-4e30-4f8c-895e-38973784ee1b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:39.567160 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 386/777] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jun 14 19:29:39 2022] GET /identity/v3/services => generated 772 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:39.646265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:39.675811 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cdb4bb-2ec0-4206-97f7-24781da60a9e None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:39.725817 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccbb5d-4478-4ef5-a92c-31b309af9ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:39.726513 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccbb5d-4478-4ef5-a92c-31b309af9ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:39.726803 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccbb5d-4478-4ef5-a92c-31b309af9ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:39.727088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccbb5d-4478-4ef5-a92c-31b309af9ef9 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:39.727849 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccbb5d-4478-4ef5-a92c-31b309af9ef9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:39.728166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccbb5d-4478-4ef5-a92c-31b309af9ef9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:39.729670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfccbb5d-4478-4ef5-a92c-31b309af9ef9 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:39.738233 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 392/778] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jun 14 19:29:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:39.746627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c68d3-4e30-4f8c-895e-38973784ee1b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:39.886458 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c68d3-4e30-4f8c-895e-38973784ee1b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:39.923714 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9650cb2-14ac-4433-9713-f2718f34d1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:39.924470 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9650cb2-14ac-4433-9713-f2718f34d1cf None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:39.924754 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9650cb2-14ac-4433-9713-f2718f34d1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:39.925032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9650cb2-14ac-4433-9713-f2718f34d1cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:39.925918 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9650cb2-14ac-4433-9713-f2718f34d1cf None admin] RBAC: Adding query filter params (interface=public, service_id=a3541412c7b44d40afc02a5e09eb4e68, region_id=RegionOne) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:39.926295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9650cb2-14ac-4433-9713-f2718f34d1cf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:39.927729 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9650cb2-14ac-4433-9713-f2718f34d1cf None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:39.933547 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 387/779] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jun 14 19:29:39 2022] GET /identity/v3/endpoints?service_id=a3541412c7b44d40afc02a5e09eb4e68&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:39.946490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccbb5d-4478-4ef5-a92c-31b309af9ef9 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:40.086729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccbb5d-4478-4ef5-a92c-31b309af9ef9 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:40.143721 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1c0c4-505e-44ee-98c4-ec728dd901b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:40.144421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1c0c4-505e-44ee-98c4-ec728dd901b5 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:40.144710 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1c0c4-505e-44ee-98c4-ec728dd901b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:40.144990 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1c0c4-505e-44ee-98c4-ec728dd901b5 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:40.145721 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1c0c4-505e-44ee-98c4-ec728dd901b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:40.147128 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1c0c4-505e-44ee-98c4-ec728dd901b5 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:40.159507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 393/780] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jun 14 19:29:39 2022] GET /identity/v3/services => generated 772 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:40.246829 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ea871-037f-4b66-845b-f65ff49e957c None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:40.247116 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ea871-037f-4b66-845b-f65ff49e957c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:40.247395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2ea871-037f-4b66-845b-f65ff49e957c None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:40.249175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 388/781] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:40.255188 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffd80f-9494-436e-ac2e-28d3c5550f3a None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:40.255483 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffd80f-9494-436e-ac2e-28d3c5550f3a None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:40.255770 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffd80f-9494-436e-ac2e-28d3c5550f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:40.278586 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-f8ffd80f-9494-436e-ac2e-28d3c5550f3a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:40.279827 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-f8ffd80f-9494-436e-ac2e-28d3c5550f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:40.282287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:40.283124 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bea98-8ce6-48da-aa99-7633f2aa4ab8 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:40.283470 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bea98-8ce6-48da-aa99-7633f2aa4ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:40.283753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535bea98-8ce6-48da-aa99-7633f2aa4ab8 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:40.285705 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 389/782] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:40.291979 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dffb8f-d238-4281-9a65-1ec9b5f1c86a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:40.292272 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dffb8f-d238-4281-9a65-1ec9b5f1c86a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:40.292557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dffb8f-d238-4281-9a65-1ec9b5f1c86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:40.333946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c0dffb8f-d238-4281-9a65-1ec9b5f1c86a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:40.335172 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c0dffb8f-d238-4281-9a65-1ec9b5f1c86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:40.358798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 394/783] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:29:40.394206 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffd80f-9494-436e-ac2e-28d3c5550f3a None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:40.397062 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:40.459793 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 390/784] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:29:40.485457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dffb8f-d238-4281-9a65-1ec9b5f1c86a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:40.524911 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffd80f-9494-436e-ac2e-28d3c5550f3a None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:40.574189 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f708f-cc07-499b-a49d-108a8f02a3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:40.575007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f708f-cc07-499b-a49d-108a8f02a3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:40.575295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f708f-cc07-499b-a49d-108a8f02a3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:40.575574 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f708f-cc07-499b-a49d-108a8f02a3b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:40.602007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f708f-cc07-499b-a49d-108a8f02a3b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:40.613752 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:40.623275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-c59f708f-cc07-499b-a49d-108a8f02a3b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:40.623275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:40.623275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:40.623275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:40.623275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:40.623275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:40.623275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:40.623275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:40.623275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:40.623275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:40.623275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:40.623275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:40.623275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:40.623275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:40.623275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:40.623275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:40.624332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:40.624332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:40.624332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:40.624332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:40.624332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:40.624332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:40.624332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:40.624332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:40.624332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:40.624332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:40.624332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:40.624332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:40.624332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:40.624332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:40.624332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:40.624332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:40.625159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:40.625159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:40.625159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:40.625159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:40.625159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:40.625159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:40.625159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:40.625159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:40.625159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:40.625159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:40.625159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:40.625159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:40.630410 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 395/785] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:29:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:40.637589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dffb8f-d238-4281-9a65-1ec9b5f1c86a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:40.642416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f708f-cc07-499b-a49d-108a8f02a3b1 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:40.678276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de7298-df36-47f7-a2bc-a98fb24aaa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:40.679081 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de7298-df36-47f7-a2bc-a98fb24aaa27 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:40.679367 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de7298-df36-47f7-a2bc-a98fb24aaa27 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:40.679647 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de7298-df36-47f7-a2bc-a98fb24aaa27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:40.698684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de7298-df36-47f7-a2bc-a98fb24aaa27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:40.707625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-21de7298-df36-47f7-a2bc-a98fb24aaa27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:29:40.707625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:40.707625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:40.707625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:40.707625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:40.707625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:40.707625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:40.707625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:40.707625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:40.707625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:40.707625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:40.707625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:40.707625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:40.707625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:40.707625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:40.707625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:40.708618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:40.708618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:40.708618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:40.708618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:40.708618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:40.708618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:40.708618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:40.708618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:40.708618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:40.708618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:40.708618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:40.708618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:40.708618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:40.708618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:40.708618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:40.708618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:40.709494 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:40.709494 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:40.709494 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:40.709494 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:40.709494 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:40.709494 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:40.709494 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:40.709494 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:40.709494 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:40.709494 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:40.709494 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:29:40.709494 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:40.709494 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 391/786] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:29:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:40.717643 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de7298-df36-47f7-a2bc-a98fb24aaa27 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:40.756546 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:40.873041 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f708f-cc07-499b-a49d-108a8f02a3b1 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:40.910907 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de7298-df36-47f7-a2bc-a98fb24aaa27 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:40.945051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409a346-8c35-4a17-abc7-484da35b99c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:40.945750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409a346-8c35-4a17-abc7-484da35b99c2 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:40.946033 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409a346-8c35-4a17-abc7-484da35b99c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:40.946307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409a346-8c35-4a17-abc7-484da35b99c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:40.947061 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409a346-8c35-4a17-abc7-484da35b99c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:40.947595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409a346-8c35-4a17-abc7-484da35b99c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:40.948727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409a346-8c35-4a17-abc7-484da35b99c2 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:40.964337 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 396/787] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jun 14 19:29:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:40.971275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409a346-8c35-4a17-abc7-484da35b99c2 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:40.977035 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b563a-30de-4bb3-8c81-8ab89a99e7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:40.977761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b563a-30de-4bb3-8c81-8ab89a99e7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:40.978048 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b563a-30de-4bb3-8c81-8ab89a99e7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:40.978324 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b563a-30de-4bb3-8c81-8ab89a99e7d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:40.979100 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b563a-30de-4bb3-8c81-8ab89a99e7d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:40.979408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b563a-30de-4bb3-8c81-8ab89a99e7d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:40.980851 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b563a-30de-4bb3-8c81-8ab89a99e7d0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:41.002255 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 392/788] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:29:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:41.008006 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b563a-30de-4bb3-8c81-8ab89a99e7d0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:41.073889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:41.117097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:41.135875 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409a346-8c35-4a17-abc7-484da35b99c2 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:41.137709 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b563a-30de-4bb3-8c81-8ab89a99e7d0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:41.175159 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60815bc7-6e37-4205-bed5-a3a9f71bdbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:41.175958 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60815bc7-6e37-4205-bed5-a3a9f71bdbae None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:41.176243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60815bc7-6e37-4205-bed5-a3a9f71bdbae None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:41.176526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60815bc7-6e37-4205-bed5-a3a9f71bdbae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:41.189057 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed332619-045c-4477-83c2-529324941b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:41.190237 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed332619-045c-4477-83c2-529324941b52 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:41.190732 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed332619-045c-4477-83c2-529324941b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:41.191269 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed332619-045c-4477-83c2-529324941b52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:41.196088 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60815bc7-6e37-4205-bed5-a3a9f71bdbae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:41.197600 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60815bc7-6e37-4205-bed5-a3a9f71bdbae None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:41.203435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed332619-045c-4477-83c2-529324941b52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:41.205481 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed332619-045c-4477-83c2-529324941b52 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:41.216095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-60815bc7-6e37-4205-bed5-a3a9f71bdbae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:41.216095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:41.216095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:41.216095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:41.216095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:41.216095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:41.216095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:41.216095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:41.216095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:41.216095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:41.216095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:41.216095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:41.216095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:41.216095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:41.216095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:41.217002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:41.217002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:41.217002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:41.217002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:41.217002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:41.217002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:41.217002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:41.217002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:41.217002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:41.217002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:41.217002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:41.217002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:41.217002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:41.217002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:41.217002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:41.217002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:41.217002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:41.217929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:41.217929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:41.217929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:41.217929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:41.217929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 393/789] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:41.218929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7721c-3fae-4440-9d2a-23a227f4312d None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:41.219220 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7721c-3fae-4440-9d2a-23a227f4312d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:41.219504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7721c-3fae-4440-9d2a-23a227f4312d None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:41.225550 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 394/790] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:41.226312 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7721c-3fae-4440-9d2a-23a227f4312d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:41.228668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-ed332619-045c-4477-83c2-529324941b52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:41.228668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:41.228668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:41.228668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:41.228668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:41.228668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:41.228668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:41.228668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:41.228668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:41.228668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:41.228668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:41.228668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:41.228668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:41.228668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:41.228668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:41.229633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:41.229633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:41.229633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:41.229633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:41.229633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:41.229633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:41.229633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:41.229633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:41.229633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:41.229633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:41.229633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:41.229633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:41.229633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:41.229633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:41.229633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:41.229633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:41.229633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:41.230484 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:41.230484 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:41.230484 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:41.230484 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:41.232737 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 397/791] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:41.234285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4c9e0-01f1-4723-93be-afd49d3a2765 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:41.234831 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4c9e0-01f1-4723-93be-afd49d3a2765 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:41.235309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4c9e0-01f1-4723-93be-afd49d3a2765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:41.254193 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-f2c4c9e0-01f1-4723-93be-afd49d3a2765 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:41.256010 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-f2c4c9e0-01f1-4723-93be-afd49d3a2765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:41.338629 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 398/792] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:29:41.339462 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4c9e0-01f1-4723-93be-afd49d3a2765 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:41.384969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:41.443917 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4c9e0-01f1-4723-93be-afd49d3a2765 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:41.479856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351f359-b820-40a5-9c64-049ca9db47ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:41.480613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351f359-b820-40a5-9c64-049ca9db47ea None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:41.480971 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351f359-b820-40a5-9c64-049ca9db47ea None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:41.481321 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351f359-b820-40a5-9c64-049ca9db47ea None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:41.482147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351f359-b820-40a5-9c64-049ca9db47ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:41.482590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351f359-b820-40a5-9c64-049ca9db47ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:41.484067 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351f359-b820-40a5-9c64-049ca9db47ea None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:41.489790 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7721c-3fae-4440-9d2a-23a227f4312d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:41.496955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 399/793] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:41.497958 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351f359-b820-40a5-9c64-049ca9db47ea None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:41.535131 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13106d7c-bc12-43b0-8cde-9a2601fd0750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:41.536094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13106d7c-bc12-43b0-8cde-9a2601fd0750 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:41.536377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13106d7c-bc12-43b0-8cde-9a2601fd0750 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:41.537538 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13106d7c-bc12-43b0-8cde-9a2601fd0750 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:41.538313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13106d7c-bc12-43b0-8cde-9a2601fd0750 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:41.538624 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13106d7c-bc12-43b0-8cde-9a2601fd0750 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:41.540269 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13106d7c-bc12-43b0-8cde-9a2601fd0750 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:41.553612 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 395/794] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:41.553957 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:41.558053 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13106d7c-bc12-43b0-8cde-9a2601fd0750 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:41.624308 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351f359-b820-40a5-9c64-049ca9db47ea None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:41.626613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:41.662879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afdfc8-2223-4c99-99c0-3a91e787e04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:41.663853 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afdfc8-2223-4c99-99c0-3a91e787e04e None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:41.664239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afdfc8-2223-4c99-99c0-3a91e787e04e None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:41.664614 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80afdfc8-2223-4c99-99c0-3a91e787e04e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:41.676126 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80afdfc8-2223-4c99-99c0-3a91e787e04e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:41.683948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-80afdfc8-2223-4c99-99c0-3a91e787e04e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:29:41.683948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:41.683948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:41.683948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:41.683948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:41.683948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:41.683948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:41.683948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:41.683948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:41.683948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:41.683948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:41.683948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:41.683948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:41.683948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:41.683948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:41.683948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:41.685068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:41.685068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:41.685068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:41.685068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:41.685068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:41.685068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:41.685068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:41.685068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:41.685068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:41.685068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:41.685068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:41.685068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:41.685068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:41.685068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:41.685068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:41.685068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:41.686124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:41.686124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:41.686124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:41.686124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:41.686124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:41.686124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:41.686124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:41.686124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:41.686124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:41.686124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:41.686124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:29:41.686124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:41.692607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 400/795] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:29:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:41.692607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afdfc8-2223-4c99-99c0-3a91e787e04e None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:41.715189 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13106d7c-bc12-43b0-8cde-9a2601fd0750 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:41.763358 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b94ca-cf03-49e0-add4-16f309edc6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:41.765197 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b94ca-cf03-49e0-add4-16f309edc6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:41.765676 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b94ca-cf03-49e0-add4-16f309edc6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:41.766118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756b94ca-cf03-49e0-add4-16f309edc6d0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:41.776311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b94ca-cf03-49e0-add4-16f309edc6d0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:41.778876 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756b94ca-cf03-49e0-add4-16f309edc6d0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:41.800091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-756b94ca-cf03-49e0-add4-16f309edc6d0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 19:29:41.800091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:41.800091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:41.800091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:41.800091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:41.800091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:41.800091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:41.800091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:41.800091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:41.800091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:41.800091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:41.800091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:41.800091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:41.800091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:41.800091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:41.800091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:41.801254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:41.801254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:41.801254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:41.801254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:41.801254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:41.801254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:41.801254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:41.801254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:41.801254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:41.801254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:41.801254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:41.801254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:41.801254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:41.801254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:41.801254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:41.801254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:41.801254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:41.801254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:41.802445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:41.802445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:41.802445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:41.802445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:41.802445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:41.802445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:41.802445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:41.802445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:41.802445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 19:29:41.802445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:41.809000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80afdfc8-2223-4c99-99c0-3a91e787e04e None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:41.809203 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 396/796] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jun 14 19:29:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:41.811088 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b94ca-cf03-49e0-add4-16f309edc6d0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:41.847461 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489d39d-6cf0-415b-a5b9-d15f410fd726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:41.848422 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489d39d-6cf0-415b-a5b9-d15f410fd726 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:41.848810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489d39d-6cf0-415b-a5b9-d15f410fd726 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:41.849189 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489d39d-6cf0-415b-a5b9-d15f410fd726 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:41.857178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489d39d-6cf0-415b-a5b9-d15f410fd726 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:41.858847 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489d39d-6cf0-415b-a5b9-d15f410fd726 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:41.873069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-e489d39d-6cf0-415b-a5b9-d15f410fd726 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 14 19:29:41.873069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:41.873069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:41.873069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:41.873069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:41.873069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:41.873069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:41.873069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:41.873069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:41.873069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:41.873069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:41.873069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:41.873069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:41.873069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:41.873069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:41.873069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:41.874186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:41.874186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:41.874186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:41.874186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:41.874186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:41.874186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:41.874186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:41.874186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:41.874186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:41.874186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:41.874186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:41.874186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:41.874186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:41.874186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:41.874186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:41.874186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:41.874186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:41.874186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:41.875184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:41.875184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:41.875184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:41.875184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:41.875184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:41.875184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:41.875184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:41.875184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:41.875184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 14 19:29:41.875184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:41.875727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 401/797] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:29:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:41.877010 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489d39d-6cf0-415b-a5b9-d15f410fd726 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:41.887608 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:41.915200 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:41.952564 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756b94ca-cf03-49e0-add4-16f309edc6d0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:41.989540 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c55a4-0eb7-4594-8c56-c98447aecb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:41.990507 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c55a4-0eb7-4594-8c56-c98447aecb96 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:41.990976 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c55a4-0eb7-4594-8c56-c98447aecb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:41.991435 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c55a4-0eb7-4594-8c56-c98447aecb96 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:41.992387 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c55a4-0eb7-4594-8c56-c98447aecb96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:41.992884 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c55a4-0eb7-4594-8c56-c98447aecb96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:41.994470 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c55a4-0eb7-4594-8c56-c98447aecb96 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:42.004112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 397/798] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:29:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:42.005248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c55a4-0eb7-4594-8c56-c98447aecb96 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:42.015459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489d39d-6cf0-415b-a5b9-d15f410fd726 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:42.061071 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543836a-6b94-4f5a-b219-10297f2d8aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:42.061803 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543836a-6b94-4f5a-b219-10297f2d8aba None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:42.062077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543836a-6b94-4f5a-b219-10297f2d8aba None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:42.062356 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7543836a-6b94-4f5a-b219-10297f2d8aba None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:42.063508 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543836a-6b94-4f5a-b219-10297f2d8aba None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:42.064395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543836a-6b94-4f5a-b219-10297f2d8aba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:42.065859 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7543836a-6b94-4f5a-b219-10297f2d8aba None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:42.097455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 402/799] 10.222.0.44 () {56 vars in 1149 bytes} [Tue Jun 14 19:29:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:42.098702 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543836a-6b94-4f5a-b219-10297f2d8aba None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:42.127924 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c55a4-0eb7-4594-8c56-c98447aecb96 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:42.150911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:42.178282 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286e067-aadb-48f5-9124-7052ce0fcad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:42.178964 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286e067-aadb-48f5-9124-7052ce0fcad2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:42.179247 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286e067-aadb-48f5-9124-7052ce0fcad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:42.179515 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0286e067-aadb-48f5-9124-7052ce0fcad2 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:42.180657 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286e067-aadb-48f5-9124-7052ce0fcad2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:42.180965 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286e067-aadb-48f5-9124-7052ce0fcad2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:42.183076 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0286e067-aadb-48f5-9124-7052ce0fcad2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:42.198290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:42.209224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 398/800] 10.222.0.44 () {56 vars in 1135 bytes} [Tue Jun 14 19:29:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:42.210308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286e067-aadb-48f5-9124-7052ce0fcad2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:42.223677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7543836a-6b94-4f5a-b219-10297f2d8aba None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:42.260785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d26f63-7a22-4c17-8233-3f6d37548fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:42.261610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d26f63-7a22-4c17-8233-3f6d37548fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:42.261893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d26f63-7a22-4c17-8233-3f6d37548fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:42.262167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d26f63-7a22-4c17-8233-3f6d37548fe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:42.273105 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d26f63-7a22-4c17-8233-3f6d37548fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:42.274632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d26f63-7a22-4c17-8233-3f6d37548fe0 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:42.292897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-54d26f63-7a22-4c17-8233-3f6d37548fe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:42.292897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:42.292897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:42.292897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:42.292897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:42.292897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:42.292897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:42.292897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:42.292897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:42.292897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:42.292897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:42.292897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:42.292897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:42.292897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:42.292897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:42.293915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:42.293915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:42.293915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:42.293915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:42.293915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:42.293915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:42.293915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:42.293915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:42.293915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:42.293915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:42.293915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:42.293915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:42.293915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:42.293915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:42.293915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:42.293915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:42.293915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:42.294766 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:42.294766 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:42.294766 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:42.294766 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:42.295669 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 403/801] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:42.296459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d26f63-7a22-4c17-8233-3f6d37548fe0 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:42.323318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0286e067-aadb-48f5-9124-7052ce0fcad2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:42.357836 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f31c8-064d-44af-ab99-3a98aa8def21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:42.358595 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f31c8-064d-44af-ab99-3a98aa8def21 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:42.358882 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f31c8-064d-44af-ab99-3a98aa8def21 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:42.359184 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f31c8-064d-44af-ab99-3a98aa8def21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:42.369803 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f31c8-064d-44af-ab99-3a98aa8def21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:42.371254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f31c8-064d-44af-ab99-3a98aa8def21 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:42.389556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-790f31c8-064d-44af-ab99-3a98aa8def21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:42.389556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:42.389556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:42.389556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:42.389556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:42.389556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:42.389556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:42.389556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:42.389556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:42.389556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:42.389556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:42.389556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:42.389556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:42.389556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:42.389556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:42.390452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:42.390452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:42.390452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:42.390452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:42.390452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:42.390452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:42.390452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:42.390452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:42.390452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:42.390452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:42.390452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:42.390452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:42.390452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:42.390452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:42.390452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:42.390452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:42.390452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:42.391331 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:42.391331 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:42.391331 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:42.391331 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:42.391331 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 399/802] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:42.392435 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e45fae-90da-4e38-b66a-bdcc4eb7bcdc None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:42.392721 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e45fae-90da-4e38-b66a-bdcc4eb7bcdc None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:42.392999 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e45fae-90da-4e38-b66a-bdcc4eb7bcdc None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:42.394455 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 400/803] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:42.399120 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e45fae-90da-4e38-b66a-bdcc4eb7bcdc None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:42.411023 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d26f63-7a22-4c17-8233-3f6d37548fe0 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:42.428576 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:42.445189 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:42.451328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59ba20-b5a5-4ba0-8509-fd875fa903fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:42.452122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59ba20-b5a5-4ba0-8509-fd875fa903fc None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:42.452406 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59ba20-b5a5-4ba0-8509-fd875fa903fc None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:42.452682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59ba20-b5a5-4ba0-8509-fd875fa903fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:42.463703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59ba20-b5a5-4ba0-8509-fd875fa903fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:42.465145 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59ba20-b5a5-4ba0-8509-fd875fa903fc None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:42.486381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-df59ba20-b5a5-4ba0-8509-fd875fa903fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:42.486381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:42.486381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:42.486381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:42.486381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:42.486381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:42.486381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:42.486381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:42.486381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:42.486381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:42.486381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:42.486381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:42.486381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:42.486381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:42.486381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:42.487467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:42.487467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:42.487467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:42.487467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:42.487467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:42.487467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:42.487467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:42.487467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:42.487467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:42.487467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:42.487467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:42.487467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:42.487467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:42.487467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:42.487467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:42.487467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:42.487467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:42.488335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:42.488335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:42.488335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:42.488335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:42.488335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 404/804] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:42.488335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59ba20-b5a5-4ba0-8509-fd875fa903fc None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:42.511827 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e45fae-90da-4e38-b66a-bdcc4eb7bcdc None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:42.551675 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353faf0d-0179-4741-b473-606d0ac3619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:42.552355 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353faf0d-0179-4741-b473-606d0ac3619f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:42.552635 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353faf0d-0179-4741-b473-606d0ac3619f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:42.552911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353faf0d-0179-4741-b473-606d0ac3619f None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:42.553679 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353faf0d-0179-4741-b473-606d0ac3619f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:42.553988 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353faf0d-0179-4741-b473-606d0ac3619f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:42.555407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353faf0d-0179-4741-b473-606d0ac3619f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:42.572251 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 401/805] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:42.572251 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99a0e1-125f-469b-a1e5-e57f143cf542 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:42.572251 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99a0e1-125f-469b-a1e5-e57f143cf542 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:42.572251 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99a0e1-125f-469b-a1e5-e57f143cf542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:42.586021 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-2c99a0e1-125f-469b-a1e5-e57f143cf542 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:42.587215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2c99a0e1-125f-469b-a1e5-e57f143cf542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:42.606765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59ba20-b5a5-4ba0-8509-fd875fa903fc None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:42.640782 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee6cf0-a004-4305-a1de-e22230e387d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:42.641394 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee6cf0-a004-4305-a1de-e22230e387d0 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:42.641713 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee6cf0-a004-4305-a1de-e22230e387d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:42.642207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee6cf0-a004-4305-a1de-e22230e387d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:42.642936 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee6cf0-a004-4305-a1de-e22230e387d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:42.643249 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee6cf0-a004-4305-a1de-e22230e387d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:42.644607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee6cf0-a004-4305-a1de-e22230e387d0 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:42.652607 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 402/806] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:29:42.653542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99a0e1-125f-469b-a1e5-e57f143cf542 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:42.655802 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 405/807] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:42.656580 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee6cf0-a004-4305-a1de-e22230e387d0 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:42.685523 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:42.702744 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:42.756897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee6cf0-a004-4305-a1de-e22230e387d0 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:42.765055 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99a0e1-125f-469b-a1e5-e57f143cf542 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:42.793509 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42234acf-8dd2-46fe-9478-9b26e10cf2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:42.794295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42234acf-8dd2-46fe-9478-9b26e10cf2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:42.794579 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42234acf-8dd2-46fe-9478-9b26e10cf2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:42.794858 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42234acf-8dd2-46fe-9478-9b26e10cf2c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:42.800201 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec69b5-e580-4bc7-a116-c4d8b4c1e27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:42.800849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec69b5-e580-4bc7-a116-c4d8b4c1e27a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:42.801133 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec69b5-e580-4bc7-a116-c4d8b4c1e27a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:42.801431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec69b5-e580-4bc7-a116-c4d8b4c1e27a None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:42.802142 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec69b5-e580-4bc7-a116-c4d8b4c1e27a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:42.802443 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec69b5-e580-4bc7-a116-c4d8b4c1e27a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:42.803610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42234acf-8dd2-46fe-9478-9b26e10cf2c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:42.803792 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec69b5-e580-4bc7-a116-c4d8b4c1e27a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:42.805029 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42234acf-8dd2-46fe-9478-9b26e10cf2c2 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:42.816562 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 403/808] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:42.817975 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31daad-2254-4e1f-8b84-2f661b598447 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:42.819996 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31daad-2254-4e1f-8b84-2f661b598447 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:42.819996 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31daad-2254-4e1f-8b84-2f661b598447 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:42.820165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-42234acf-8dd2-46fe-9478-9b26e10cf2c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 19:29:42.820165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:42.820165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:42.820165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:42.820165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:42.820165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:42.820165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:42.820165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:42.820165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:42.820165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:42.820165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:42.820165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:42.820165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:42.820165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:42.820165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:42.820165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:42.821490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:42.821490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:42.821490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:42.821490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:42.821490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:42.821490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:42.821490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:42.821490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:42.821490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:42.821490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:42.821490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:42.821490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:42.821490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:42.821490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:42.821490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:42.821490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:42.821490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:42.821490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:42.822445 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:42.822445 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:42.822445 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:42.822445 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:42.822445 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:42.822445 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:42.822445 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:42.822445 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:42.822445 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 19:29:42.822445 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:42.823933 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 404/809] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:42.823933 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31daad-2254-4e1f-8b84-2f661b598447 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:42.824092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 406/810] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jun 14 19:29:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:42.824092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42234acf-8dd2-46fe-9478-9b26e10cf2c2 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:42.902655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:42.924969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42234acf-8dd2-46fe-9478-9b26e10cf2c2 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:42.926936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31daad-2254-4e1f-8b84-2f661b598447 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:42.928072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:42.960357 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741cb54-31cd-42d1-bda3-50c29e9bc80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:42.960870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835900d-4e12-4e4f-a30b-80c0a17c71be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:42.961148 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741cb54-31cd-42d1-bda3-50c29e9bc80d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:42.961459 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741cb54-31cd-42d1-bda3-50c29e9bc80d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:42.961657 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835900d-4e12-4e4f-a30b-80c0a17c71be None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:42.961749 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741cb54-31cd-42d1-bda3-50c29e9bc80d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:42.961942 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835900d-4e12-4e4f-a30b-80c0a17c71be None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:42.962221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835900d-4e12-4e4f-a30b-80c0a17c71be None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:42.962880 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835900d-4e12-4e4f-a30b-80c0a17c71be None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:42.964235 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835900d-4e12-4e4f-a30b-80c0a17c71be None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:42.968285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741cb54-31cd-42d1-bda3-50c29e9bc80d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:42.969737 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741cb54-31cd-42d1-bda3-50c29e9bc80d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:42.977006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-a835900d-4e12-4e4f-a30b-80c0a17c71be None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 19:29:42.977006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:42.977006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:29:42.977006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:29:42.977006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:29:42.977006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:29:42.977006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:29:42.977006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:42.977006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 19:29:42.977006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:42.977006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:29:42.977006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:42.977006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:42.977006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:42.977006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:42.977006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:42.978121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:42.978121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:42.978121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:42.978121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:42.978121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:42.978121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:42.978121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:42.978121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:29:42.978121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:29:42.978121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:29:42.978121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:29:42.978121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:42.978121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:42.978121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:42.978121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:42.978121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:42.979138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:42.979138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:42.979138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:42.979138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:42.979138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:42.979138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:42.979138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:42.979138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:42.979138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:42.979138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:42.979138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:42.979138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:29:42.979138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:42.979138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 14 19:29:42.979138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:42.979138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 407/811] 10.222.0.44 () {56 vars in 1129 bytes} [Tue Jun 14 19:29:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:42.979994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835900d-4e12-4e4f-a30b-80c0a17c71be None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:42.987225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-6741cb54-31cd-42d1-bda3-50c29e9bc80d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:42.987225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:42.987225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:42.987225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:42.987225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:42.987225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:42.987225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:42.987225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:42.987225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:42.987225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:42.987225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:42.987225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:42.987225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:42.987225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:42.987225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:42.988154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:42.988154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:42.988154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:42.988154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:42.988154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:42.988154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:42.988154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:42.988154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:42.988154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:42.988154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:42.988154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:42.988154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:42.988154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:42.988154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:42.988154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:42.988154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:42.988154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:42.989016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:42.989016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:42.989016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:42.989016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:42.989016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:42.989016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:42.989016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:42.989016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:42.989016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 405/812] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:42.990375 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fb396-820a-419f-8543-e11ae5480bbf None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:42.990667 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fb396-820a-419f-8543-e11ae5480bbf None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:42.990949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fb396-820a-419f-8543-e11ae5480bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:43.007601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e85fb396-820a-419f-8543-e11ae5480bbf None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:43.008784 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e85fb396-820a-419f-8543-e11ae5480bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:43.073932 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 406/813] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:29:43.074736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fb396-820a-419f-8543-e11ae5480bbf None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:43.076371 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835900d-4e12-4e4f-a30b-80c0a17c71be None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:43.114577 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6601d-330a-4650-a387-eef7153f116b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:43.115368 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6601d-330a-4650-a387-eef7153f116b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:43.115649 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6601d-330a-4650-a387-eef7153f116b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:43.115926 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6601d-330a-4650-a387-eef7153f116b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:43.122495 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6601d-330a-4650-a387-eef7153f116b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:43.123921 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6601d-330a-4650-a387-eef7153f116b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:43.137271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:43.137870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-55d6601d-330a-4650-a387-eef7153f116b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:43.137870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:43.137870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:43.137870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:43.137870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:43.137870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:43.137870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:43.137870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:43.137870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:43.137870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:43.137870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:43.137870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:43.137870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:43.137870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:43.137870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:43.138813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:43.138813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:43.138813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:43.138813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:43.138813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:43.138813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:43.138813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:43.138813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:43.138813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:43.138813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:43.138813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:43.138813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:43.138813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:43.138813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:43.138813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:43.138813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:43.138813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:43.139959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:43.139959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:43.139959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:43.139959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:43.139959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:43.139959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:43.139959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:43.139959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:43.139959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 408/814] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:43.140500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6601d-330a-4650-a387-eef7153f116b None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:43.171113 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:43.175056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fb396-820a-419f-8543-e11ae5480bbf None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:43.208564 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d59727-de8d-45ea-ab8d-3c992162f3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:43.209227 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d59727-de8d-45ea-ab8d-3c992162f3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:43.209550 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d59727-de8d-45ea-ab8d-3c992162f3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:43.209833 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d59727-de8d-45ea-ab8d-3c992162f3e0 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:43.210663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d59727-de8d-45ea-ab8d-3c992162f3e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:43.210969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d59727-de8d-45ea-ab8d-3c992162f3e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:43.212389 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d59727-de8d-45ea-ab8d-3c992162f3e0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:43.229148 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 407/815] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jun 14 19:29:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:43.229981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d59727-de8d-45ea-ab8d-3c992162f3e0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:43.242110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6601d-330a-4650-a387-eef7153f116b None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:43.276439 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dddca-5f3e-4426-b73d-3bbe17dd098f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:43.277097 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dddca-5f3e-4426-b73d-3bbe17dd098f None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:43.277402 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dddca-5f3e-4426-b73d-3bbe17dd098f None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:43.277688 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dddca-5f3e-4426-b73d-3bbe17dd098f None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:43.278395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dddca-5f3e-4426-b73d-3bbe17dd098f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:43.278698 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dddca-5f3e-4426-b73d-3bbe17dd098f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:43.280049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dddca-5f3e-4426-b73d-3bbe17dd098f None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:43.284557 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 409/816] 10.222.0.44 () {56 vars in 1124 bytes} [Tue Jun 14 19:29:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:43.285323 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dddca-5f3e-4426-b73d-3bbe17dd098f None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:43.333108 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d59727-de8d-45ea-ab8d-3c992162f3e0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:43.355387 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:43.366393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1731148-02ac-4ea2-b96c-4a4f923c3275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:43.367047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1731148-02ac-4ea2-b96c-4a4f923c3275 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:43.367331 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1731148-02ac-4ea2-b96c-4a4f923c3275 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:43.367603 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1731148-02ac-4ea2-b96c-4a4f923c3275 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:43.368377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1731148-02ac-4ea2-b96c-4a4f923c3275 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:43.368678 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1731148-02ac-4ea2-b96c-4a4f923c3275 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:43.370134 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1731148-02ac-4ea2-b96c-4a4f923c3275 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:43.374226 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:43.381979 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 408/817] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:43.382767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1731148-02ac-4ea2-b96c-4a4f923c3275 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:43.383844 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dddca-5f3e-4426-b73d-3bbe17dd098f None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:43.418126 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f321a-bde9-4863-a747-0c1eebe600cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:43.418921 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f321a-bde9-4863-a747-0c1eebe600cf None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:43.419204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f321a-bde9-4863-a747-0c1eebe600cf None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:43.419481 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f321a-bde9-4863-a747-0c1eebe600cf None admin] PATH_INFO: `/v3/services/network` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:43.420131 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f321a-bde9-4863-a747-0c1eebe600cf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:43.421565 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f321a-bde9-4863-a747-0c1eebe600cf None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:43.433300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-be0f321a-bde9-4863-a747-0c1eebe600cf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 19:29:43.433300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:43.433300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:29:43.433300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:29:43.433300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:29:43.433300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:29:43.433300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:29:43.433300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:43.433300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 19:29:43.433300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:43.433300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:29:43.433300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:43.433300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:43.433300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:43.433300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:43.433300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:43.433300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:43.434334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:43.434334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:43.434334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:43.434334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:43.434334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:43.434334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:43.434334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:29:43.434334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:29:43.434334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:29:43.434334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:29:43.434334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:43.434334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:43.434334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:43.434334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:43.434334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:43.434334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:43.435436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:43.435436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:43.435436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:43.435436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:43.435436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:43.435436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:43.435436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:43.435436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:43.435436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:43.435436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:43.435436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:29:43.435436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:43.435436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 14 19:29:43.435436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:43.435436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 410/818] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:43 2022] GET /identity/v3/services/network => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:43.436326 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f321a-bde9-4863-a747-0c1eebe600cf None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:43.487497 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1731148-02ac-4ea2-b96c-4a4f923c3275 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:43.521396 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4e5e4-33c9-460b-9797-7a8c4926a4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:43.522067 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4e5e4-33c9-460b-9797-7a8c4926a4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:43.522351 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4e5e4-33c9-460b-9797-7a8c4926a4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:43.522630 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4e5e4-33c9-460b-9797-7a8c4926a4d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:43.523405 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4e5e4-33c9-460b-9797-7a8c4926a4d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:43.523710 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4e5e4-33c9-460b-9797-7a8c4926a4d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:43.525137 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4e5e4-33c9-460b-9797-7a8c4926a4d7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:43.534557 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f321a-bde9-4863-a747-0c1eebe600cf None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:43.536974 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 409/819] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:43.537783 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4e5e4-33c9-460b-9797-7a8c4926a4d7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:43.573132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197788f3-b94e-4479-a836-6e6b3d9f614e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:43.573795 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197788f3-b94e-4479-a836-6e6b3d9f614e None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:43.574080 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197788f3-b94e-4479-a836-6e6b3d9f614e None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:43.574355 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197788f3-b94e-4479-a836-6e6b3d9f614e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:43.583881 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:43.600075 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:43.639070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4e5e4-33c9-460b-9797-7a8c4926a4d7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:43.643277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197788f3-b94e-4479-a836-6e6b3d9f614e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:43.644748 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197788f3-b94e-4479-a836-6e6b3d9f614e None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:43.672383 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4690c5-8fe8-4174-86cb-44766e5d6153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:43.673499 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4690c5-8fe8-4174-86cb-44766e5d6153 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:43.673996 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4690c5-8fe8-4174-86cb-44766e5d6153 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:43.674303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4690c5-8fe8-4174-86cb-44766e5d6153 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:43.674999 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4690c5-8fe8-4174-86cb-44766e5d6153 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:43.675301 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4690c5-8fe8-4174-86cb-44766e5d6153 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:43.676650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4690c5-8fe8-4174-86cb-44766e5d6153 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:43.681500 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 410/820] 10.222.0.44 () {56 vars in 1124 bytes} [Tue Jun 14 19:29:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:43.682050 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4690c5-8fe8-4174-86cb-44766e5d6153 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:43.745936 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 411/821] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:29:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 19:29:43.746774 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197788f3-b94e-4479-a836-6e6b3d9f614e None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:43.792183 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4690c5-8fe8-4174-86cb-44766e5d6153 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:43.800313 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:43.801614 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:43.831570 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c599f-3e8d-446c-b5bc-634bd33c56c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:43.832461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c599f-3e8d-446c-b5bc-634bd33c56c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:43.832803 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c599f-3e8d-446c-b5bc-634bd33c56c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:43.833079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c599f-3e8d-446c-b5bc-634bd33c56c7 None admin] PATH_INFO: `/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/d16be8774cb842199cfb9e3b9965bd7c/roles/539442ef092c4fcf9e1d0be045928c5a` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:43.847628 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c599f-3e8d-446c-b5bc-634bd33c56c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d3e177b11504cb3b19d25ed5850ef12, user_id=d16be8774cb842199cfb9e3b9965bd7c, role_id=539442ef092c4fcf9e1d0be045928c5a)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:43.849059 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c599f-3e8d-446c-b5bc-634bd33c56c7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:43.850440 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197788f3-b94e-4479-a836-6e6b3d9f614e None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:43.861802 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 411/822] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:29:43 2022] PUT /identity/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/d16be8774cb842199cfb9e3b9965bd7c/roles/539442ef092c4fcf9e1d0be045928c5a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:29:43.862565 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c599f-3e8d-446c-b5bc-634bd33c56c7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:43.906393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa508938-d0e2-47f1-9a14-a22974cb1bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:43.908362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa508938-d0e2-47f1-9a14-a22974cb1bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:43.908806 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa508938-d0e2-47f1-9a14-a22974cb1bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:43.909275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa508938-d0e2-47f1-9a14-a22974cb1bc0 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:43.910531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa508938-d0e2-47f1-9a14-a22974cb1bc0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:43.911281 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa508938-d0e2-47f1-9a14-a22974cb1bc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:43.913044 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa508938-d0e2-47f1-9a14-a22974cb1bc0 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:43.920869 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 412/823] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jun 14 19:29:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:43.922493 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa508938-d0e2-47f1-9a14-a22974cb1bc0 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:43.973988 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c599f-3e8d-446c-b5bc-634bd33c56c7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:44.013165 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f1647-9097-4258-bdb3-ec6432dc75b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:44.014113 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f1647-9097-4258-bdb3-ec6432dc75b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:44.014553 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f1647-9097-4258-bdb3-ec6432dc75b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:44.014715 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f1647-9097-4258-bdb3-ec6432dc75b9 None admin] PATH_INFO: `/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/7fff5414195f4873bcc8752c914b6b49/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:44.016715 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f1647-9097-4258-bdb3-ec6432dc75b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d3e177b11504cb3b19d25ed5850ef12, user_id=7fff5414195f4873bcc8752c914b6b49, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:44.018398 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372f1647-9097-4258-bdb3-ec6432dc75b9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:44.035117 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 412/824] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:29:43 2022] PUT /identity/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/7fff5414195f4873bcc8752c914b6b49/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:29:44.035967 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f1647-9097-4258-bdb3-ec6432dc75b9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:44.054089 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa508938-d0e2-47f1-9a14-a22974cb1bc0 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:44.068923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:44.087973 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:44.114335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e21cf8-761d-4cb6-9e01-4afa21c68060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:44.115020 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e21cf8-761d-4cb6-9e01-4afa21c68060 None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:44.116008 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e21cf8-761d-4cb6-9e01-4afa21c68060 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:44.116303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e21cf8-761d-4cb6-9e01-4afa21c68060 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:44.117404 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e21cf8-761d-4cb6-9e01-4afa21c68060 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:44.119159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e21cf8-761d-4cb6-9e01-4afa21c68060 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:44.149250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 413/825] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jun 14 19:29:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:29:44.150704 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e21cf8-761d-4cb6-9e01-4afa21c68060 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:44.183174 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372f1647-9097-4258-bdb3-ec6432dc75b9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:44.243203 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b0535-e049-47e7-a5df-ff62f87e8f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:44.244040 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b0535-e049-47e7-a5df-ff62f87e8f5e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:44.245166 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b0535-e049-47e7-a5df-ff62f87e8f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:44.245510 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b0535-e049-47e7-a5df-ff62f87e8f5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:44.263757 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b0535-e049-47e7-a5df-ff62f87e8f5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:44.265268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b0535-e049-47e7-a5df-ff62f87e8f5e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:44.287621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-ff9b0535-e049-47e7-a5df-ff62f87e8f5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:44.287621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:44.287621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:44.287621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:44.287621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:44.287621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:44.287621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:44.287621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:44.287621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:44.287621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:44.287621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:44.287621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:44.287621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:44.287621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:44.287621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:44.288580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:44.288580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:44.288580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:44.288580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:44.288580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:44.288580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:44.288580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:44.288580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:44.288580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:44.288580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:44.288580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:44.288580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:44.288580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:44.288580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:44.288580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:44.288580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:44.288580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:44.289594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:44.289594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:44.289594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:44.289594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:44.289594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 413/826] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:44.295422 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b0535-e049-47e7-a5df-ff62f87e8f5e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:44.302719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e21cf8-761d-4cb6-9e01-4afa21c68060 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:44.366309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe334fd-c874-4c56-932a-c0be5cb24f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:44.366954 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe334fd-c874-4c56-932a-c0be5cb24f3f None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:44.367242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe334fd-c874-4c56-932a-c0be5cb24f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:44.367519 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe334fd-c874-4c56-932a-c0be5cb24f3f None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:44.368232 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe334fd-c874-4c56-932a-c0be5cb24f3f None admin] RBAC: Adding query filter params (type=network) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:44.368537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe334fd-c874-4c56-932a-c0be5cb24f3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:44.369937 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe334fd-c874-4c56-932a-c0be5cb24f3f None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:44.375682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 414/827] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jun 14 19:29:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:44.382328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe334fd-c874-4c56-932a-c0be5cb24f3f None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:44.397838 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:44.436728 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:44.439390 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b0535-e049-47e7-a5df-ff62f87e8f5e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:44.493771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e3487-fb5b-4b65-91ae-5f8a5878d926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:44.494434 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e3487-fb5b-4b65-91ae-5f8a5878d926 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:44.495130 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e3487-fb5b-4b65-91ae-5f8a5878d926 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:44.495410 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e3487-fb5b-4b65-91ae-5f8a5878d926 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:44.496416 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e3487-fb5b-4b65-91ae-5f8a5878d926 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:44.496725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e3487-fb5b-4b65-91ae-5f8a5878d926 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:44.498478 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88e3487-fb5b-4b65-91ae-5f8a5878d926 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:44.516230 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 414/828] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:44.521757 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e3487-fb5b-4b65-91ae-5f8a5878d926 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:44.522819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe334fd-c874-4c56-932a-c0be5cb24f3f None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:44.573700 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e038a-cee2-4bdc-8ba2-0d7a3b7562ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:44.575738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e038a-cee2-4bdc-8ba2-0d7a3b7562ac None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:44.576194 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e038a-cee2-4bdc-8ba2-0d7a3b7562ac None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:44.576627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e038a-cee2-4bdc-8ba2-0d7a3b7562ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:44.577687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e038a-cee2-4bdc-8ba2-0d7a3b7562ac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:44.579780 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e038a-cee2-4bdc-8ba2-0d7a3b7562ac None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:44.606476 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 415/829] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jun 14 19:29:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:29:44.681344 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e3487-fb5b-4b65-91ae-5f8a5878d926 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:44.710957 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:44.728416 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1c5b5-4184-4e80-acec-dffe2247da03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:44.729224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1c5b5-4184-4e80-acec-dffe2247da03 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:44.729538 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1c5b5-4184-4e80-acec-dffe2247da03 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:44.729813 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1c5b5-4184-4e80-acec-dffe2247da03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:44.737887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1c5b5-4184-4e80-acec-dffe2247da03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:44.739361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1c5b5-4184-4e80-acec-dffe2247da03 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:44.760866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-2db1c5b5-4184-4e80-acec-dffe2247da03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:44.760866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:44.760866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:44.760866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:44.760866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:44.760866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:44.760866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:44.760866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:44.760866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:44.760866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:44.760866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:44.760866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:44.760866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:44.760866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:44.760866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:44.762046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:44.762046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:44.762046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:44.762046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:44.762046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:44.762046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:44.762046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:44.762046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:44.762046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:44.762046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:44.762046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:44.762046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:44.762046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:44.762046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:44.762046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:44.762046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:44.762046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:44.763199 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:44.763199 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:44.763199 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:44.763199 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:44.763199 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:44.763199 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:44.763199 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:44.763199 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:44.763199 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 415/830] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:44.768609 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e038a-cee2-4bdc-8ba2-0d7a3b7562ac None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:44.921206 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:44.935104 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e038a-cee2-4bdc-8ba2-0d7a3b7562ac None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:44.972269 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74238e8-2550-4324-8cc5-9971b23fef8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:44.972942 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74238e8-2550-4324-8cc5-9971b23fef8b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:44.973230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74238e8-2550-4324-8cc5-9971b23fef8b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:44.973560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74238e8-2550-4324-8cc5-9971b23fef8b None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:44.974365 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74238e8-2550-4324-8cc5-9971b23fef8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:44.974677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74238e8-2550-4324-8cc5-9971b23fef8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:44.976127 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74238e8-2550-4324-8cc5-9971b23fef8b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:44.990099 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 416/831] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:44.997731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1c5b5-4184-4e80-acec-dffe2247da03 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:45.114056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1c5b5-4184-4e80-acec-dffe2247da03 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:45.155101 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471a311-e0c2-4113-aff5-67959dd6c165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:45.156149 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471a311-e0c2-4113-aff5-67959dd6c165 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:45.156629 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471a311-e0c2-4113-aff5-67959dd6c165 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:45.157100 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471a311-e0c2-4113-aff5-67959dd6c165 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:45.158691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471a311-e0c2-4113-aff5-67959dd6c165 None admin] RBAC: Adding query filter params (role.id=1e2bb0d759694428ada2b52285de933b, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=37c521e20aea4cad9758568a4f082fbd) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:45.159222 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471a311-e0c2-4113-aff5-67959dd6c165 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:45.160858 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a471a311-e0c2-4113-aff5-67959dd6c165 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:45.168089 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 416/832] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:29:44 2022] GET /identity/v3/role_assignments?user.id=37c521e20aea4cad9758568a4f082fbd&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=1e2bb0d759694428ada2b52285de933b => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:46.208443 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a454db-a2cd-4b2b-a12f-3518455a450c None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:46.209462 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a454db-a2cd-4b2b-a12f-3518455a450c None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:46.209996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a454db-a2cd-4b2b-a12f-3518455a450c None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:46.211795 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 417/833] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:46.217172 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d352b-5165-4e5a-aaed-82ec9f6143a4 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:46.218007 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d352b-5165-4e5a-aaed-82ec9f6143a4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:46.218483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d352b-5165-4e5a-aaed-82ec9f6143a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:46.236034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-009d352b-5165-4e5a-aaed-82ec9f6143a4 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:46.237565 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-009d352b-5165-4e5a-aaed-82ec9f6143a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:46.283294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:46.316066 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 417/834] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:29:46.340628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a454db-a2cd-4b2b-a12f-3518455a450c None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:46.455416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a454db-a2cd-4b2b-a12f-3518455a450c None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:46.493411 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab285c5-bc6b-4c89-a4ed-8e6f0ede1e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:46.493618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8ce31-eb9d-49d1-8f42-17f97b19123f None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:46.493841 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8ce31-eb9d-49d1-8f42-17f97b19123f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:46.494102 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b8ce31-eb9d-49d1-8f42-17f97b19123f None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:46.495029 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab285c5-bc6b-4c89-a4ed-8e6f0ede1e77 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:46.495539 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab285c5-bc6b-4c89-a4ed-8e6f0ede1e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:46.495723 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 418/835] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:29:46.496186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab285c5-bc6b-4c89-a4ed-8e6f0ede1e77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:46.500636 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db704d7-e915-4d1f-80c9-3ecf2dc5c1ad None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:46.501510 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db704d7-e915-4d1f-80c9-3ecf2dc5c1ad None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:46.501804 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db704d7-e915-4d1f-80c9-3ecf2dc5c1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:46.511565 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab285c5-bc6b-4c89-a4ed-8e6f0ede1e77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:46.519441 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-7db704d7-e915-4d1f-80c9-3ecf2dc5c1ad None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:46.520621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7db704d7-e915-4d1f-80c9-3ecf2dc5c1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:46.521984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-1ab285c5-bc6b-4c89-a4ed-8e6f0ede1e77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:46.521984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:46.521984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:46.521984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:46.521984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:46.521984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:46.521984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:46.521984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:46.521984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:46.521984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:46.521984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:46.521984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:46.521984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:46.521984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:46.521984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:46.521984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:46.522898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:46.522898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:46.522898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:46.522898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:46.522898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:46.522898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:46.522898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:46.522898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:46.522898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:46.522898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:46.522898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:46.522898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:46.522898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:46.522898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:46.522898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:46.522898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:46.523775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:46.523775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:46.523775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:46.523775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:46.523775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:46.523775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:46.523775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:46.523775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:46.523775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:46.523775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:46.523775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:29:46.523775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:46.527266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 418/836] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:29:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:46.533519 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab285c5-bc6b-4c89-a4ed-8e6f0ede1e77 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:46.561197 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:46.605520 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 419/837] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 19:29:46.626875 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db704d7-e915-4d1f-80c9-3ecf2dc5c1ad None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:46.669987 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab285c5-bc6b-4c89-a4ed-8e6f0ede1e77 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:46.707040 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9ccdaa-f894-4e89-ab24-a3a7b6d187e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:46.707980 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ccdaa-f894-4e89-ab24-a3a7b6d187e7 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:46.708266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ccdaa-f894-4e89-ab24-a3a7b6d187e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:46.708545 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9ccdaa-f894-4e89-ab24-a3a7b6d187e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:46.709296 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ccdaa-f894-4e89-ab24-a3a7b6d187e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:46.709637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ccdaa-f894-4e89-ab24-a3a7b6d187e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:46.711697 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9ccdaa-f894-4e89-ab24-a3a7b6d187e7 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:46.727752 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 419/838] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jun 14 19:29:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:46.727752 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568df282-ee2d-40cb-aec2-515869f1dbd5 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:46.727752 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568df282-ee2d-40cb-aec2-515869f1dbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:46.727752 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568df282-ee2d-40cb-aec2-515869f1dbd5 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:46.729417 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 420/839] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:46.729525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568df282-ee2d-40cb-aec2-515869f1dbd5 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:46.746091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db704d7-e915-4d1f-80c9-3ecf2dc5c1ad None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:46.754080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:46.784170 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203594a-8a96-4e64-8727-4adf0aaf4ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:46.784965 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203594a-8a96-4e64-8727-4adf0aaf4ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:46.785250 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203594a-8a96-4e64-8727-4adf0aaf4ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:46.785548 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203594a-8a96-4e64-8727-4adf0aaf4ef3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:46.797071 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203594a-8a96-4e64-8727-4adf0aaf4ef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:46.805009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-b203594a-8a96-4e64-8727-4adf0aaf4ef3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:29:46.805009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:46.805009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:46.805009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:46.805009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:46.805009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:46.805009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:46.805009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:46.805009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:46.805009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:46.805009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:46.805009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:46.805009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:46.805009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:46.805009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:46.805009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:46.806096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:46.806096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:46.806096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:46.806096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:46.806096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:46.806096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:46.806096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:46.806096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:46.806096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:46.806096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:46.806096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:46.806096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:46.806096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:46.806096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:46.806096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:46.806096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:46.806923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:46.806923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:46.806923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:46.806923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:46.806923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:46.806923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:46.806923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:46.806923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:46.806923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:46.806923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:46.806923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:29:46.806923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:46.806923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 420/840] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:29:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:46.807600 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac4216-e856-421f-ba80-8e5ecbaca6ac None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:46.807669 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac4216-e856-421f-ba80-8e5ecbaca6ac None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:46.808637 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac4216-e856-421f-ba80-8e5ecbaca6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:46.825032 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:46.832039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-edac4216-e856-421f-ba80-8e5ecbaca6ac None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:46.833227 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-edac4216-e856-421f-ba80-8e5ecbaca6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:46.854947 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568df282-ee2d-40cb-aec2-515869f1dbd5 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:46.889417 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12ef43-f6c8-4511-b7bd-8838f5f17f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:46.890189 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12ef43-f6c8-4511-b7bd-8838f5f17f43 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:46.890481 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12ef43-f6c8-4511-b7bd-8838f5f17f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:46.890758 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12ef43-f6c8-4511-b7bd-8838f5f17f43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:46.902689 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12ef43-f6c8-4511-b7bd-8838f5f17f43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:46.904127 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12ef43-f6c8-4511-b7bd-8838f5f17f43 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:46.913740 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 421/841] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:29:46.915258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac4216-e856-421f-ba80-8e5ecbaca6ac None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:46.923465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-2b12ef43-f6c8-4511-b7bd-8838f5f17f43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:46.923465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:46.923465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:46.923465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:46.923465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:46.923465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:46.923465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:46.923465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:46.923465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:46.923465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:46.923465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:46.923465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:46.923465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:46.923465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:46.923465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:46.924529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:46.924529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:46.924529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:46.924529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:46.924529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:46.924529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:46.924529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:46.924529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:46.924529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:46.924529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:46.924529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:46.924529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:46.924529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:46.924529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:46.924529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:46.924529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:46.924529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:46.925641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:46.925641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:46.925641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:46.925641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:46.927474 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 421/842] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:46.934633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12ef43-f6c8-4511-b7bd-8838f5f17f43 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:47.021615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:47.029214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac4216-e856-421f-ba80-8e5ecbaca6ac None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:47.041597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12ef43-f6c8-4511-b7bd-8838f5f17f43 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:47.070690 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:47.073369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4092b19-a0e7-469c-8e35-8ef160ecea63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:47.074077 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4092b19-a0e7-469c-8e35-8ef160ecea63 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:47.074363 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4092b19-a0e7-469c-8e35-8ef160ecea63 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:47.074659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4092b19-a0e7-469c-8e35-8ef160ecea63 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:47.075398 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4092b19-a0e7-469c-8e35-8ef160ecea63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:47.075699 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4092b19-a0e7-469c-8e35-8ef160ecea63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:47.077065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4092b19-a0e7-469c-8e35-8ef160ecea63 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:47.078887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07504e0-ca3c-422f-8abe-eb8fbff1b08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:47.080418 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07504e0-ca3c-422f-8abe-eb8fbff1b08a None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:47.080768 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07504e0-ca3c-422f-8abe-eb8fbff1b08a None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:47.081115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07504e0-ca3c-422f-8abe-eb8fbff1b08a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:47.081884 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07504e0-ca3c-422f-8abe-eb8fbff1b08a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:47.083433 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07504e0-ca3c-422f-8abe-eb8fbff1b08a None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:47.086585 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 422/843] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:29:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:47.087264 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4092b19-a0e7-469c-8e35-8ef160ecea63 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:47.101049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-c07504e0-ca3c-422f-8abe-eb8fbff1b08a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 19:29:47.101049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:47.101049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:29:47.101049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:29:47.101049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:29:47.101049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:29:47.101049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:29:47.101049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:47.101049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 19:29:47.101049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:47.101049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:29:47.101049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:47.101049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:47.101049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:47.101049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:47.101049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:47.101049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:47.102311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:47.102311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:47.102311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:47.102311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:47.102311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:47.102311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:47.102311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:29:47.102311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:29:47.102311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:29:47.102311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:29:47.102311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:47.102311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:47.102311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:47.102311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:47.102311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:47.102311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:47.103228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:47.103228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:47.103228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:47.103228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:47.103228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:47.103228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:47.103228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:47.103228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:47.103228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:47.103228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:47.103228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:29:47.103228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:47.103228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 19:29:47.103228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:47.103228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 422/844] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:29:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:47.104022 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07504e0-ca3c-422f-8abe-eb8fbff1b08a None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:47.200399 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4092b19-a0e7-469c-8e35-8ef160ecea63 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:47.214935 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07504e0-ca3c-422f-8abe-eb8fbff1b08a None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:47.238336 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8919a70-38e4-4b4f-8221-08599a8b953e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:47.238997 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8919a70-38e4-4b4f-8221-08599a8b953e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:47.239281 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8919a70-38e4-4b4f-8221-08599a8b953e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:47.239559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8919a70-38e4-4b4f-8221-08599a8b953e None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:47.240271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8919a70-38e4-4b4f-8221-08599a8b953e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:47.240573 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8919a70-38e4-4b4f-8221-08599a8b953e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:47.241971 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8919a70-38e4-4b4f-8221-08599a8b953e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:47.254338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746957fe-7be3-44d4-9fcf-03d5dc53cae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:47.259048 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 423/845] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:47.259180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746957fe-7be3-44d4-9fcf-03d5dc53cae0 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:47.259180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746957fe-7be3-44d4-9fcf-03d5dc53cae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:47.259376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8919a70-38e4-4b4f-8221-08599a8b953e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:47.259462 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746957fe-7be3-44d4-9fcf-03d5dc53cae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:47.271848 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746957fe-7be3-44d4-9fcf-03d5dc53cae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:47.273307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746957fe-7be3-44d4-9fcf-03d5dc53cae0 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:47.281761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:47.293907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-746957fe-7be3-44d4-9fcf-03d5dc53cae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:47.293907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:47.293907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:47.293907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:47.293907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:47.293907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:47.293907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:47.293907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:47.293907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:47.293907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:47.293907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:47.293907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:47.293907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:47.293907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:47.293907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:47.294856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:47.294856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:47.294856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:47.294856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:47.294856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:47.294856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:47.294856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:47.294856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:47.294856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:47.294856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:47.294856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:47.294856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:47.294856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:47.294856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:47.294856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:47.294856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:47.294856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:47.295715 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:47.295715 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:47.295715 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:47.295715 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:47.300828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 423/846] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:47.301863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746957fe-7be3-44d4-9fcf-03d5dc53cae0 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:47.351605 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:47.377164 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8919a70-38e4-4b4f-8221-08599a8b953e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:47.405275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746957fe-7be3-44d4-9fcf-03d5dc53cae0 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:47.411722 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0ea77-e01b-4bb1-be5f-339f9c6c9084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:47.412790 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0ea77-e01b-4bb1-be5f-339f9c6c9084 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:47.413080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0ea77-e01b-4bb1-be5f-339f9c6c9084 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:47.413364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0ea77-e01b-4bb1-be5f-339f9c6c9084 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:47.414452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0ea77-e01b-4bb1-be5f-339f9c6c9084 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:47.415037 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0ea77-e01b-4bb1-be5f-339f9c6c9084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:47.416719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f0ea77-e01b-4bb1-be5f-339f9c6c9084 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:47.421100 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 424/847] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:29:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:47.421911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0ea77-e01b-4bb1-be5f-339f9c6c9084 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:47.445453 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbacfdb4-6a81-4d9e-aaf5-ee9a1759dc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:47.446262 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacfdb4-6a81-4d9e-aaf5-ee9a1759dc30 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:47.446546 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacfdb4-6a81-4d9e-aaf5-ee9a1759dc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:47.446821 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbacfdb4-6a81-4d9e-aaf5-ee9a1759dc30 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:47.454352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacfdb4-6a81-4d9e-aaf5-ee9a1759dc30 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:47.455908 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbacfdb4-6a81-4d9e-aaf5-ee9a1759dc30 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:47.470670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-cbacfdb4-6a81-4d9e-aaf5-ee9a1759dc30 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 19:29:47.470670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:47.470670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:47.470670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:47.470670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:47.470670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:47.470670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:47.470670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:47.470670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:47.470670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:47.470670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:47.470670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:47.470670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:47.470670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:47.470670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:47.470670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:47.471593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:47.471593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:47.471593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:47.471593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:47.471593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:47.471593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:47.471593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:47.471593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:47.471593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:47.471593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:47.471593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:47.471593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:47.471593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:47.471593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:47.471593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:47.471593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:47.471593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:47.471593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:47.472826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:47.472826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:47.472826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:47.472826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:47.472826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:47.472826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:47.472826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:47.472826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:47.472826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 19:29:47.472826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:47.472826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 424/848] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jun 14 19:29:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:47.473629 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada12a37-4595-480a-a432-4ef2fc38a55d None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:47.473629 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada12a37-4595-480a-a432-4ef2fc38a55d None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:47.473629 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada12a37-4595-480a-a432-4ef2fc38a55d None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:47.477838 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 425/849] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:47.477838 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada12a37-4595-480a-a432-4ef2fc38a55d None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:47.508407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:47.526781 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0ea77-e01b-4bb1-be5f-339f9c6c9084 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:47.560404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a2a96-b790-455d-bf17-21413fdf0897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:47.561058 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a2a96-b790-455d-bf17-21413fdf0897 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:47.561345 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a2a96-b790-455d-bf17-21413fdf0897 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:47.561655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a2a96-b790-455d-bf17-21413fdf0897 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:47.562373 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a2a96-b790-455d-bf17-21413fdf0897 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:47.562678 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a2a96-b790-455d-bf17-21413fdf0897 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:47.564081 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a2a96-b790-455d-bf17-21413fdf0897 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:47.575586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 425/850] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:47.576364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a2a96-b790-455d-bf17-21413fdf0897 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:47.583948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada12a37-4595-480a-a432-4ef2fc38a55d None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:47.591348 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:47.620582 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3190f3-1249-43ea-9828-73a43d04dee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:47.621243 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3190f3-1249-43ea-9828-73a43d04dee7 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:47.621561 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3190f3-1249-43ea-9828-73a43d04dee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:47.621843 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3190f3-1249-43ea-9828-73a43d04dee7 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:47.622552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3190f3-1249-43ea-9828-73a43d04dee7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:47.622863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3190f3-1249-43ea-9828-73a43d04dee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:47.624232 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3190f3-1249-43ea-9828-73a43d04dee7 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:47.628971 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 426/851] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:29:47 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:47.630169 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386bba1-28f9-43e6-bb0b-5146ac017068 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:47.630458 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386bba1-28f9-43e6-bb0b-5146ac017068 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:47.630736 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386bba1-28f9-43e6-bb0b-5146ac017068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:47.660146 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-1386bba1-28f9-43e6-bb0b-5146ac017068 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:47.661417 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-1386bba1-28f9-43e6-bb0b-5146ac017068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:47.679709 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a2a96-b790-455d-bf17-21413fdf0897 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:47.721721 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3590851-8332-4e81-a2f9-effdf93a00bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:47.722402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3590851-8332-4e81-a2f9-effdf93a00bd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:47.722690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3590851-8332-4e81-a2f9-effdf93a00bd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:47.722966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3590851-8332-4e81-a2f9-effdf93a00bd None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:47.723827 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3590851-8332-4e81-a2f9-effdf93a00bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:47.724136 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3590851-8332-4e81-a2f9-effdf93a00bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:47.725631 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3590851-8332-4e81-a2f9-effdf93a00bd None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:47.749475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 427/852] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:29:47.749475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386bba1-28f9-43e6-bb0b-5146ac017068 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:47.749876 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:47.757488 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 426/853] 10.222.0.44 () {56 vars in 1149 bytes} [Tue Jun 14 19:29:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:47.763017 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3590851-8332-4e81-a2f9-effdf93a00bd None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:47.865516 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:47.868877 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386bba1-28f9-43e6-bb0b-5146ac017068 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:47.886213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3590851-8332-4e81-a2f9-effdf93a00bd None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:47.909632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89c2d9-7f8c-41dc-88b0-03b62ed0be63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:47.910435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89c2d9-7f8c-41dc-88b0-03b62ed0be63 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:47.910718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89c2d9-7f8c-41dc-88b0-03b62ed0be63 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:47.911219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89c2d9-7f8c-41dc-88b0-03b62ed0be63 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:47.919005 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89c2d9-7f8c-41dc-88b0-03b62ed0be63 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:47.920436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf89c2d9-7f8c-41dc-88b0-03b62ed0be63 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:47.922182 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f1c3c-e18f-4552-8831-7e5f89a3e0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:47.922857 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f1c3c-e18f-4552-8831-7e5f89a3e0db None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:47.923155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f1c3c-e18f-4552-8831-7e5f89a3e0db None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:47.923437 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f1c3c-e18f-4552-8831-7e5f89a3e0db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:47.935830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-bf89c2d9-7f8c-41dc-88b0-03b62ed0be63 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 14 19:29:47.935830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:47.935830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:47.935830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:47.935830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:47.935830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:47.935830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:47.935830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:47.935830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:47.935830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:47.935830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:47.935830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:47.935830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:47.935830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:47.935830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:47.935830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:47.936993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:47.936993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:47.936993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:47.936993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:47.936993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:47.936993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:47.936993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:47.936993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:47.936993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:47.936993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:47.936993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:47.936993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:47.936993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:47.936993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:47.936993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:47.936993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:47.936993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:47.936993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:47.937962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:47.937962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:47.937962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:47.937962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:47.937962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:47.937962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:47.937962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:47.937962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:47.937962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 14 19:29:47.937962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:47.937962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 428/854] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:29:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:47.937962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89c2d9-7f8c-41dc-88b0-03b62ed0be63 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:47.996799 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:47.999745 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f1c3c-e18f-4552-8831-7e5f89a3e0db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:48.002224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f1c3c-e18f-4552-8831-7e5f89a3e0db None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:48.054213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89c2d9-7f8c-41dc-88b0-03b62ed0be63 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:48.114794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 427/855] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:29:47 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 14 19:29:48.115991 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f1c3c-e18f-4552-8831-7e5f89a3e0db None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:48.215352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c7e2b-2866-4b44-870f-5a699373f1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:48.216162 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c7e2b-2866-4b44-870f-5a699373f1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:48.216544 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c7e2b-2866-4b44-870f-5a699373f1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:48.216830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5c7e2b-2866-4b44-870f-5a699373f1e2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:48.217519 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c7e2b-2866-4b44-870f-5a699373f1e2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:48.218883 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5c7e2b-2866-4b44-870f-5a699373f1e2 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:48.223034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:48.227267 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f1c3c-e18f-4552-8831-7e5f89a3e0db None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:48.232799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-3d5c7e2b-2866-4b44-870f-5a699373f1e2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 19:29:48.232799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:48.232799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:29:48.232799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:29:48.232799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:29:48.232799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:29:48.232799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:29:48.232799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:48.232799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 19:29:48.232799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:48.232799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:29:48.232799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:48.232799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:48.232799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:48.232799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:48.232799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:48.233775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:48.233775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:48.233775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:48.233775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:48.233775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:48.233775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:48.233775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:48.233775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:29:48.233775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:29:48.233775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:29:48.233775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:29:48.233775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:48.233775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:48.233775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:48.233775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:48.233775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:48.234839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:48.234839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:48.234839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:48.234839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:48.234839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:48.234839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:48.234839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:48.234839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:48.234839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:48.234839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:48.234839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:48.234839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:29:48.234839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:48.234839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 19:29:48.234839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:48.234839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 429/856] 10.222.0.44 () {56 vars in 1132 bytes} [Tue Jun 14 19:29:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:48.236237 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c7e2b-2866-4b44-870f-5a699373f1e2 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:48.263639 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:48.266923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936eff4-bf04-412a-a3f3-a16720adf61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:48.267747 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936eff4-bf04-412a-a3f3-a16720adf61c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:48.268035 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936eff4-bf04-412a-a3f3-a16720adf61c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:48.268316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936eff4-bf04-412a-a3f3-a16720adf61c None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:48.269162 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936eff4-bf04-412a-a3f3-a16720adf61c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:48.269505 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936eff4-bf04-412a-a3f3-a16720adf61c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:48.270947 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936eff4-bf04-412a-a3f3-a16720adf61c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:48.295479 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 428/857] 10.222.0.44 () {56 vars in 1135 bytes} [Tue Jun 14 19:29:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:48.296374 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936eff4-bf04-412a-a3f3-a16720adf61c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:48.345833 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5c7e2b-2866-4b44-870f-5a699373f1e2 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:48.383900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c51d21-4514-4079-86ab-db90177b4b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:48.384619 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c51d21-4514-4079-86ab-db90177b4b09 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:48.384901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c51d21-4514-4079-86ab-db90177b4b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:48.385175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c51d21-4514-4079-86ab-db90177b4b09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:48.395912 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c51d21-4514-4079-86ab-db90177b4b09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:48.397361 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c51d21-4514-4079-86ab-db90177b4b09 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:48.401614 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936eff4-bf04-412a-a3f3-a16720adf61c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:48.415531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-46c51d21-4514-4079-86ab-db90177b4b09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:48.415531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:48.415531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:48.415531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:48.415531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:48.415531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:48.415531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:48.415531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:48.415531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:48.415531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:48.415531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:48.415531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:48.415531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:48.415531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:48.415531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:48.416637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:48.416637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:48.416637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:48.416637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:48.416637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:48.416637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:48.416637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:48.416637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:48.416637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:48.416637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:48.416637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:48.416637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:48.416637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:48.416637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:48.416637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:48.416637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:48.416637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:48.417558 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:48.417558 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:48.417558 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:48.417558 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:48.417558 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 430/858] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:48.417558 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c51d21-4514-4079-86ab-db90177b4b09 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:48.445969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc1eec-1735-47e6-88a6-a1c3d31bfa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:48.446738 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc1eec-1735-47e6-88a6-a1c3d31bfa56 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:48.447028 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc1eec-1735-47e6-88a6-a1c3d31bfa56 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:48.447443 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc1eec-1735-47e6-88a6-a1c3d31bfa56 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:48.448476 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc1eec-1735-47e6-88a6-a1c3d31bfa56 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:48.449040 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc1eec-1735-47e6-88a6-a1c3d31bfa56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:48.450641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc1eec-1735-47e6-88a6-a1c3d31bfa56 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:48.461623 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 429/859] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jun 14 19:29:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:48.461623 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc1eec-1735-47e6-88a6-a1c3d31bfa56 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:48.488858 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:48.504269 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:48.528942 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c51d21-4514-4079-86ab-db90177b4b09 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:48.564533 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3bb0b-b411-424f-85b2-6d6f69b5616b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:48.565175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3bb0b-b411-424f-85b2-6d6f69b5616b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:48.565489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3bb0b-b411-424f-85b2-6d6f69b5616b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:48.565763 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d3bb0b-b411-424f-85b2-6d6f69b5616b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:48.572219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc1eec-1735-47e6-88a6-a1c3d31bfa56 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:48.611912 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15257bf3-7dc2-4135-b6f0-955a809f5376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:48.612557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15257bf3-7dc2-4135-b6f0-955a809f5376 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:48.612840 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15257bf3-7dc2-4135-b6f0-955a809f5376 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:48.613110 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15257bf3-7dc2-4135-b6f0-955a809f5376 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:48.613845 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15257bf3-7dc2-4135-b6f0-955a809f5376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:48.614278 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15257bf3-7dc2-4135-b6f0-955a809f5376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:48.615811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15257bf3-7dc2-4135-b6f0-955a809f5376 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:48.628440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 430/860] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:48.629167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15257bf3-7dc2-4135-b6f0-955a809f5376 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:48.638798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3bb0b-b411-424f-85b2-6d6f69b5616b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:48.640932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d3bb0b-b411-424f-85b2-6d6f69b5616b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:48.714087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:48.733335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:48.735521 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15257bf3-7dc2-4135-b6f0-955a809f5376 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:48.761457 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 431/861] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:29:48 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 19:29:48.762605 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3bb0b-b411-424f-85b2-6d6f69b5616b None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:48.777043 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be491bc-1ae0-4ea8-823a-43b4fd936dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:48.777734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be491bc-1ae0-4ea8-823a-43b4fd936dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:48.778016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be491bc-1ae0-4ea8-823a-43b4fd936dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:48.778290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be491bc-1ae0-4ea8-823a-43b4fd936dc1 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:48.778986 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be491bc-1ae0-4ea8-823a-43b4fd936dc1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:48.779289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be491bc-1ae0-4ea8-823a-43b4fd936dc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:48.780644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be491bc-1ae0-4ea8-823a-43b4fd936dc1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:48.785416 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 431/862] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jun 14 19:29:48 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:48.786057 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be491bc-1ae0-4ea8-823a-43b4fd936dc1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:48.910966 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d3bb0b-b411-424f-85b2-6d6f69b5616b None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:48.929641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be491bc-1ae0-4ea8-823a-43b4fd936dc1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:48.951262 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33d94a-5c37-4ae9-aec5-c3521ceac50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:48.952162 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33d94a-5c37-4ae9-aec5-c3521ceac50d None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:48.952544 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33d94a-5c37-4ae9-aec5-c3521ceac50d None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:48.952828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33d94a-5c37-4ae9-aec5-c3521ceac50d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:48.962995 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33d94a-5c37-4ae9-aec5-c3521ceac50d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:48.964618 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33d94a-5c37-4ae9-aec5-c3521ceac50d None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:48.973007 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a9cd6-cc86-4991-b3d3-a625f77f4ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:48.974011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a9cd6-cc86-4991-b3d3-a625f77f4ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:48.974454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a9cd6-cc86-4991-b3d3-a625f77f4ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:48.974877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a9cd6-cc86-4991-b3d3-a625f77f4ac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:48.979553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-7a33d94a-5c37-4ae9-aec5-c3521ceac50d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:48.979553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:48.979553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:48.979553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:48.979553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:48.979553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:48.979553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:48.979553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:48.979553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:48.979553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:48.979553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:48.979553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:48.979553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:48.979553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:48.979553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:48.980421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:48.980421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:48.980421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:48.980421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:48.980421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:48.980421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:48.980421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:48.980421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:48.980421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:48.980421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:48.980421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:48.980421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:48.980421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:48.980421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:48.980421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:48.980421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:48.980421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:48.981342 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:48.981342 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:48.981342 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:48.981342 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:48.981342 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:48.981342 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:48.981342 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:48.981342 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:48.981342 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 432/863] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:48.988488 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33d94a-5c37-4ae9-aec5-c3521ceac50d None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:48.993008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a9cd6-cc86-4991-b3d3-a625f77f4ac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:48.994646 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a9cd6-cc86-4991-b3d3-a625f77f4ac4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:49.002638 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:49.022193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-336a9cd6-cc86-4991-b3d3-a625f77f4ac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:49.022193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:49.022193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:49.022193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:49.022193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:49.022193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:49.022193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:49.022193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:49.022193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:49.022193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:49.022193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:49.022193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:49.022193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:49.022193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:49.022193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:49.023268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:49.023268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:49.023268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:49.023268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:49.023268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:49.023268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:49.023268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:49.023268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:49.023268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:49.023268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:49.023268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:49.023268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:49.023268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:49.023268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:49.023268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:49.023268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:49.023268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:49.024306 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:49.024306 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:49.024306 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:49.024306 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:49.024729 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 432/864] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:49.028736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a9cd6-cc86-4991-b3d3-a625f77f4ac4 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:49.031564 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:49.115351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33d94a-5c37-4ae9-aec5-c3521ceac50d None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:49.160135 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a9cd6-cc86-4991-b3d3-a625f77f4ac4 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:49.169340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbe2f8-6c08-47a4-994f-fb3c2fd80cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:49.170537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbe2f8-6c08-47a4-994f-fb3c2fd80cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:49.170933 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbe2f8-6c08-47a4-994f-fb3c2fd80cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:49.171318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbe2f8-6c08-47a4-994f-fb3c2fd80cf1 None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:49.173262 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbe2f8-6c08-47a4-994f-fb3c2fd80cf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:49.173676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbe2f8-6c08-47a4-994f-fb3c2fd80cf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:49.175719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbe2f8-6c08-47a4-994f-fb3c2fd80cf1 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:49.194385 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 433/865] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:49.199573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbe2f8-6c08-47a4-994f-fb3c2fd80cf1 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:49.204688 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9e1aa-f6b8-4014-8222-8f0569264a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:49.205171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9e1aa-f6b8-4014-8222-8f0569264a8e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:49.205491 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9e1aa-f6b8-4014-8222-8f0569264a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:49.205772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9e1aa-f6b8-4014-8222-8f0569264a8e None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:49.206498 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9e1aa-f6b8-4014-8222-8f0569264a8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:49.206804 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9e1aa-f6b8-4014-8222-8f0569264a8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:49.208188 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b9e1aa-f6b8-4014-8222-8f0569264a8e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:49.226158 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 433/866] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:49.231259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9e1aa-f6b8-4014-8222-8f0569264a8e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:49.301840 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:49.320414 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:49.328616 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbe2f8-6c08-47a4-994f-fb3c2fd80cf1 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:49.346753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9e1aa-f6b8-4014-8222-8f0569264a8e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:49.369009 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d0ee6-6a36-41c6-96c8-a6582f4106d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:49.370063 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d0ee6-6a36-41c6-96c8-a6582f4106d9 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:49.370542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d0ee6-6a36-41c6-96c8-a6582f4106d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:49.371005 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d0ee6-6a36-41c6-96c8-a6582f4106d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:49.372023 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d0ee6-6a36-41c6-96c8-a6582f4106d9 None admin] RBAC: Adding query filter params (role.id=539442ef092c4fcf9e1d0be045928c5a, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=d16be8774cb842199cfb9e3b9965bd7c) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:49.372551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d0ee6-6a36-41c6-96c8-a6582f4106d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:49.374279 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d0ee6-6a36-41c6-96c8-a6582f4106d9 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:49.381996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 434/867] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:29:49 2022] GET /identity/v3/role_assignments?user.id=d16be8774cb842199cfb9e3b9965bd7c&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=539442ef092c4fcf9e1d0be045928c5a => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:49.394321 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8475a1-3f80-4980-bde6-8865284ccdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:49.395559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8475a1-3f80-4980-bde6-8865284ccdc1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:49.396065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8475a1-3f80-4980-bde6-8865284ccdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:49.396538 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8475a1-3f80-4980-bde6-8865284ccdc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:49.405173 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8475a1-3f80-4980-bde6-8865284ccdc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:49.407132 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8475a1-3f80-4980-bde6-8865284ccdc1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:49.425342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-bb8475a1-3f80-4980-bde6-8865284ccdc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:49.425342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:49.425342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:49.425342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:49.425342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:49.425342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:49.425342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:49.425342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:49.425342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:49.425342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:49.425342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:49.425342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:49.425342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:49.425342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:49.425342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:49.426311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:49.426311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:49.426311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:49.426311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:49.426311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:49.426311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:49.426311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:49.426311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:49.426311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:49.426311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:49.426311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:49.426311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:49.426311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:49.426311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:49.426311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:49.426311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:49.426311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:49.427163 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:49.427163 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:49.427163 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:49.427163 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:49.427163 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:49.427163 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:49.427163 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:49.427163 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:49.429958 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 434/868] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:49.435834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d0ee6-6a36-41c6-96c8-a6582f4106d9 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:49.552821 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d0ee6-6a36-41c6-96c8-a6582f4106d9 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:49.589330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4d197-1525-4ce9-8c5a-43c46c19c75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:49.590017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4d197-1525-4ce9-8c5a-43c46c19c75a None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:49.590298 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4d197-1525-4ce9-8c5a-43c46c19c75a None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:49.590571 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4d197-1525-4ce9-8c5a-43c46c19c75a None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:49.591355 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4d197-1525-4ce9-8c5a-43c46c19c75a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:49.591660 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4d197-1525-4ce9-8c5a-43c46c19c75a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:49.593078 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4d197-1525-4ce9-8c5a-43c46c19c75a None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:49.606603 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 435/869] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:49.612241 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8475a1-3f80-4980-bde6-8865284ccdc1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:49.723582 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8475a1-3f80-4980-bde6-8865284ccdc1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:49.743342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:49.762415 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4dc942-1106-4c08-9107-60f66376575b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:49.763091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dc942-1106-4c08-9107-60f66376575b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:49.763378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dc942-1106-4c08-9107-60f66376575b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:49.763659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4dc942-1106-4c08-9107-60f66376575b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:49.764516 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dc942-1106-4c08-9107-60f66376575b None admin] RBAC: Adding query filter params (role.id=1e2bb0d759694428ada2b52285de933b, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=7fff5414195f4873bcc8752c914b6b49) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:49.764832 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dc942-1106-4c08-9107-60f66376575b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:49.767299 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4dc942-1106-4c08-9107-60f66376575b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:49.775053 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 435/870] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:29:49 2022] GET /identity/v3/role_assignments?user.id=7fff5414195f4873bcc8752c914b6b49&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=1e2bb0d759694428ada2b52285de933b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:49.844562 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4832c-1b6f-4427-a99f-86d08a3b5226 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:49.846318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4832c-1b6f-4427-a99f-86d08a3b5226 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:49.846821 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4832c-1b6f-4427-a99f-86d08a3b5226 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:49.848719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 436/871] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:49.854722 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98854a46-a083-416a-9652-6552fd239585 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:49.855013 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98854a46-a083-416a-9652-6552fd239585 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:49.855302 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98854a46-a083-416a-9652-6552fd239585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:49.873731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-98854a46-a083-416a-9652-6552fd239585 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:49.875020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-98854a46-a083-416a-9652-6552fd239585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:49.958724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 436/872] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:29:49.984424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4832c-1b6f-4427-a99f-86d08a3b5226 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:50.008488 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:50.095917 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4832c-1b6f-4427-a99f-86d08a3b5226 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:50.131043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddc21e-70fb-43bc-90d9-bd934c103b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:50.131706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddc21e-70fb-43bc-90d9-bd934c103b9a None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:50.131992 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddc21e-70fb-43bc-90d9-bd934c103b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:50.132274 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddc21e-70fb-43bc-90d9-bd934c103b9a None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:50.133007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddc21e-70fb-43bc-90d9-bd934c103b9a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:50.134396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddc21e-70fb-43bc-90d9-bd934c103b9a None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:50.149492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 437/873] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jun 14 19:29:49 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:29:50.993458 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b7f06-7f26-497f-a4bd-84100f02cab6 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:50.994080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b7f06-7f26-497f-a4bd-84100f02cab6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:50.994080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b7f06-7f26-497f-a4bd-84100f02cab6 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:50.995637 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 437/874] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:51.001562 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d900c-3a1b-4275-ab8d-092ebffb53f3 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:51.001985 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d900c-3a1b-4275-ab8d-092ebffb53f3 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:51.002164 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d900c-3a1b-4275-ab8d-092ebffb53f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:51.019099 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-c76d900c-3a1b-4275-ab8d-092ebffb53f3 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:51.020274 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c76d900c-3a1b-4275-ab8d-092ebffb53f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:51.100835 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 438/875] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:50 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:29:51.123129 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b7f06-7f26-497f-a4bd-84100f02cab6 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:51.230434 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b7f06-7f26-497f-a4bd-84100f02cab6 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:51.244779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:51.269563 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a84088-730d-494c-b567-8558b1093883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:51.270239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a84088-730d-494c-b567-8558b1093883 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:51.270527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a84088-730d-494c-b567-8558b1093883 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:51.270811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a84088-730d-494c-b567-8558b1093883 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:51.271548 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a84088-730d-494c-b567-8558b1093883 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:51.273109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a84088-730d-494c-b567-8558b1093883 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:51.290972 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 438/876] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jun 14 19:29:51 2022] POST /identity/v3/services => generated 269 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:29:51.728604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15f342-bcb2-48ea-b2e5-bf8909542f7b None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:51.729009 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15f342-bcb2-48ea-b2e5-bf8909542f7b None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:51.729194 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15f342-bcb2-48ea-b2e5-bf8909542f7b None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:51.730840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 439/877] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:51.736616 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9ddfd-61e5-4788-abc0-cfd73173a5d4 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:51.737162 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9ddfd-61e5-4788-abc0-cfd73173a5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:51.737681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9ddfd-61e5-4788-abc0-cfd73173a5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:51.754997 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-61e9ddfd-61e5-4788-abc0-cfd73173a5d4 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:51.756495 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-61e9ddfd-61e5-4788-abc0-cfd73173a5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:51.843013 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 439/878] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:29:51.866901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15f342-bcb2-48ea-b2e5-bf8909542f7b None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:51.877011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:51.979391 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15f342-bcb2-48ea-b2e5-bf8909542f7b None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:52.030155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc634138-896d-487a-bb4a-e2e9ef9df356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:52.030982 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc634138-896d-487a-bb4a-e2e9ef9df356 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:52.031271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc634138-896d-487a-bb4a-e2e9ef9df356 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:52.031551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc634138-896d-487a-bb4a-e2e9ef9df356 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:52.043867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc634138-896d-487a-bb4a-e2e9ef9df356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:52.052792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-cc634138-896d-487a-bb4a-e2e9ef9df356 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 19:29:52.052792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:52.052792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:52.052792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:52.052792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:52.052792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:52.052792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:52.052792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:52.052792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:52.052792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:52.052792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:52.052792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:52.052792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:52.052792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:52.052792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:52.052792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:52.053834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:52.053834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:52.053834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:52.053834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:52.053834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:52.053834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:52.053834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:52.053834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:52.053834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:52.053834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:52.053834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:52.053834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:52.053834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:52.053834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:52.053834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:52.053834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:52.054746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:52.054746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:52.054746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:52.054746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:52.054746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:52.054746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:52.054746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:52.054746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:52.054746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:52.054746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:52.054746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 19:29:52.054746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:52.054746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 440/879] 10.222.0.44 () {56 vars in 1120 bytes} [Tue Jun 14 19:29:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:52.062134 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9ddfd-61e5-4788-abc0-cfd73173a5d4 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:52.088950 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ada0a-d7ec-403e-9932-6be836021f8c None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:52.089281 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ada0a-d7ec-403e-9932-6be836021f8c None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:52.089542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ada0a-d7ec-403e-9932-6be836021f8c None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:52.091152 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 441/880] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:29:52.096316 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8639e-befe-42f8-987d-e5b57b597830 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:52.096601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8639e-befe-42f8-987d-e5b57b597830 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:52.096879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8639e-befe-42f8-987d-e5b57b597830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:52.114473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-c8c8639e-befe-42f8-987d-e5b57b597830 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:52.115755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c8c8639e-befe-42f8-987d-e5b57b597830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:52.171582 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:52.179243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9ddfd-61e5-4788-abc0-cfd73173a5d4 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:52.194435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:52.205534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 442/881] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 19:29:52.224799 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb79b4c-c606-4577-9089-6d92f80693e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:52.225806 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb79b4c-c606-4577-9089-6d92f80693e6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:52.226313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb79b4c-c606-4577-9089-6d92f80693e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:52.226831 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb79b4c-c606-4577-9089-6d92f80693e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:52.227791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb79b4c-c606-4577-9089-6d92f80693e6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:52.228311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb79b4c-c606-4577-9089-6d92f80693e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:52.229734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8639e-befe-42f8-987d-e5b57b597830 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:52.230798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb79b4c-c606-4577-9089-6d92f80693e6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:52.240748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 440/882] 10.222.0.44 () {56 vars in 1115 bytes} [Tue Jun 14 19:29:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:52.246744 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb79b4c-c606-4577-9089-6d92f80693e6 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:52.347580 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8639e-befe-42f8-987d-e5b57b597830 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:52.385308 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465bd78-b069-43d1-80dd-777c09351826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:52.386544 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465bd78-b069-43d1-80dd-777c09351826 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:52.387041 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465bd78-b069-43d1-80dd-777c09351826 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:52.387533 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465bd78-b069-43d1-80dd-777c09351826 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:52.388409 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465bd78-b069-43d1-80dd-777c09351826 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:52.390144 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465bd78-b069-43d1-80dd-777c09351826 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:52.396555 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb79b4c-c606-4577-9089-6d92f80693e6 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:52.403750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-8465bd78-b069-43d1-80dd-777c09351826 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 19:29:52.403750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:52.403750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:29:52.403750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:29:52.403750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:29:52.403750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:29:52.403750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:29:52.403750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:52.403750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 19:29:52.403750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:52.403750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:29:52.403750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:52.403750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:52.403750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:52.403750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:52.403750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:52.403750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:52.404863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:52.404863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:52.404863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:52.404863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:52.404863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:52.404863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:52.404863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:29:52.404863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:29:52.404863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:29:52.404863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:29:52.404863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:52.404863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:52.404863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:52.404863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:52.404863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:52.404863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:52.405755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:52.405755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:52.405755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:52.405755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:52.405755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:52.405755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:52.405755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:52.405755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:52.405755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:52.405755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:52.405755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:29:52.405755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:52.405755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 19:29:52.405755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:52.413644 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 443/883] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jun 14 19:29:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:52.415899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465bd78-b069-43d1-80dd-777c09351826 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:52.450220 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a63b9-a373-4dc3-bfb1-7fa910f8ec0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:52.451335 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a63b9-a373-4dc3-bfb1-7fa910f8ec0e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:52.451620 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a63b9-a373-4dc3-bfb1-7fa910f8ec0e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:52.451893 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a63b9-a373-4dc3-bfb1-7fa910f8ec0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:52.470219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a63b9-a373-4dc3-bfb1-7fa910f8ec0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:52.471820 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a63b9-a373-4dc3-bfb1-7fa910f8ec0e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:52.490386 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:52.492400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-e38a63b9-a373-4dc3-bfb1-7fa910f8ec0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:52.492400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:52.492400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:52.492400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:52.492400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:52.492400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:52.492400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:52.492400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:52.492400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:52.492400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:52.492400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:52.492400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:52.492400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:52.492400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:52.492400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:52.497998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:52.497998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:52.497998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:52.497998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:52.497998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:52.497998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:52.497998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:52.497998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:52.497998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:52.497998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:52.497998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:52.497998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:52.497998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:52.497998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:52.497998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:52.497998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:52.497998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:52.498974 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:52.498974 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:52.498974 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:52.498974 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:52.498974 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 441/884] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:52.501985 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a63b9-a373-4dc3-bfb1-7fa910f8ec0e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:52.518946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:52.547041 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465bd78-b069-43d1-80dd-777c09351826 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:52.584895 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d918f731-bd1c-4500-99e1-f89a1a64c654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:52.585598 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918f731-bd1c-4500-99e1-f89a1a64c654 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:52.585915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918f731-bd1c-4500-99e1-f89a1a64c654 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:52.586195 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d918f731-bd1c-4500-99e1-f89a1a64c654 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:52.587241 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918f731-bd1c-4500-99e1-f89a1a64c654 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:52.587561 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918f731-bd1c-4500-99e1-f89a1a64c654 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:52.588934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d918f731-bd1c-4500-99e1-f89a1a64c654 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:52.599220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 444/885] 10.222.0.44 () {56 vars in 1122 bytes} [Tue Jun 14 19:29:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:52.599220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b7e05-a232-45d0-8b0b-28191bc245e2 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:52.599220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b7e05-a232-45d0-8b0b-28191bc245e2 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:52.599220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691b7e05-a232-45d0-8b0b-28191bc245e2 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:52.599220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 445/886] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:52.602791 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b7e05-a232-45d0-8b0b-28191bc245e2 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:52.613791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a63b9-a373-4dc3-bfb1-7fa910f8ec0e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:52.649671 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b47cb-d650-46e1-816d-6a4d4e93a2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:52.650334 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b47cb-d650-46e1-816d-6a4d4e93a2ef None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:52.650651 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b47cb-d650-46e1-816d-6a4d4e93a2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:52.650934 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b47cb-d650-46e1-816d-6a4d4e93a2ef None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:52.651658 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b47cb-d650-46e1-816d-6a4d4e93a2ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:52.651969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b47cb-d650-46e1-816d-6a4d4e93a2ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:52.653340 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b47cb-d650-46e1-816d-6a4d4e93a2ef None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:52.666476 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 442/887] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:52.667665 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d082d75-d1af-4dd3-8116-eeda39d6d9b3 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:52.667959 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d082d75-d1af-4dd3-8116-eeda39d6d9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:52.668240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d082d75-d1af-4dd3-8116-eeda39d6d9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:52.684621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1d082d75-d1af-4dd3-8116-eeda39d6d9b3 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:52.685854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1d082d75-d1af-4dd3-8116-eeda39d6d9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:52.721955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691b7e05-a232-45d0-8b0b-28191bc245e2 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:52.749636 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:52.769403 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 443/888] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:29:52.769573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bf82b-2a93-480d-a3e6-b925df85d3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:52.769669 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d082d75-d1af-4dd3-8116-eeda39d6d9b3 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:52.769762 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bf82b-2a93-480d-a3e6-b925df85d3dd None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:52.769762 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bf82b-2a93-480d-a3e6-b925df85d3dd None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:52.769762 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bf82b-2a93-480d-a3e6-b925df85d3dd None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:52.769762 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bf82b-2a93-480d-a3e6-b925df85d3dd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:52.770018 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:52.770087 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bf82b-2a93-480d-a3e6-b925df85d3dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:52.770087 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bf82b-2a93-480d-a3e6-b925df85d3dd None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:52.773657 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 446/889] 10.222.0.44 () {56 vars in 1122 bytes} [Tue Jun 14 19:29:52 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:52.791321 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bf82b-2a93-480d-a3e6-b925df85d3dd None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:52.890110 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d082d75-d1af-4dd3-8116-eeda39d6d9b3 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:52.930350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdb8d3-a970-4617-907a-920fd89bc165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:52.931182 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdb8d3-a970-4617-907a-920fd89bc165 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:52.931586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdb8d3-a970-4617-907a-920fd89bc165 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:52.931866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdb8d3-a970-4617-907a-920fd89bc165 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:52.940709 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdb8d3-a970-4617-907a-920fd89bc165 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:52.942238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdb8d3-a970-4617-907a-920fd89bc165 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:52.945751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bf82b-2a93-480d-a3e6-b925df85d3dd None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:52.963284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-5efdb8d3-a970-4617-907a-920fd89bc165 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 19:29:52.963284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:52.963284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:52.963284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:52.963284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:52.963284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:52.963284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:52.963284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:52.963284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:52.963284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:52.963284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:52.963284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:52.963284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:52.963284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:52.963284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:52.963284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:52.964275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:52.964275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:52.964275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:52.964275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:52.964275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:52.964275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:52.964275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:52.964275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:52.964275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:52.964275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:52.964275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:52.964275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:52.964275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:52.964275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:52.964275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:52.964275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:52.964275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:52.964275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:52.965196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:52.965196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:52.965196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:52.965196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:52.965196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:52.965196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:52.965196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:52.965196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:52.965196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 19:29:52.965196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:52.972908 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 444/890] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jun 14 19:29:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:52.974437 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdb8d3-a970-4617-907a-920fd89bc165 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:52.987958 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900072ac-2652-42c3-afe6-0e9a886e11b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:52.989109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900072ac-2652-42c3-afe6-0e9a886e11b8 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:52.989446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900072ac-2652-42c3-afe6-0e9a886e11b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:52.990768 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900072ac-2652-42c3-afe6-0e9a886e11b8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:52.990768 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900072ac-2652-42c3-afe6-0e9a886e11b8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:52.991737 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900072ac-2652-42c3-afe6-0e9a886e11b8 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:53.005077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-900072ac-2652-42c3-afe6-0e9a886e11b8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 19:29:53.005077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:53.005077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:29:53.005077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:29:53.005077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:29:53.005077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:29:53.005077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:29:53.005077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:53.005077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 19:29:53.005077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:53.005077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:29:53.005077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:53.005077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:53.005077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:53.005077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:53.005077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:53.005077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:53.006158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:53.006158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:53.006158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:53.006158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:53.006158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:53.006158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:53.006158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:29:53.006158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:29:53.006158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:29:53.006158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:29:53.006158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:53.006158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:53.006158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:53.006158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:53.006158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:53.006158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:53.006989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:53.006989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:53.006989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:53.006989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:53.006989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:53.006989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:53.006989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:53.006989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:53.006989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:53.006989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:53.006989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:29:53.006989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:53.006989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 19:29:53.006989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:53.006989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 447/891] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:29:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:53.013847 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900072ac-2652-42c3-afe6-0e9a886e11b8 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:53.053780 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:53.077638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:53.105140 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdb8d3-a970-4617-907a-920fd89bc165 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:53.134026 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900072ac-2652-42c3-afe6-0e9a886e11b8 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:53.153171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97b463-e1a1-4726-8824-facf61443158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:53.154174 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97b463-e1a1-4726-8824-facf61443158 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:53.154467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97b463-e1a1-4726-8824-facf61443158 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:53.154750 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97b463-e1a1-4726-8824-facf61443158 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:53.155589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97b463-e1a1-4726-8824-facf61443158 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:53.155904 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97b463-e1a1-4726-8824-facf61443158 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:53.158233 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97b463-e1a1-4726-8824-facf61443158 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:53.175893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672b80d-deda-4d5c-b68a-7545b4b603e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:53.176990 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672b80d-deda-4d5c-b68a-7545b4b603e1 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:53.177530 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672b80d-deda-4d5c-b68a-7545b4b603e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:53.178050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1672b80d-deda-4d5c-b68a-7545b4b603e1 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:53.179052 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672b80d-deda-4d5c-b68a-7545b4b603e1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:53.179563 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672b80d-deda-4d5c-b68a-7545b4b603e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:53.180647 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 445/892] 10.222.0.44 () {56 vars in 1149 bytes} [Tue Jun 14 19:29:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:53.181486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1672b80d-deda-4d5c-b68a-7545b4b603e1 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:53.185965 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97b463-e1a1-4726-8824-facf61443158 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:53.190541 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 448/893] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:29:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:53.196632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672b80d-deda-4d5c-b68a-7545b4b603e1 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:53.308612 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1672b80d-deda-4d5c-b68a-7545b4b603e1 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:53.321997 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97b463-e1a1-4726-8824-facf61443158 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:53.331247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:53.346141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:53.357565 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcc1e3-83c5-4190-80e3-725c4f4d29cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:53.358683 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcc1e3-83c5-4190-80e3-725c4f4d29cf None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:53.358974 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcc1e3-83c5-4190-80e3-725c4f4d29cf None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:53.359286 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efcc1e3-83c5-4190-80e3-725c4f4d29cf None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:53.361019 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efcc1e3-83c5-4190-80e3-725c4f4d29cf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:53.361329 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efcc1e3-83c5-4190-80e3-725c4f4d29cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:53.362820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efcc1e3-83c5-4190-80e3-725c4f4d29cf None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:53.364819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f925047-cd2f-401f-9d8c-61199a12b378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:53.365796 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f925047-cd2f-401f-9d8c-61199a12b378 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:53.366283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f925047-cd2f-401f-9d8c-61199a12b378 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:53.366773 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f925047-cd2f-401f-9d8c-61199a12b378 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:53.372576 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 449/894] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:29:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:53.374376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcc1e3-83c5-4190-80e3-725c4f4d29cf None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:53.459699 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f925047-cd2f-401f-9d8c-61199a12b378 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:53.461643 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f925047-cd2f-401f-9d8c-61199a12b378 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:53.485575 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efcc1e3-83c5-4190-80e3-725c4f4d29cf None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:53.522455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d43e9-cdd9-4e1c-b246-6a1aeed96071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:53.523457 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d43e9-cdd9-4e1c-b246-6a1aeed96071 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:53.523962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d43e9-cdd9-4e1c-b246-6a1aeed96071 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:53.524524 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d43e9-cdd9-4e1c-b246-6a1aeed96071 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:53.525557 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d43e9-cdd9-4e1c-b246-6a1aeed96071 None admin] RBAC: Adding query filter params (interface=public, service_id=083c659baee0429ea223ab9242dd9658, region_id=RegionOne) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:53.526025 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d43e9-cdd9-4e1c-b246-6a1aeed96071 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:53.527769 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d43e9-cdd9-4e1c-b246-6a1aeed96071 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:53.540905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 450/895] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jun 14 19:29:53 2022] GET /identity/v3/endpoints?service_id=083c659baee0429ea223ab9242dd9658&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:53.542466 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f610b-ce8e-43db-baca-a0bc927ec9a4 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:53.542766 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f610b-ce8e-43db-baca-a0bc927ec9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:53.543051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f610b-ce8e-43db-baca-a0bc927ec9a4 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:53.544619 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 451/896] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:53.545323 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f610b-ce8e-43db-baca-a0bc927ec9a4 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:53.574595 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 446/897] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:29:53 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 14 19:29:53.576122 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73726054-3e45-423f-97cb-9c41eab24cd3 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:53.576417 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73726054-3e45-423f-97cb-9c41eab24cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:53.576696 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73726054-3e45-423f-97cb-9c41eab24cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:53.593648 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-73726054-3e45-423f-97cb-9c41eab24cd3 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:53.595633 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-73726054-3e45-423f-97cb-9c41eab24cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:53.599616 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:53.611329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:53.660757 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f610b-ce8e-43db-baca-a0bc927ec9a4 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:53.685395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 447/898] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:29:53.685395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73726054-3e45-423f-97cb-9c41eab24cd3 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:53.696302 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2955387-00dd-4a90-bf91-82168cab8113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:53.696968 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2955387-00dd-4a90-bf91-82168cab8113 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:53.697254 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2955387-00dd-4a90-bf91-82168cab8113 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:53.697577 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2955387-00dd-4a90-bf91-82168cab8113 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:53.698280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2955387-00dd-4a90-bf91-82168cab8113 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:53.699613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2955387-00dd-4a90-bf91-82168cab8113 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:53.706472 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 452/899] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jun 14 19:29:53 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:29:53.707314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2955387-00dd-4a90-bf91-82168cab8113 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:53.821621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73726054-3e45-423f-97cb-9c41eab24cd3 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:53.850288 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2955387-00dd-4a90-bf91-82168cab8113 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:53.861393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:53.875619 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb33a70-22c0-494a-a98d-4368803afafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:53.877044 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb33a70-22c0-494a-a98d-4368803afafa None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:53.877546 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb33a70-22c0-494a-a98d-4368803afafa None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:53.878255 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb33a70-22c0-494a-a98d-4368803afafa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:53.889529 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb33a70-22c0-494a-a98d-4368803afafa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:53.891279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb33a70-22c0-494a-a98d-4368803afafa None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:53.896121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b58a0-36d7-49d3-9ede-ae2f26b2264d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:53.897013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b58a0-36d7-49d3-9ede-ae2f26b2264d None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:53.897450 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b58a0-36d7-49d3-9ede-ae2f26b2264d None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:53.898286 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b58a0-36d7-49d3-9ede-ae2f26b2264d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:53.898453 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b58a0-36d7-49d3-9ede-ae2f26b2264d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:53.899940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b58a0-36d7-49d3-9ede-ae2f26b2264d None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:53.913571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-0bb33a70-22c0-494a-a98d-4368803afafa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:53.913571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:53.913571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:53.913571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:53.913571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:53.913571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:53.913571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:53.913571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:53.913571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:53.913571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:53.913571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:53.913571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:53.913571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:53.913571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:53.913571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:53.914731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:53.914731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:53.914731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:53.914731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:53.914731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:53.914731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:53.914731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:53.914731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:53.914731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:53.914731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:53.914731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:53.914731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:53.914731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:53.914731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:53.914731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:53.914731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:53.914731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:53.916009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:53.916009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:53.916009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:53.916009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:53.916009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 448/900] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:53.918658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-035b58a0-36d7-49d3-9ede-ae2f26b2264d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 19:29:53.918658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:53.918658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:29:53.918658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:29:53.918658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:29:53.918658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:29:53.918658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:29:53.918658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:53.918658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 19:29:53.918658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:53.918658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:29:53.918658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:53.918658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:53.918658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:53.918658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:53.918658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:53.919818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:53.919818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:53.919818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:53.919818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:53.919818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:53.919818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:53.919818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:53.919818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:29:53.919818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:29:53.919818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:29:53.919818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:29:53.919818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:53.919818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:53.919818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:53.919818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:53.919818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:53.920667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:53.920667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:53.920667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:53.920667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:53.920667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:53.920667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:53.920667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:53.920667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:53.920667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:53.920667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:53.920667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:53.920667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:29:53.920667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:53.920667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 19:29:53.920667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:53.921445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb33a70-22c0-494a-a98d-4368803afafa None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:53.924525 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:53.924757 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 453/901] 10.222.0.44 () {56 vars in 1132 bytes} [Tue Jun 14 19:29:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:53.931333 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b58a0-36d7-49d3-9ede-ae2f26b2264d None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:54.034047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb33a70-22c0-494a-a98d-4368803afafa None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:54.039337 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b58a0-36d7-49d3-9ede-ae2f26b2264d None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:54.072001 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1623f-9c7b-47ba-af3c-1dee2adb86c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:54.073158 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1623f-9c7b-47ba-af3c-1dee2adb86c7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:54.073676 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1623f-9c7b-47ba-af3c-1dee2adb86c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:54.074159 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1623f-9c7b-47ba-af3c-1dee2adb86c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:54.075292 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1623f-9c7b-47ba-af3c-1dee2adb86c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:54.075833 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1623f-9c7b-47ba-af3c-1dee2adb86c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:54.076632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7132b-0b2a-4629-9403-630e3236a5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:54.077427 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1623f-9c7b-47ba-af3c-1dee2adb86c7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:54.077652 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7132b-0b2a-4629-9403-630e3236a5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:54.078080 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7132b-0b2a-4629-9403-630e3236a5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:54.079653 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7132b-0b2a-4629-9403-630e3236a5d0 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:54.080536 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7132b-0b2a-4629-9403-630e3236a5d0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:54.080995 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7132b-0b2a-4629-9403-630e3236a5d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:54.082603 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7132b-0b2a-4629-9403-630e3236a5d0 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:54.092573 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 449/903] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:54.092885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 454/903] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jun 14 19:29:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:54.096573 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1623f-9c7b-47ba-af3c-1dee2adb86c7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:54.097600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7132b-0b2a-4629-9403-630e3236a5d0 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:54.152816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:54.157332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:54.201051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1623f-9c7b-47ba-af3c-1dee2adb86c7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:54.232209 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7132b-0b2a-4629-9403-630e3236a5d0 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:54.248545 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a9e69-fb41-4d8f-a533-20775e719820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:54.249588 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a9e69-fb41-4d8f-a533-20775e719820 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:54.250336 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a9e69-fb41-4d8f-a533-20775e719820 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:54.251360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a9e69-fb41-4d8f-a533-20775e719820 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:54.252650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a9e69-fb41-4d8f-a533-20775e719820 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:54.253142 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a9e69-fb41-4d8f-a533-20775e719820 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:54.255246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a9e69-fb41-4d8f-a533-20775e719820 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:54.263141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 450/904] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jun 14 19:29:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:54.268685 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a9e69-fb41-4d8f-a533-20775e719820 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:54.272456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446d5a6-4abd-4e0c-9c34-871efa548729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:54.273518 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446d5a6-4abd-4e0c-9c34-871efa548729 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:54.274020 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446d5a6-4abd-4e0c-9c34-871efa548729 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:54.274498 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446d5a6-4abd-4e0c-9c34-871efa548729 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:54.281896 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446d5a6-4abd-4e0c-9c34-871efa548729 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:54.283853 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446d5a6-4abd-4e0c-9c34-871efa548729 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:54.299441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-9446d5a6-4abd-4e0c-9c34-871efa548729 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:54.299441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:54.299441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:54.299441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:54.299441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:54.299441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:54.299441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:54.299441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:54.299441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:54.299441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:54.299441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:54.299441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:54.299441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:54.299441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:54.299441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:54.300378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:54.300378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:54.300378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:54.300378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:54.300378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:54.300378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:54.300378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:54.300378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:54.300378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:54.300378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:54.300378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:54.300378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:54.300378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:54.300378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:54.300378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:54.300378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:54.300378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:54.301254 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:54.301254 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:54.301254 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:54.301254 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:54.301254 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:54.301254 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:54.301254 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:54.301254 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:54.308091 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 455/905] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:54.309151 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446d5a6-4abd-4e0c-9c34-871efa548729 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:54.388615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a9e69-fb41-4d8f-a533-20775e719820 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:54.416839 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:54.418921 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:54.428154 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446d5a6-4abd-4e0c-9c34-871efa548729 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:54.429705 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11ac77-dfc1-4225-9ef4-fba78c4851db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:54.430753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11ac77-dfc1-4225-9ef4-fba78c4851db None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:54.431251 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11ac77-dfc1-4225-9ef4-fba78c4851db None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:54.431746 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11ac77-dfc1-4225-9ef4-fba78c4851db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:54.432735 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11ac77-dfc1-4225-9ef4-fba78c4851db None admin] RBAC: Adding query filter params (interface=public, service_id=7e0f3b6349d64681b9c3df0507c1b8a8, region_id=RegionOne) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:54.433317 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11ac77-dfc1-4225-9ef4-fba78c4851db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:54.434955 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11ac77-dfc1-4225-9ef4-fba78c4851db None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:54.441326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 451/906] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jun 14 19:29:54 2022] GET /identity/v3/endpoints?service_id=7e0f3b6349d64681b9c3df0507c1b8a8&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:54.446674 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11ac77-dfc1-4225-9ef4-fba78c4851db None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:54.479114 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9649633-0cef-470e-9887-d4c8a65d8a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:54.479878 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9649633-0cef-470e-9887-d4c8a65d8a14 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:54.480179 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9649633-0cef-470e-9887-d4c8a65d8a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:54.480443 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9649633-0cef-470e-9887-d4c8a65d8a14 None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:54.481240 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9649633-0cef-470e-9887-d4c8a65d8a14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:54.481574 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9649633-0cef-470e-9887-d4c8a65d8a14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:54.483287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9649633-0cef-470e-9887-d4c8a65d8a14 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:54.501881 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 456/907] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:54.503347 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9649633-0cef-470e-9887-d4c8a65d8a14 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:54.572603 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11ac77-dfc1-4225-9ef4-fba78c4851db None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:54.609192 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e80e8-3d1c-47eb-9289-d52e58c17a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:54.609937 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e80e8-3d1c-47eb-9289-d52e58c17a93 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:54.610228 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e80e8-3d1c-47eb-9289-d52e58c17a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:54.610499 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e80e8-3d1c-47eb-9289-d52e58c17a93 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:54.611178 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e80e8-3d1c-47eb-9289-d52e58c17a93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:54.612557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e80e8-3d1c-47eb-9289-d52e58c17a93 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:54.625928 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 452/908] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jun 14 19:29:54 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:29:54.634069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9649633-0cef-470e-9887-d4c8a65d8a14 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:54.673590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a8252-ab45-454e-92da-c752949b9ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:54.674177 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a8252-ab45-454e-92da-c752949b9ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:54.674512 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a8252-ab45-454e-92da-c752949b9ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:54.674787 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a8252-ab45-454e-92da-c752949b9ee3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:54.675677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a8252-ab45-454e-92da-c752949b9ee3 None admin] RBAC: Adding query filter params (role.id=04984986168e4190919081ad55f01b76, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=d16be8774cb842199cfb9e3b9965bd7c) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:54.675992 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a8252-ab45-454e-92da-c752949b9ee3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:54.677447 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a8252-ab45-454e-92da-c752949b9ee3 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:54.684168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 457/909] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:29:54 2022] GET /identity/v3/role_assignments?user.id=d16be8774cb842199cfb9e3b9965bd7c&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=04984986168e4190919081ad55f01b76 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:29:55.005083 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b8f6a-eb38-491c-a75b-98e98e1b9e0e None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:55.005503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b8f6a-eb38-491c-a75b-98e98e1b9e0e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:55.005704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b8f6a-eb38-491c-a75b-98e98e1b9e0e None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:55.007278 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 453/910] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:55.012691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98be8c9-a28f-492b-a35e-794df07eebb7 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:55.012987 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98be8c9-a28f-492b-a35e-794df07eebb7 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:55.013273 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98be8c9-a28f-492b-a35e-794df07eebb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:55.034475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-e98be8c9-a28f-492b-a35e-794df07eebb7 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:55.034966 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e98be8c9-a28f-492b-a35e-794df07eebb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:55.051494 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:55.110137 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 458/911] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:29:55.132918 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b8f6a-eb38-491c-a75b-98e98e1b9e0e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:55.196379 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:55.247733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b8f6a-eb38-491c-a75b-98e98e1b9e0e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:55.283342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d486d-27f0-498f-94c4-63611a3ef2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:55.283932 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d486d-27f0-498f-94c4-63611a3ef2ba None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:55.284218 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d486d-27f0-498f-94c4-63611a3ef2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:55.284553 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d486d-27f0-498f-94c4-63611a3ef2ba None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:55.285287 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d486d-27f0-498f-94c4-63611a3ef2ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:55.286726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48d486d-27f0-498f-94c4-63611a3ef2ba None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:55.303473 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 454/912] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jun 14 19:29:55 2022] POST /identity/v3/services => generated 241 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:29:55.952251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d431d79-de5a-4a48-87e9-cbdde6642424 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:55.952623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d431d79-de5a-4a48-87e9-cbdde6642424 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:55.952845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d431d79-de5a-4a48-87e9-cbdde6642424 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:55.955061 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 459/913] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:55.960526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca291a6-9a8f-46ae-94bf-8a454cdbbe62 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:55.960827 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca291a6-9a8f-46ae-94bf-8a454cdbbe62 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:55.961113 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca291a6-9a8f-46ae-94bf-8a454cdbbe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:55.978271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-eca291a6-9a8f-46ae-94bf-8a454cdbbe62 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:55.979517 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-eca291a6-9a8f-46ae-94bf-8a454cdbbe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:56.059323 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 455/914] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:29:56.082996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d431d79-de5a-4a48-87e9-cbdde6642424 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:56.190609 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d431d79-de5a-4a48-87e9-cbdde6642424 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:56.226651 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de60a12-c03f-4be5-9aeb-3fae607ca0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:56.227739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de60a12-c03f-4be5-9aeb-3fae607ca0ba None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:56.228229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de60a12-c03f-4be5-9aeb-3fae607ca0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:56.228700 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de60a12-c03f-4be5-9aeb-3fae607ca0ba None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:56.229568 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de60a12-c03f-4be5-9aeb-3fae607ca0ba None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:56.231134 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de60a12-c03f-4be5-9aeb-3fae607ca0ba None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:56.244051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-4de60a12-c03f-4be5-9aeb-3fae607ca0ba None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 19:29:56.244051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:56.244051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:29:56.244051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:29:56.244051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:29:56.244051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:29:56.244051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:29:56.244051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:56.244051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 19:29:56.244051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:56.244051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:29:56.244051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:56.244051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:56.244051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:56.244051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:56.244051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:56.244051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:56.245007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:56.245007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:56.245007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:56.245007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:56.245007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:56.245007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:56.245007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:29:56.245007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:29:56.245007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:29:56.245007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:29:56.245007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:56.245007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:56.245007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:56.245007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:56.245007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:56.245007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:56.245832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:56.245832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:56.245832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:56.245832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:56.245832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:56.245832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:56.245832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:56.245832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:56.245832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:56.245832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:56.245832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:29:56.245832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:56.245832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 14 19:29:56.245832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:56.253200 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 460/915] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:29:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:56.255910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca291a6-9a8f-46ae-94bf-8a454cdbbe62 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:56.299461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:56.364159 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca291a6-9a8f-46ae-94bf-8a454cdbbe62 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:56.399351 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e467bf-9386-4c60-9ac9-0f75779732ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:56.400021 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e467bf-9386-4c60-9ac9-0f75779732ad None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:56.400305 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e467bf-9386-4c60-9ac9-0f75779732ad None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:56.400581 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e467bf-9386-4c60-9ac9-0f75779732ad None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:56.401284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e467bf-9386-4c60-9ac9-0f75779732ad None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:56.401618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e467bf-9386-4c60-9ac9-0f75779732ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:56.402990 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e467bf-9386-4c60-9ac9-0f75779732ad None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:56.408226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 456/916] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:29:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:56.413836 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de60a12-c03f-4be5-9aeb-3fae607ca0ba None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:56.432144 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:56.527625 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de60a12-c03f-4be5-9aeb-3fae607ca0ba None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:56.567807 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b790935-512d-4ffe-a61c-e77992c201a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:56.568530 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b790935-512d-4ffe-a61c-e77992c201a5 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:56.568819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b790935-512d-4ffe-a61c-e77992c201a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:56.569149 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b790935-512d-4ffe-a61c-e77992c201a5 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:56.569909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b790935-512d-4ffe-a61c-e77992c201a5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:56.570221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b790935-512d-4ffe-a61c-e77992c201a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:56.571593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b790935-512d-4ffe-a61c-e77992c201a5 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:56.576990 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 461/917] 10.222.0.44 () {56 vars in 1114 bytes} [Tue Jun 14 19:29:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:56.582807 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e467bf-9386-4c60-9ac9-0f75779732ad None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:56.689470 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e467bf-9386-4c60-9ac9-0f75779732ad None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:56.691740 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:56.726045 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6b262-0aa0-49a3-9230-790bcb6b02c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:56.726702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6b262-0aa0-49a3-9230-790bcb6b02c1 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:56.726992 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6b262-0aa0-49a3-9230-790bcb6b02c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:56.727271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6b262-0aa0-49a3-9230-790bcb6b02c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:56.728035 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6b262-0aa0-49a3-9230-790bcb6b02c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:56.729423 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6b262-0aa0-49a3-9230-790bcb6b02c1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:56.753961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 457/918] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jun 14 19:29:56 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:29:56.914853 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f34b0-1967-425e-a1a1-ee742566e5d1 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:56.915184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f34b0-1967-425e-a1a1-ee742566e5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:56.915426 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f34b0-1967-425e-a1a1-ee742566e5d1 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:56.917143 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 462/919] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:56.919922 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c90d84-d8a3-4bee-a874-32c98bc9da13 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:56.920218 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c90d84-d8a3-4bee-a874-32c98bc9da13 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:56.920502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c90d84-d8a3-4bee-a874-32c98bc9da13 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:56.922927 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 458/920] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:56.928560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cf729-91f9-4c94-a56b-4eb1ef9c46d6 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:56.928858 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cf729-91f9-4c94-a56b-4eb1ef9c46d6 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:56.929143 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cf729-91f9-4c94-a56b-4eb1ef9c46d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:56.931954 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bab7f-379e-401e-87ca-a8edfcf400a6 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:56.932245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bab7f-379e-401e-87ca-a8edfcf400a6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:56.932528 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bab7f-379e-401e-87ca-a8edfcf400a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:56.951758 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-9c3cf729-91f9-4c94-a56b-4eb1ef9c46d6 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:56.952704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d92bab7f-379e-401e-87ca-a8edfcf400a6 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:56.952958 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-9c3cf729-91f9-4c94-a56b-4eb1ef9c46d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:56.954159 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d92bab7f-379e-401e-87ca-a8edfcf400a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:57.041079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 463/921] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:29:57.049124 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 459/922] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:29:57.066909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cf729-91f9-4c94-a56b-4eb1ef9c46d6 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:57.071106 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:57.071550 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bab7f-379e-401e-87ca-a8edfcf400a6 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:57.180483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:57.196624 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cf729-91f9-4c94-a56b-4eb1ef9c46d6 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:57.201995 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bab7f-379e-401e-87ca-a8edfcf400a6 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:57.240066 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c647507-535d-4dc7-9f21-16828e489401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:57.241304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c647507-535d-4dc7-9f21-16828e489401 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:57.241855 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c647507-535d-4dc7-9f21-16828e489401 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:57.242304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c647507-535d-4dc7-9f21-16828e489401 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:57.244075 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db732b0-046e-4ca8-9ff3-a2d822825ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:57.245644 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db732b0-046e-4ca8-9ff3-a2d822825ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:57.246081 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db732b0-046e-4ca8-9ff3-a2d822825ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:57.246478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db732b0-046e-4ca8-9ff3-a2d822825ad6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:57.247242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db732b0-046e-4ca8-9ff3-a2d822825ad6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:57.249024 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db732b0-046e-4ca8-9ff3-a2d822825ad6 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:57.255154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c647507-535d-4dc7-9f21-16828e489401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:29:57.263533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-8c647507-535d-4dc7-9f21-16828e489401 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 19:29:57.263533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:57.263533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:57.263533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:57.263533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:57.263533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:57.263533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:57.263533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:57.263533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:57.263533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:57.263533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:57.263533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:57.263533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:29:57.263533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:29:57.263533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:29:57.263533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:29:57.264887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:29:57.264887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:29:57.264887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:29:57.264887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:29:57.264887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:57.264887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:57.264887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:57.264887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:57.264887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:57.264887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:57.264887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:57.264887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:57.264887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:57.264887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:57.264887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:57.264887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:57.265753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:57.265753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:57.265753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:57.265753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:57.265753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:29:57.265753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:29:57.265753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:29:57.265753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:29:57.265753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:29:57.265753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:29:57.265753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 19:29:57.265753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:57.266822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-8db732b0-046e-4ca8-9ff3-a2d822825ad6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 19:29:57.266822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:57.266822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:29:57.266822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:29:57.266822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:29:57.266822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:29:57.266822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:29:57.266822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:57.266822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 19:29:57.266822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:57.266822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:29:57.266822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:57.266822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:57.266822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:57.266822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:57.266822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:57.267638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:57.267638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:57.267638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:57.267638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:57.267638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:57.267638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:57.267638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:57.267638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:29:57.267638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:29:57.267638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:29:57.267638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:29:57.267638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:57.267638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:57.267638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:57.267638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:57.267638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:57.269362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:57.269362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:57.269362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:57.269362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:57.269362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:57.269362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:57.269362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:57.269362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:57.269362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:57.269362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:57.269362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:57.269362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:29:57.269362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:57.269362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 14 19:29:57.269362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:57.271094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 464/923] 10.222.0.44 () {56 vars in 1132 bytes} [Tue Jun 14 19:29:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:57.271731 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db732b0-046e-4ca8-9ff3-a2d822825ad6 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:57.273115 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 460/924] 10.222.0.44 () {56 vars in 1120 bytes} [Tue Jun 14 19:29:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:57.281204 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c647507-535d-4dc7-9f21-16828e489401 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:57.347991 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:57.386559 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db732b0-046e-4ca8-9ff3-a2d822825ad6 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:57.389526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c647507-535d-4dc7-9f21-16828e489401 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:57.423891 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ce4fd-466d-46a9-b72a-cec02acf9e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:57.424781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ce4fd-466d-46a9-b72a-cec02acf9e58 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:57.425097 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ce4fd-466d-46a9-b72a-cec02acf9e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:57.425511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802ce4fd-466d-46a9-b72a-cec02acf9e58 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:57.426372 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ce4fd-466d-46a9-b72a-cec02acf9e58 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:57.426755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ce4fd-466d-46a9-b72a-cec02acf9e58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:57.427290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a30a6-7584-4214-8b70-a4dc7afc3af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:57.428150 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a30a6-7584-4214-8b70-a4dc7afc3af2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:57.428273 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802ce4fd-466d-46a9-b72a-cec02acf9e58 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:57.428718 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a30a6-7584-4214-8b70-a4dc7afc3af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:57.429186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a30a6-7584-4214-8b70-a4dc7afc3af2 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:57.430133 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a30a6-7584-4214-8b70-a4dc7afc3af2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:57.430617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a30a6-7584-4214-8b70-a4dc7afc3af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:57.432155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a30a6-7584-4214-8b70-a4dc7afc3af2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:57.438657 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 465/925] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jun 14 19:29:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:57.439667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ce4fd-466d-46a9-b72a-cec02acf9e58 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:57.445501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 461/926] 10.222.0.44 () {56 vars in 1115 bytes} [Tue Jun 14 19:29:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:57.447631 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a30a6-7584-4214-8b70-a4dc7afc3af2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:57.477736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:57.555716 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a30a6-7584-4214-8b70-a4dc7afc3af2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:57.556601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802ce4fd-466d-46a9-b72a-cec02acf9e58 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:57.588236 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:57.592816 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3647a21-4194-41e9-a643-284c269d9701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:57.593644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3647a21-4194-41e9-a643-284c269d9701 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:57.593935 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3647a21-4194-41e9-a643-284c269d9701 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:57.594732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3647a21-4194-41e9-a643-284c269d9701 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:57.595386 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3728522-1fcc-400b-816f-93a965b0fbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:57.596205 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3728522-1fcc-400b-816f-93a965b0fbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:57.596635 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3728522-1fcc-400b-816f-93a965b0fbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:57.597055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3728522-1fcc-400b-816f-93a965b0fbe2 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:57.597955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3728522-1fcc-400b-816f-93a965b0fbe2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:57.598407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3728522-1fcc-400b-816f-93a965b0fbe2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:57.599918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3728522-1fcc-400b-816f-93a965b0fbe2 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:57.605365 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3647a21-4194-41e9-a643-284c269d9701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:57.605915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 466/927] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jun 14 19:29:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:57.606862 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3647a21-4194-41e9-a643-284c269d9701 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:57.607652 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf3fad-fbda-43d8-8c0d-630f98f7d8a0 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:57.607944 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf3fad-fbda-43d8-8c0d-630f98f7d8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:57.608225 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf3fad-fbda-43d8-8c0d-630f98f7d8a0 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:57.610294 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 467/928] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:57.615467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4352ef-13c8-4636-9d4b-7a6d2a01874e None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:57.615831 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4352ef-13c8-4636-9d4b-7a6d2a01874e None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:57.616523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4352ef-13c8-4636-9d4b-7a6d2a01874e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:57.631946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-f3647a21-4194-41e9-a643-284c269d9701 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:57.631946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:57.631946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:57.631946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:57.631946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:57.631946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:57.631946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:57.631946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:57.631946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:57.631946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:57.631946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:57.631946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:57.631946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:57.631946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:57.631946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:57.632903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:57.632903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:57.632903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:57.632903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:57.632903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:57.632903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:57.632903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:57.632903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:57.632903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:57.632903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:57.632903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:57.632903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:57.632903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:57.632903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:57.632903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:57.632903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:57.632903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:57.633798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:57.633798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:57.633798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:57.633798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:57.633798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 462/929] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:57.634091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3647a21-4194-41e9-a643-284c269d9701 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:57.635622 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-ea4352ef-13c8-4636-9d4b-7a6d2a01874e None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:57.636815 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-ea4352ef-13c8-4636-9d4b-7a6d2a01874e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:57.703419 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:57.713479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 468/930] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 19:29:57.714789 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4352ef-13c8-4636-9d4b-7a6d2a01874e None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:57.751357 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3647a21-4194-41e9-a643-284c269d9701 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:57.788438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f6b83-fb09-4063-9558-a3a75cbf0c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:57.789693 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f6b83-fb09-4063-9558-a3a75cbf0c93 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:57.790188 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f6b83-fb09-4063-9558-a3a75cbf0c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:57.790645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f6b83-fb09-4063-9558-a3a75cbf0c93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:57.791555 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f6b83-fb09-4063-9558-a3a75cbf0c93 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:57.793108 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f6b83-fb09-4063-9558-a3a75cbf0c93 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:57.821586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 463/931] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jun 14 19:29:57 2022] POST /identity/v3/endpoints => generated 347 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:29:57.822934 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f6b83-fb09-4063-9558-a3a75cbf0c93 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:57.847167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4352ef-13c8-4636-9d4b-7a6d2a01874e None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:57.882350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:57.905515 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b36e8-0d7a-4002-a04a-f61522765489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:57.907155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b36e8-0d7a-4002-a04a-f61522765489 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:57.907725 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b36e8-0d7a-4002-a04a-f61522765489 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:57.908229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b36e8-0d7a-4002-a04a-f61522765489 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:57.909188 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b36e8-0d7a-4002-a04a-f61522765489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:57.909762 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b36e8-0d7a-4002-a04a-f61522765489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:57.912429 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b36e8-0d7a-4002-a04a-f61522765489 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:57.934853 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 469/932] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:57.936746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b36e8-0d7a-4002-a04a-f61522765489 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:57.949126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f6b83-fb09-4063-9558-a3a75cbf0c93 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:57.970265 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:57.991752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd9ef8-9a01-413f-a387-3cf48ad36dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:57.992568 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd9ef8-9a01-413f-a387-3cf48ad36dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:57.992898 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd9ef8-9a01-413f-a387-3cf48ad36dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:57.993174 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd9ef8-9a01-413f-a387-3cf48ad36dd3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:57.993886 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd9ef8-9a01-413f-a387-3cf48ad36dd3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:57.995275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd9ef8-9a01-413f-a387-3cf48ad36dd3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:58.008462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-93dd9ef8-9a01-413f-a387-3cf48ad36dd3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 19:29:58.008462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:58.008462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:29:58.008462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:29:58.008462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:29:58.008462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:29:58.008462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:29:58.008462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:58.008462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 19:29:58.008462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:58.008462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:29:58.008462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:58.008462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:58.008462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:58.008462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:58.008462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:58.008462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:58.009727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:58.009727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:58.009727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:58.009727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:58.009727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:58.009727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:58.009727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:29:58.009727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:29:58.009727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:29:58.009727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:29:58.009727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:58.009727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:58.009727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:58.009727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:58.009727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:58.009727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:58.010732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:58.010732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:58.010732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:58.010732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:58.010732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:58.010732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:58.010732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:58.010732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:58.010732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:58.010732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:58.010732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:29:58.010732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:29:58.010732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 19:29:58.010732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:58.014214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 464/933] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jun 14 19:29:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:58.018269 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd9ef8-9a01-413f-a387-3cf48ad36dd3 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:58.077695 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b36e8-0d7a-4002-a04a-f61522765489 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:58.116172 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a8402-5d3c-4b51-8c19-0a3faee82f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:58.116995 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a8402-5d3c-4b51-8c19-0a3faee82f71 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:58.117279 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a8402-5d3c-4b51-8c19-0a3faee82f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:58.117717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a8402-5d3c-4b51-8c19-0a3faee82f71 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:58.126992 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a8402-5d3c-4b51-8c19-0a3faee82f71 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:58.128433 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a8402-5d3c-4b51-8c19-0a3faee82f71 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:58.144701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-737a8402-5d3c-4b51-8c19-0a3faee82f71 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 19:29:58.144701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:58.144701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:58.144701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:58.144701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:58.144701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:58.144701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:58.144701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:58.144701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:58.144701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:58.144701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:58.144701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:58.144701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:29:58.144701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:29:58.144701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:29:58.144701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:29:58.145673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:58.145673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:58.145673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:29:58.145673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:58.145673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:29:58.145673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:29:58.145673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:58.145673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:58.145673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:58.145673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:58.145673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:58.145673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:58.145673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:58.145673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:58.145673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:58.145673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:58.145673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:58.145673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:58.146670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:58.146670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:58.146670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:29:58.146670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:29:58.146670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:29:58.146670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:29:58.146670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:29:58.146670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:29:58.146670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 19:29:58.146670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:58.146670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 470/934] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jun 14 19:29:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:58.148303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd9ef8-9a01-413f-a387-3cf48ad36dd3 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:58.151745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a8402-5d3c-4b51-8c19-0a3faee82f71 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:58.195346 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80915677-ed91-4e50-a7f5-f4cbabb86fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:58.196314 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915677-ed91-4e50-a7f5-f4cbabb86fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:58.196801 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915677-ed91-4e50-a7f5-f4cbabb86fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:58.197261 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80915677-ed91-4e50-a7f5-f4cbabb86fd0 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:58.198175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80915677-ed91-4e50-a7f5-f4cbabb86fd0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:58.198675 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80915677-ed91-4e50-a7f5-f4cbabb86fd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:58.200749 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80915677-ed91-4e50-a7f5-f4cbabb86fd0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:58.203485 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:58.210168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 465/935] 10.222.0.44 () {56 vars in 1122 bytes} [Tue Jun 14 19:29:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:58.216195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80915677-ed91-4e50-a7f5-f4cbabb86fd0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:58.271777 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:58.284910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a8402-5d3c-4b51-8c19-0a3faee82f71 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:58.323194 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54bef6-12d6-481d-b175-4545079a2b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:58.323932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54bef6-12d6-481d-b175-4545079a2b6f None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:58.324133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54bef6-12d6-481d-b175-4545079a2b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:58.325738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54bef6-12d6-481d-b175-4545079a2b6f None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:58.326586 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54bef6-12d6-481d-b175-4545079a2b6f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:58.326910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54bef6-12d6-481d-b175-4545079a2b6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:58.328376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54bef6-12d6-481d-b175-4545079a2b6f None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:58.351604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 471/936] 10.222.0.44 () {56 vars in 1149 bytes} [Tue Jun 14 19:29:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:58.352602 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54bef6-12d6-481d-b175-4545079a2b6f None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:58.354709 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80915677-ed91-4e50-a7f5-f4cbabb86fd0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:58.400338 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16843c-84c2-414e-ab60-5586fe62bc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:58.401275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16843c-84c2-414e-ab60-5586fe62bc24 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:58.401661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16843c-84c2-414e-ab60-5586fe62bc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:58.402033 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16843c-84c2-414e-ab60-5586fe62bc24 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:58.402912 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16843c-84c2-414e-ab60-5586fe62bc24 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:58.403317 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16843c-84c2-414e-ab60-5586fe62bc24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:58.404769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16843c-84c2-414e-ab60-5586fe62bc24 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:58.415655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 466/937] 10.222.0.44 () {56 vars in 1122 bytes} [Tue Jun 14 19:29:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:58.416726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16843c-84c2-414e-ab60-5586fe62bc24 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:58.479207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:58.482620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54bef6-12d6-481d-b175-4545079a2b6f None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:58.520835 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003692b4-76ac-4f10-81ee-46eb1674e7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:58.521864 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003692b4-76ac-4f10-81ee-46eb1674e7fe None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:58.522202 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003692b4-76ac-4f10-81ee-46eb1674e7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:58.522580 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003692b4-76ac-4f10-81ee-46eb1674e7fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:58.533935 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003692b4-76ac-4f10-81ee-46eb1674e7fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:58.535655 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003692b4-76ac-4f10-81ee-46eb1674e7fe None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:58.538506 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16843c-84c2-414e-ab60-5586fe62bc24 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:58.549725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:58.557503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-003692b4-76ac-4f10-81ee-46eb1674e7fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:58.557503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:58.557503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:58.557503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:58.557503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:58.557503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:58.557503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:58.557503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:58.557503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:58.557503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:58.557503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:58.557503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:58.557503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:29:58.557503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:29:58.557503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:29:58.558393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:29:58.558393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:58.558393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:58.558393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:58.558393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:58.558393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:58.558393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:58.558393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:58.558393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:58.558393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:58.558393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:58.558393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:58.558393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:58.558393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:58.558393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:58.558393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:58.558393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:58.559257 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:29:58.559257 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:29:58.559257 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:29:58.559257 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:58.564601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 472/938] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:58.565598 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003692b4-76ac-4f10-81ee-46eb1674e7fe None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:58.581426 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966a87a-6b6d-4691-9a08-15e44753c741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:58.582419 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966a87a-6b6d-4691-9a08-15e44753c741 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:58.582892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966a87a-6b6d-4691-9a08-15e44753c741 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:58.583356 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966a87a-6b6d-4691-9a08-15e44753c741 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:58.584332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966a87a-6b6d-4691-9a08-15e44753c741 None admin] RBAC: Adding query filter params (interface=public, service_id=7677afec823547d78332b520bb5d28aa, region_id=RegionOne) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:58.584827 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966a87a-6b6d-4691-9a08-15e44753c741 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:58.586426 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2966a87a-6b6d-4691-9a08-15e44753c741 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:58.596998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 467/939] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jun 14 19:29:58 2022] GET /identity/v3/endpoints?service_id=7677afec823547d78332b520bb5d28aa&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:58.598143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966a87a-6b6d-4691-9a08-15e44753c741 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:58.675036 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003692b4-76ac-4f10-81ee-46eb1674e7fe None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:58.706056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966a87a-6b6d-4691-9a08-15e44753c741 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:58.712141 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c64a98-2eab-4819-97b9-a6fda3fb1f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:58.712889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c64a98-2eab-4819-97b9-a6fda3fb1f37 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:58.713263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c64a98-2eab-4819-97b9-a6fda3fb1f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:58.713646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c64a98-2eab-4819-97b9-a6fda3fb1f37 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:58.714439 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c64a98-2eab-4819-97b9-a6fda3fb1f37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:58.714816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c64a98-2eab-4819-97b9-a6fda3fb1f37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:58.716242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c64a98-2eab-4819-97b9-a6fda3fb1f37 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:58.729905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 473/940] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:58.736136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c64a98-2eab-4819-97b9-a6fda3fb1f37 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:58.745487 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9187f-f8ba-44ff-aa79-008dfb5c6ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:58.746449 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9187f-f8ba-44ff-aa79-008dfb5c6ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:58.746953 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9187f-f8ba-44ff-aa79-008dfb5c6ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:58.747416 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9187f-f8ba-44ff-aa79-008dfb5c6ee5 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:58.748327 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9187f-f8ba-44ff-aa79-008dfb5c6ee5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:58.749928 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9187f-f8ba-44ff-aa79-008dfb5c6ee5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:58.752664 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:58.765483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 468/941] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jun 14 19:29:58 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:29:58.852383 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c64a98-2eab-4819-97b9-a6fda3fb1f37 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:58.892053 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00107cc0-65af-4324-b099-d8aea4dbac3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:58.892864 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00107cc0-65af-4324-b099-d8aea4dbac3b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:58.893144 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00107cc0-65af-4324-b099-d8aea4dbac3b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:58.893443 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00107cc0-65af-4324-b099-d8aea4dbac3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:58.901502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00107cc0-65af-4324-b099-d8aea4dbac3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:58.902961 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00107cc0-65af-4324-b099-d8aea4dbac3b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:58.919173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-00107cc0-65af-4324-b099-d8aea4dbac3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:58.919173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:58.919173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:58.919173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:58.919173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:58.919173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:58.919173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:58.919173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:58.919173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:58.919173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:58.919173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:58.919173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:58.919173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:58.919173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:58.919173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:58.920110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:58.920110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:58.920110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:58.920110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:58.920110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:58.920110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:58.920110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:58.920110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:58.920110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:58.920110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:58.920110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:58.920110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:58.920110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:58.920110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:58.920110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:58.920110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:58.920110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:58.921018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:58.921018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:58.921018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:58.921018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:58.921018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:58.921018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:58.921018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:58.921018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:58.921018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 474/942] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:58.927148 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9187f-f8ba-44ff-aa79-008dfb5c6ee5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:58.971522 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:59.027959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20f4ea-c18a-4789-91c3-ec709fa685e4 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:59.028243 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20f4ea-c18a-4789-91c3-ec709fa685e4 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:59.028597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20f4ea-c18a-4789-91c3-ec709fa685e4 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:59.030038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 475/943] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:29:59.036771 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d90bf-e2d6-4c2a-94aa-60e8f430846a None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:59.037476 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d90bf-e2d6-4c2a-94aa-60e8f430846a None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:59.038210 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d90bf-e2d6-4c2a-94aa-60e8f430846a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:59.047954 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9187f-f8ba-44ff-aa79-008dfb5c6ee5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:59.060949 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-3d5d90bf-e2d6-4c2a-94aa-60e8f430846a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:29:59.064068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-3d5d90bf-e2d6-4c2a-94aa-60e8f430846a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:29:59.097618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bde238-ef66-43ef-aecc-2a1b6829171e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:59.098196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bde238-ef66-43ef-aecc-2a1b6829171e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:59.098475 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bde238-ef66-43ef-aecc-2a1b6829171e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:59.098747 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bde238-ef66-43ef-aecc-2a1b6829171e None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:59.099535 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bde238-ef66-43ef-aecc-2a1b6829171e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:59.099844 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bde238-ef66-43ef-aecc-2a1b6829171e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:59.101550 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bde238-ef66-43ef-aecc-2a1b6829171e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:59.118477 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 469/944] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:29:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:29:59.124099 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bde238-ef66-43ef-aecc-2a1b6829171e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:59.140164 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 476/945] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:29:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 19:29:59.164044 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d90bf-e2d6-4c2a-94aa-60e8f430846a None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:59.166681 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:59.229834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:59.238472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bde238-ef66-43ef-aecc-2a1b6829171e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:59.270064 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d90bf-e2d6-4c2a-94aa-60e8f430846a None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:59.276818 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03f5e9-760d-44f9-9175-fa98e6dc7953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:59.278336 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03f5e9-760d-44f9-9175-fa98e6dc7953 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:59.278833 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03f5e9-760d-44f9-9175-fa98e6dc7953 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:59.279324 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03f5e9-760d-44f9-9175-fa98e6dc7953 None admin] PATH_INFO: `/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/d16be8774cb842199cfb9e3b9965bd7c/roles/04984986168e4190919081ad55f01b76` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:59.282308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03f5e9-760d-44f9-9175-fa98e6dc7953 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d3e177b11504cb3b19d25ed5850ef12, user_id=d16be8774cb842199cfb9e3b9965bd7c, role_id=04984986168e4190919081ad55f01b76)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:59.283954 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03f5e9-760d-44f9-9175-fa98e6dc7953 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:59.300302 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 470/946] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:29:59 2022] PUT /identity/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/d16be8774cb842199cfb9e3b9965bd7c/roles/04984986168e4190919081ad55f01b76 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:29:59.314373 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f172028-00c6-46ad-bc80-9ae1cdca1ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:59.315064 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f172028-00c6-46ad-bc80-9ae1cdca1ae1 None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:59.315358 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f172028-00c6-46ad-bc80-9ae1cdca1ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:59.315695 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f172028-00c6-46ad-bc80-9ae1cdca1ae1 None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:59.316441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f172028-00c6-46ad-bc80-9ae1cdca1ae1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:59.318280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f172028-00c6-46ad-bc80-9ae1cdca1ae1 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:59.319767 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: WARNING keystone.server.flask.common [None req-8f172028-00c6-46ad-bc80-9ae1cdca1ae1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 14 19:29:59.341405 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.sql.core [None req-8f172028-00c6-46ad-bc80-9ae1cdca1ae1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 14 19:29:59.341405 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 14 19:29:59.341405 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [parameters: {'id': 'af88e740e8554158b735c66c5310b881', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 14 19:29:59.341405 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80346) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 14 19:29:59.350147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-8f172028-00c6-46ad-bc80-9ae1cdca1ae1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id af88e740e8554158b735c66c5310b881.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id af88e740e8554158b735c66c5310b881. Jun 14 19:29:59.350147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:59.350147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 14 19:29:59.350147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 14 19:29:59.350147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 14 19:29:59.350147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 14 19:29:59.350147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 14 19:29:59.350147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application result = self._query(query) Jun 14 19:29:59.350147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 14 19:29:59.350147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application conn.query(q) Jun 14 19:29:59.350147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 14 19:29:59.350147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 14 19:29:59.350147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 14 19:29:59.350994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application result.read() Jun 14 19:29:59.350994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 14 19:29:59.350994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 14 19:29:59.350994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 14 19:29:59.350994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 14 19:29:59.350994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 14 19:29:59.350994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 14 19:29:59.350994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 14 19:29:59.350994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 14 19:29:59.350994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 14 19:29:59.350994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:59.350994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 14 19:29:59.350994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:59.350994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:59.350994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 14 19:29:59.350994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 14 19:29:59.350994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 14 19:29:59.350994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 14 19:29:59.351943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 14 19:29:59.351943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application next(self.gen) Jun 14 19:29:59.351943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 14 19:29:59.351943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application yield resource Jun 14 19:29:59.351943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 14 19:29:59.351943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application next(self.gen) Jun 14 19:29:59.351943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 14 19:29:59.351943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self.session.rollback() Jun 14 19:29:59.351943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 14 19:29:59.351943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self.force_reraise() Jun 14 19:29:59.351943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 14 19:29:59.351943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise self.value Jun 14 19:29:59.351943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 14 19:29:59.351943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 14 19:29:59.351943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 14 19:29:59.351943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application session.commit() Jun 14 19:29:59.351943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 14 19:29:59.352829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 14 19:29:59.352829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 14 19:29:59.352829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._prepare_impl() Jun 14 19:29:59.352829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 14 19:29:59.352829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self.session.flush() Jun 14 19:29:59.352829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 14 19:29:59.352829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._flush(objects) Jun 14 19:29:59.352829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 14 19:29:59.352829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 14 19:29:59.352829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 14 19:29:59.352829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application compat.raise_( Jun 14 19:29:59.352829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 14 19:29:59.352829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception Jun 14 19:29:59.352829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 14 19:29:59.352829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application flush_context.execute() Jun 14 19:29:59.352829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 14 19:29:59.352829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rec.execute(self) Jun 14 19:29:59.353837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 14 19:29:59.353837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 14 19:29:59.353837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 14 19:29:59.353837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 14 19:29:59.353837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 14 19:29:59.353837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 14 19:29:59.353837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 14 19:29:59.353837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 14 19:29:59.353837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 14 19:29:59.353837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 14 19:29:59.353837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 14 19:29:59.353837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 14 19:29:59.353837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 14 19:29:59.353837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 14 19:29:59.353837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 14 19:29:59.354641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 14 19:29:59.354641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 14 19:29:59.354641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception Jun 14 19:29:59.354641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 14 19:29:59.354641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 14 19:29:59.354641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 14 19:29:59.354641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 14 19:29:59.354641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 14 19:29:59.354641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application result = self._query(query) Jun 14 19:29:59.354641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 14 19:29:59.354641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application conn.query(q) Jun 14 19:29:59.354641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 14 19:29:59.354641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 14 19:29:59.354641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 14 19:29:59.354641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application result.read() Jun 14 19:29:59.354641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 14 19:29:59.354641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 14 19:29:59.355500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 14 19:29:59.355500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 14 19:29:59.355500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 14 19:29:59.355500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 14 19:29:59.355500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 14 19:29:59.355500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 14 19:29:59.355500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 14 19:29:59.355500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 14 19:29:59.355500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [parameters: {'id': 'af88e740e8554158b735c66c5310b881', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 14 19:29:59.355500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 14 19:29:59.355500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:59.355500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:29:59.355500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:59.355500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:59.355500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 14 19:29:59.356300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 14 19:29:59.356300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 14 19:29:59.356300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 14 19:29:59.356300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 14 19:29:59.356300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:59.356300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:29:59.356300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:59.356300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:59.356300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:59.356300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:59.356300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:59.356300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:59.356300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:59.356300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:59.356300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:59.356300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:59.356300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:59.357242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:59.357242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 14 19:29:59.357242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 14 19:29:59.357242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:59.357242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:59.357242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 14 19:29:59.357242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 14 19:29:59.357242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id af88e740e8554158b735c66c5310b881. Jun 14 19:29:59.357242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:29:59.357242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 477/947] 10.222.0.44 () {60 vars in 1140 bytes} [Tue Jun 14 19:29:59 2022] POST /identity/v3/projects => generated 262 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:29:59.363273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03f5e9-760d-44f9-9175-fa98e6dc7953 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:59.470671 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03f5e9-760d-44f9-9175-fa98e6dc7953 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:59.507821 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c517f-1bf4-45e4-a0de-f0c6c384cc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:59.508623 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c517f-1bf4-45e4-a0de-f0c6c384cc40 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:59.508907 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c517f-1bf4-45e4-a0de-f0c6c384cc40 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:59.509184 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c517f-1bf4-45e4-a0de-f0c6c384cc40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:59.516647 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c517f-1bf4-45e4-a0de-f0c6c384cc40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:59.518247 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c517f-1bf4-45e4-a0de-f0c6c384cc40 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:59.533213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-500c517f-1bf4-45e4-a0de-f0c6c384cc40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:59.533213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:29:59.533213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:29:59.533213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:29:59.533213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:29:59.533213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:29:59.533213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:29:59.533213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:29:59.533213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:29:59.533213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:29:59.533213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:29:59.533213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:29:59.533213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:29:59.533213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:29:59.533213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:29:59.534202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:29:59.534202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:29:59.534202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:29:59.534202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:29:59.534202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:29:59.534202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:29:59.534202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:29:59.534202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:29:59.534202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:29:59.534202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:29:59.534202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:29:59.534202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:29:59.534202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:29:59.534202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:29:59.534202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:29:59.534202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:29:59.534202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:29:59.535119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:29:59.535119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:29:59.535119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:29:59.535119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:29:59.535119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:29:59.535119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:29:59.535119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:29:59.535119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:29:59.537585 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 471/948] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:29:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:29:59.541018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f172028-00c6-46ad-bc80-9ae1cdca1ae1 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:29:59.603508 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:29:59.653694 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f172028-00c6-46ad-bc80-9ae1cdca1ae1 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:29:59.691138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1361790c-3cb7-47eb-a3d8-a91fca888ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:29:59.691806 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361790c-3cb7-47eb-a3d8-a91fca888ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:29:59.692094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361790c-3cb7-47eb-a3d8-a91fca888ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:29:59.692374 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1361790c-3cb7-47eb-a3d8-a91fca888ef6 None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:29:59.693139 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361790c-3cb7-47eb-a3d8-a91fca888ef6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:29:59.693478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361790c-3cb7-47eb-a3d8-a91fca888ef6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:29:59.695181 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1361790c-3cb7-47eb-a3d8-a91fca888ef6 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:29:59.716704 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 478/949] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jun 14 19:29:59 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:30:00.070855 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1c22e-520d-4cde-8bee-e4addf26ef9e None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:00.071567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1c22e-520d-4cde-8bee-e4addf26ef9e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:00.072082 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1c22e-520d-4cde-8bee-e4addf26ef9e None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:00.073947 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 472/950] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:00.080244 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fde198-7f52-4c3b-b1d3-87c5d43a22ad None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:00.080806 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fde198-7f52-4c3b-b1d3-87c5d43a22ad None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:00.081291 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fde198-7f52-4c3b-b1d3-87c5d43a22ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:00.099489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-d0fde198-7f52-4c3b-b1d3-87c5d43a22ad None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:00.101327 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-d0fde198-7f52-4c3b-b1d3-87c5d43a22ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:00.176663 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 479/951] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:00.199048 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1c22e-520d-4cde-8bee-e4addf26ef9e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:00.218897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:00.309794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1c22e-520d-4cde-8bee-e4addf26ef9e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:00.351570 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd424c-d65f-4364-8599-b5ac3bbd0422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:00.352283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd424c-d65f-4364-8599-b5ac3bbd0422 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:00.352566 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd424c-d65f-4364-8599-b5ac3bbd0422 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:00.352840 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd424c-d65f-4364-8599-b5ac3bbd0422 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:00.353515 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd424c-d65f-4364-8599-b5ac3bbd0422 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:00.354877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd424c-d65f-4364-8599-b5ac3bbd0422 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:00.367141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-cdbd424c-d65f-4364-8599-b5ac3bbd0422 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 19:30:00.367141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:00.367141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:30:00.367141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:30:00.367141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:30:00.367141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:30:00.367141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:30:00.367141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:30:00.367141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 19:30:00.367141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:00.367141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:30:00.367141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:00.367141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:00.367141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:00.367141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:00.367141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:00.367141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:00.368171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:00.368171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:00.368171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:00.368171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:00.368171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:00.368171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:00.368171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:30:00.368171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:30:00.368171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:30:00.368171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:30:00.368171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:00.368171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:00.368171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:00.368171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:00.368171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:00.368171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:00.369279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:00.369279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:00.369279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:00.369279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:00.369279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:00.369279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:00.369279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:00.369279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:00.369279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:00.369279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:00.369279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:30:00.369279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:30:00.369279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 19:30:00.369279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:00.369279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 473/952] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:30:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:00.376505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fde198-7f52-4c3b-b1d3-87c5d43a22ad None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:00.426683 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:00.480661 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fde198-7f52-4c3b-b1d3-87c5d43a22ad None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:00.521025 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434dc3e-b478-4353-a5ea-b1766dfcaca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:00.521724 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434dc3e-b478-4353-a5ea-b1766dfcaca7 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:00.522011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434dc3e-b478-4353-a5ea-b1766dfcaca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:00.522293 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434dc3e-b478-4353-a5ea-b1766dfcaca7 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:00.523012 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434dc3e-b478-4353-a5ea-b1766dfcaca7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:00.523323 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434dc3e-b478-4353-a5ea-b1766dfcaca7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:00.524699 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8434dc3e-b478-4353-a5ea-b1766dfcaca7 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:00.530148 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 480/953] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jun 14 19:30:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:00.535964 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd424c-d65f-4364-8599-b5ac3bbd0422 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:00.625047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:00.645430 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd424c-d65f-4364-8599-b5ac3bbd0422 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:00.680893 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9170b-8095-4a58-823e-38d6d16e2586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:00.681927 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9170b-8095-4a58-823e-38d6d16e2586 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:00.682446 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9170b-8095-4a58-823e-38d6d16e2586 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:00.682950 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9170b-8095-4a58-823e-38d6d16e2586 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:00.683869 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9170b-8095-4a58-823e-38d6d16e2586 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:00.684379 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9170b-8095-4a58-823e-38d6d16e2586 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:00.686072 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9170b-8095-4a58-823e-38d6d16e2586 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:00.696838 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 474/954] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jun 14 19:30:00 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:01.122763 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260f598-2084-41b8-b94b-22cb11c18b59 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:01.123142 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260f598-2084-41b8-b94b-22cb11c18b59 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:01.123345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f260f598-2084-41b8-b94b-22cb11c18b59 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:01.124941 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 481/955] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:01.130145 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb9d9d-18bd-4e16-96d2-ae934b8231aa None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:01.130437 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb9d9d-18bd-4e16-96d2-ae934b8231aa None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:01.130717 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb9d9d-18bd-4e16-96d2-ae934b8231aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:01.148218 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-14fb9d9d-18bd-4e16-96d2-ae934b8231aa None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:01.149411 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-14fb9d9d-18bd-4e16-96d2-ae934b8231aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:01.220938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 475/956] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:01.243859 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260f598-2084-41b8-b94b-22cb11c18b59 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:01.359630 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f260f598-2084-41b8-b94b-22cb11c18b59 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:01.373615 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:01.400490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00735f68-f968-4292-9df0-2e95332727a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:01.401287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00735f68-f968-4292-9df0-2e95332727a8 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:01.401594 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00735f68-f968-4292-9df0-2e95332727a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:01.401866 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00735f68-f968-4292-9df0-2e95332727a8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:01.402519 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00735f68-f968-4292-9df0-2e95332727a8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:01.403879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00735f68-f968-4292-9df0-2e95332727a8 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:01.416729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-00735f68-f968-4292-9df0-2e95332727a8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 19:30:01.416729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:01.416729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:30:01.416729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:30:01.416729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:30:01.416729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:30:01.416729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:30:01.416729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:30:01.416729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 19:30:01.416729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:01.416729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:30:01.416729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:01.416729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:01.416729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:01.416729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:01.416729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:01.416729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:01.417820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:01.417820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:01.417820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:01.417820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:01.417820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:01.417820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:01.417820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:30:01.417820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:30:01.417820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:30:01.417820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:30:01.417820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:01.417820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:01.417820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:01.417820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:01.417820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:01.417820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:01.419250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:01.419250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:01.419250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:01.419250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:01.419250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:01.419250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:01.419250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:01.419250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:01.419250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:01.419250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:01.419250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:30:01.419250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:30:01.419250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 19:30:01.419250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:01.419250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 482/957] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jun 14 19:30:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:01.423855 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb9d9d-18bd-4e16-96d2-ae934b8231aa None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:01.504953 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:01.531104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb9d9d-18bd-4e16-96d2-ae934b8231aa None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:01.573619 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e080d9c2-624c-4703-9c92-32e296d36b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:01.574300 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080d9c2-624c-4703-9c92-32e296d36b57 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:01.574582 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080d9c2-624c-4703-9c92-32e296d36b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:01.574855 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e080d9c2-624c-4703-9c92-32e296d36b57 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:01.575576 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080d9c2-624c-4703-9c92-32e296d36b57 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:01.575880 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080d9c2-624c-4703-9c92-32e296d36b57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:01.577266 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e080d9c2-624c-4703-9c92-32e296d36b57 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:01.583006 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 476/958] 10.222.0.44 () {56 vars in 1122 bytes} [Tue Jun 14 19:30:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:01.588494 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00735f68-f968-4292-9df0-2e95332727a8 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:01.612575 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca261d-e900-4544-b234-c05c01a515c0 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:01.612852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca261d-e900-4544-b234-c05c01a515c0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:01.613129 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca261d-e900-4544-b234-c05c01a515c0 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:01.614530 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 477/959] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:30:01.621778 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16816107-ed51-4c93-b6f7-31a08c3d9989 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:01.622383 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16816107-ed51-4c93-b6f7-31a08c3d9989 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:01.622668 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16816107-ed51-4c93-b6f7-31a08c3d9989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:01.640531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-16816107-ed51-4c93-b6f7-31a08c3d9989 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:01.642136 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-16816107-ed51-4c93-b6f7-31a08c3d9989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:01.710995 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 478/960] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:01.724307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00735f68-f968-4292-9df0-2e95332727a8 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:01.737793 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16816107-ed51-4c93-b6f7-31a08c3d9989 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:01.766540 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3204740-a1f0-4434-b71e-0e8b5d5ed0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:01.767651 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3204740-a1f0-4434-b71e-0e8b5d5ed0bc None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:01.768049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3204740-a1f0-4434-b71e-0e8b5d5ed0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:01.768330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3204740-a1f0-4434-b71e-0e8b5d5ed0bc None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:01.769193 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3204740-a1f0-4434-b71e-0e8b5d5ed0bc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:01.769529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3204740-a1f0-4434-b71e-0e8b5d5ed0bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:01.771517 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3204740-a1f0-4434-b71e-0e8b5d5ed0bc None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:01.781544 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 483/961] 10.222.0.44 () {56 vars in 1122 bytes} [Tue Jun 14 19:30:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:01.783010 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3204740-a1f0-4434-b71e-0e8b5d5ed0bc None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:01.828464 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:01.856764 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:01.876852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16816107-ed51-4c93-b6f7-31a08c3d9989 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:01.915950 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff5613-09a0-4ea0-b248-0c858f578a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:01.916682 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff5613-09a0-4ea0-b248-0c858f578a5b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:01.917332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff5613-09a0-4ea0-b248-0c858f578a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:01.917332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff5613-09a0-4ea0-b248-0c858f578a5b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:01.928966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff5613-09a0-4ea0-b248-0c858f578a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:30:01.931924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3204740-a1f0-4434-b71e-0e8b5d5ed0bc None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:01.937291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-baff5613-09a0-4ea0-b248-0c858f578a5b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 19:30:01.937291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:01.937291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:01.937291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:01.937291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:01.937291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:01.937291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:01.937291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:01.937291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:01.937291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:01.937291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:01.937291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:01.937291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:30:01.937291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:30:01.937291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:30:01.937291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:30:01.938294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:30:01.938294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:30:01.938294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:30:01.938294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:30:01.938294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:01.938294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:01.938294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:01.938294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:01.938294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:01.938294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:01.938294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:01.938294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:01.938294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:01.938294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:01.938294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:01.938294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:01.939118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:01.939118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:01.939118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:01.939118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:01.939118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:30:01.939118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:30:01.939118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:30:01.939118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:30:01.939118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:30:01.939118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:30:01.939118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 19:30:01.939118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:01.941778 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 479/962] 10.222.0.44 () {56 vars in 1120 bytes} [Tue Jun 14 19:30:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:30:01.943407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0947f59-91c4-4dce-b5f0-499c8950f5d7 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:01.944149 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0947f59-91c4-4dce-b5f0-499c8950f5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:01.944640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0947f59-91c4-4dce-b5f0-499c8950f5d7 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:01.946106 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 480/963] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:01.950498 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0947f59-91c4-4dce-b5f0-499c8950f5d7 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:01.968218 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec1bc2-97e4-42e8-9cbd-fb692bd241a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:01.969427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec1bc2-97e4-42e8-9cbd-fb692bd241a6 None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:01.969722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec1bc2-97e4-42e8-9cbd-fb692bd241a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:01.970002 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec1bc2-97e4-42e8-9cbd-fb692bd241a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:01.970751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec1bc2-97e4-42e8-9cbd-fb692bd241a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:01.972124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec1bc2-97e4-42e8-9cbd-fb692bd241a6 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:01.997758 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 484/964] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jun 14 19:30:01 2022] POST /identity/v3/endpoints => generated 349 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:30:01.997758 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc14b8-133e-4047-99ba-c6a2860879d5 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:01.997758 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc14b8-133e-4047-99ba-c6a2860879d5 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:01.997758 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc14b8-133e-4047-99ba-c6a2860879d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:02.011310 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-94bc14b8-133e-4047-99ba-c6a2860879d5 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:02.012631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-94bc14b8-133e-4047-99ba-c6a2860879d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:02.101435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 485/965] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:02.103656 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0947f59-91c4-4dce-b5f0-499c8950f5d7 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:02.124608 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc14b8-133e-4047-99ba-c6a2860879d5 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:02.142128 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:02.151546 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:02.154475 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050e13b-8057-4565-b7cb-87a1e0349e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:02.156848 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050e13b-8057-4565-b7cb-87a1e0349e82 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:02.157275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050e13b-8057-4565-b7cb-87a1e0349e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:02.157736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050e13b-8057-4565-b7cb-87a1e0349e82 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:02.159404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050e13b-8057-4565-b7cb-87a1e0349e82 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:02.160361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050e13b-8057-4565-b7cb-87a1e0349e82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:02.162547 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050e13b-8057-4565-b7cb-87a1e0349e82 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:02.177866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 481/966] 10.222.0.44 () {56 vars in 1115 bytes} [Tue Jun 14 19:30:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:02.185539 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050e13b-8057-4565-b7cb-87a1e0349e82 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:02.251598 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc14b8-133e-4047-99ba-c6a2860879d5 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:02.298408 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c92dd9-6182-4ede-8faf-1fd22c48c1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:02.299085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c92dd9-6182-4ede-8faf-1fd22c48c1ac None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:02.299367 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c92dd9-6182-4ede-8faf-1fd22c48c1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:02.299575 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050e13b-8057-4565-b7cb-87a1e0349e82 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:02.299698 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c92dd9-6182-4ede-8faf-1fd22c48c1ac None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:02.300332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c92dd9-6182-4ede-8faf-1fd22c48c1ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:02.302730 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c92dd9-6182-4ede-8faf-1fd22c48c1ac None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:02.321989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.sql.core [None req-d8c92dd9-6182-4ede-8faf-1fd22c48c1ac None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 14 19:30:02.321989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 14 19:30:02.321989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [parameters: {'user_id': '170ae46ac417465b8b1bb1818d4154ba', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 14 19:30:02.321989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80346) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 14 19:30:02.334658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-d8c92dd9-6182-4ede-8faf-1fd22c48c1ac None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 14 19:30:02.334658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:02.334658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 14 19:30:02.334658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 14 19:30:02.334658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 14 19:30:02.334658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 14 19:30:02.334658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 14 19:30:02.334658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application result = self._query(query) Jun 14 19:30:02.334658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 14 19:30:02.334658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application conn.query(q) Jun 14 19:30:02.334658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 14 19:30:02.334658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 14 19:30:02.334658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 14 19:30:02.334658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application result.read() Jun 14 19:30:02.334658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 14 19:30:02.335552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 14 19:30:02.335552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 14 19:30:02.335552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 14 19:30:02.335552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 14 19:30:02.335552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 14 19:30:02.335552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 14 19:30:02.335552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 14 19:30:02.335552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 14 19:30:02.335552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:02.335552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 14 19:30:02.335552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:02.335552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:02.335552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 14 19:30:02.335552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 14 19:30:02.335552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 14 19:30:02.335552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 14 19:30:02.335552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 14 19:30:02.335552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application next(self.gen) Jun 14 19:30:02.336492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 14 19:30:02.336492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application yield resource Jun 14 19:30:02.336492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 14 19:30:02.336492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application next(self.gen) Jun 14 19:30:02.336492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 14 19:30:02.336492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self.session.rollback() Jun 14 19:30:02.336492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 14 19:30:02.336492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self.force_reraise() Jun 14 19:30:02.336492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 14 19:30:02.336492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise self.value Jun 14 19:30:02.336492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 14 19:30:02.336492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 14 19:30:02.336492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 14 19:30:02.336492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application session.commit() Jun 14 19:30:02.336492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 14 19:30:02.336492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 14 19:30:02.336492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 14 19:30:02.338167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._prepare_impl() Jun 14 19:30:02.338167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 14 19:30:02.338167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self.session.flush() Jun 14 19:30:02.338167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 14 19:30:02.338167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._flush(objects) Jun 14 19:30:02.338167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 14 19:30:02.338167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 14 19:30:02.338167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 14 19:30:02.338167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application compat.raise_( Jun 14 19:30:02.338167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 14 19:30:02.338167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception Jun 14 19:30:02.338167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 14 19:30:02.338167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application flush_context.execute() Jun 14 19:30:02.338167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 14 19:30:02.338167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rec.execute(self) Jun 14 19:30:02.338167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 14 19:30:02.338167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 14 19:30:02.340717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 14 19:30:02.340717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 14 19:30:02.340717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 14 19:30:02.340717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 14 19:30:02.340717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 14 19:30:02.340717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 14 19:30:02.340717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 14 19:30:02.340717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 14 19:30:02.340717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 14 19:30:02.340717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 14 19:30:02.340717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 14 19:30:02.340717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 14 19:30:02.340717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 14 19:30:02.340717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 14 19:30:02.340717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 14 19:30:02.340717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception Jun 14 19:30:02.345854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 14 19:30:02.345854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 14 19:30:02.345854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 14 19:30:02.345854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 14 19:30:02.345854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 14 19:30:02.345854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application result = self._query(query) Jun 14 19:30:02.345854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 14 19:30:02.345854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application conn.query(q) Jun 14 19:30:02.345854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 14 19:30:02.345854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 14 19:30:02.345854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 14 19:30:02.345854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application result.read() Jun 14 19:30:02.345854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 14 19:30:02.345854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 14 19:30:02.345854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 14 19:30:02.345854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 14 19:30:02.346703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 14 19:30:02.346703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 14 19:30:02.346703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 14 19:30:02.346703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 14 19:30:02.346703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 14 19:30:02.346703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 14 19:30:02.346703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [parameters: {'user_id': '170ae46ac417465b8b1bb1818d4154ba', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 14 19:30:02.346703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 14 19:30:02.346703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:02.346703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:30:02.346703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:02.346703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:02.346703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:02.346703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:02.346703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:02.347478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:02.347478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:02.347478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:02.347478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:02.347478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:02.347478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:02.347478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:02.347478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 14 19:30:02.347478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 14 19:30:02.347478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:02.347478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:02.347478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:30:02.347478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:30:02.347478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:30:02.347478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:30:02.347478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 14 19:30:02.347478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 14 19:30:02.348387 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 14 19:30:02.348387 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 14 19:30:02.348387 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 14 19:30:02.348387 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 14 19:30:02.348387 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 14 19:30:02.348387 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:02.348387 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 486/967] 10.222.0.44 () {60 vars in 1131 bytes} [Tue Jun 14 19:30:02 2022] POST /identity/v3/users => generated 160 bytes in 213 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:30:02.348770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435094b-6b8d-4c26-95b4-924363109b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:02.348770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435094b-6b8d-4c26-95b4-924363109b79 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:02.348770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435094b-6b8d-4c26-95b4-924363109b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:02.348984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c92dd9-6182-4ede-8faf-1fd22c48c1ac None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:02.349073 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435094b-6b8d-4c26-95b4-924363109b79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:02.367025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435094b-6b8d-4c26-95b4-924363109b79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:02.370336 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435094b-6b8d-4c26-95b4-924363109b79 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:02.404289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-4435094b-6b8d-4c26-95b4-924363109b79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:30:02.404289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:02.404289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:02.404289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:02.404289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:02.404289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:02.404289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:02.404289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:02.404289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:02.404289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:02.404289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:02.404289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:02.404289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:30:02.404289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:30:02.404289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:30:02.406938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:30:02.406938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:02.406938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:02.406938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:02.406938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:02.406938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:02.406938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:02.406938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:02.406938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:02.406938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:02.406938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:02.406938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:02.406938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:02.406938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:02.406938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:02.406938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:02.406938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:02.408712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:30:02.408712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:30:02.408712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:30:02.408712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:02.412658 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 482/968] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:02.419379 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435094b-6b8d-4c26-95b4-924363109b79 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:02.472110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:02.481309 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:02.495162 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c92dd9-6182-4ede-8faf-1fd22c48c1ac None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:02.535297 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e4be1-1af3-4b4a-80e1-f7868a4a6a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:02.536750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e4be1-1af3-4b4a-80e1-f7868a4a6a57 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:02.537239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e4be1-1af3-4b4a-80e1-f7868a4a6a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:02.537787 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e4be1-1af3-4b4a-80e1-f7868a4a6a57 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:02.547620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e4be1-1af3-4b4a-80e1-f7868a4a6a57 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:02.549890 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e4be1-1af3-4b4a-80e1-f7868a4a6a57 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:02.561522 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435094b-6b8d-4c26-95b4-924363109b79 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:02.568306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-194e4be1-1af3-4b4a-80e1-f7868a4a6a57 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 19:30:02.568306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:02.568306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:02.568306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:02.568306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:02.568306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:02.568306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:02.568306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:02.568306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:02.568306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:02.568306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:02.568306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:02.568306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:30:02.568306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:30:02.568306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:30:02.568306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:30:02.569221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:02.569221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:02.569221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:30:02.569221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:30:02.569221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:30:02.569221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:30:02.569221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:02.569221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:02.569221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:02.569221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:02.569221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:02.569221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:02.569221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:02.569221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:02.569221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:02.569221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:02.569221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:02.569221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:02.570500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:02.570500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:02.570500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:30:02.570500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:30:02.570500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:30:02.570500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:30:02.570500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:30:02.570500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:30:02.570500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 14 19:30:02.570500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:02.577481 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 487/969] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:30:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:30:02.579235 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e4be1-1af3-4b4a-80e1-f7868a4a6a57 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:02.600623 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493a855-cf37-4bc9-a4a0-7bfe833682ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:02.601295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493a855-cf37-4bc9-a4a0-7bfe833682ef None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:02.601609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493a855-cf37-4bc9-a4a0-7bfe833682ef None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:02.601923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493a855-cf37-4bc9-a4a0-7bfe833682ef None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:02.602658 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493a855-cf37-4bc9-a4a0-7bfe833682ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:02.602964 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493a855-cf37-4bc9-a4a0-7bfe833682ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:02.604395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493a855-cf37-4bc9-a4a0-7bfe833682ef None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:02.625455 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 483/970] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:02.628866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493a855-cf37-4bc9-a4a0-7bfe833682ef None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:02.696343 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e4be1-1af3-4b4a-80e1-f7868a4a6a57 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:02.732716 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e1375-63ef-4159-9db7-9d503194ebc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:02.733584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e1375-63ef-4159-9db7-9d503194ebc8 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:02.733697 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e1375-63ef-4159-9db7-9d503194ebc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:02.733939 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e1375-63ef-4159-9db7-9d503194ebc8 None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:02.734787 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e1375-63ef-4159-9db7-9d503194ebc8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:02.735096 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e1375-63ef-4159-9db7-9d503194ebc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:02.736596 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e1375-63ef-4159-9db7-9d503194ebc8 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:02.763010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493a855-cf37-4bc9-a4a0-7bfe833682ef None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:02.764873 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:02.785852 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 488/971] 10.222.0.44 () {56 vars in 1101 bytes} [Tue Jun 14 19:30:02 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:02.804207 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5376e04-2c3c-41bb-a5eb-d555910c2ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:02.805513 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5376e04-2c3c-41bb-a5eb-d555910c2ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:02.806007 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5376e04-2c3c-41bb-a5eb-d555910c2ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:02.806503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5376e04-2c3c-41bb-a5eb-d555910c2ad6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:02.816538 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5376e04-2c3c-41bb-a5eb-d555910c2ad6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:02.818431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5376e04-2c3c-41bb-a5eb-d555910c2ad6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:02.838065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-f5376e04-2c3c-41bb-a5eb-d555910c2ad6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 19:30:02.838065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:02.838065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:02.838065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:02.838065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:02.838065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:02.838065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:02.838065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:02.838065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:02.838065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:02.838065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:02.838065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:02.838065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:30:02.838065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:30:02.838065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:30:02.838065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:30:02.839074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:02.839074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:02.839074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:30:02.839074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:30:02.839074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:30:02.839074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:30:02.839074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:02.839074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:02.839074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:02.839074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:02.839074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:02.839074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:02.839074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:02.839074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:02.839074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:02.839074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:02.839074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:02.839074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:02.840003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:02.840003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:02.840003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:30:02.840003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:30:02.840003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:30:02.840003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:30:02.840003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:30:02.840003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:30:02.840003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 14 19:30:02.840003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:02.842992 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 484/972] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jun 14 19:30:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:02.850143 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e1375-63ef-4159-9db7-9d503194ebc8 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:02.853464 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:02.894132 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc537d-d476-4c53-ae56-cb078232a693 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:02.894760 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc537d-d476-4c53-ae56-cb078232a693 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:02.895238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc537d-d476-4c53-ae56-cb078232a693 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:02.897113 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 485/973] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:02.902850 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803bf7f-4576-4460-a005-1116170b5975 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:02.903515 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803bf7f-4576-4460-a005-1116170b5975 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:02.903995 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803bf7f-4576-4460-a005-1116170b5975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:02.923099 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b803bf7f-4576-4460-a005-1116170b5975 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:02.924830 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b803bf7f-4576-4460-a005-1116170b5975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:02.970990 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e1375-63ef-4159-9db7-9d503194ebc8 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:03.009517 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 486/974] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:03.014081 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41171a-6a58-4e82-baa2-cd29a9f6e419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:03.014754 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41171a-6a58-4e82-baa2-cd29a9f6e419 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:03.015040 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41171a-6a58-4e82-baa2-cd29a9f6e419 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:03.015380 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41171a-6a58-4e82-baa2-cd29a9f6e419 None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:03.016800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41171a-6a58-4e82-baa2-cd29a9f6e419 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:03.017115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41171a-6a58-4e82-baa2-cd29a9f6e419 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:03.018605 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41171a-6a58-4e82-baa2-cd29a9f6e419 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:03.027802 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803bf7f-4576-4460-a005-1116170b5975 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:03.037960 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 489/975] 10.222.0.44 () {56 vars in 1149 bytes} [Tue Jun 14 19:30:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:03.044065 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41171a-6a58-4e82-baa2-cd29a9f6e419 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:03.108717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:03.137723 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:03.148500 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803bf7f-4576-4460-a005-1116170b5975 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:03.154107 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41171a-6a58-4e82-baa2-cd29a9f6e419 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:03.185815 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2daac6-7311-4154-8836-22e11629499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:03.186799 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2daac6-7311-4154-8836-22e11629499b None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:03.187261 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2daac6-7311-4154-8836-22e11629499b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:03.188336 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2daac6-7311-4154-8836-22e11629499b None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:03.189236 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2daac6-7311-4154-8836-22e11629499b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:03.191025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2daac6-7311-4154-8836-22e11629499b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:03.191500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6cd58-307e-4b4f-9214-120758f99eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:03.192152 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6cd58-307e-4b4f-9214-120758f99eda None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:03.192440 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6cd58-307e-4b4f-9214-120758f99eda None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:03.192719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6cd58-307e-4b4f-9214-120758f99eda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:03.209988 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 487/976] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jun 14 19:30:03 2022] POST /identity/v3/services => generated 242 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:30:03.276943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6cd58-307e-4b4f-9214-120758f99eda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:03.278358 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6cd58-307e-4b4f-9214-120758f99eda None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:03.344252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:03.389558 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 490/977] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:30:03 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 14 19:30:03.395760 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2daac6-7311-4154-8836-22e11629499b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:03.502810 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2daac6-7311-4154-8836-22e11629499b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:03.535733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f35b5-b229-4e62-b6c5-e63e5cee75df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:03.536439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f35b5-b229-4e62-b6c5-e63e5cee75df None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:03.536739 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f35b5-b229-4e62-b6c5-e63e5cee75df None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:03.537011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f35b5-b229-4e62-b6c5-e63e5cee75df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:03.549310 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f35b5-b229-4e62-b6c5-e63e5cee75df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:03.550784 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f35b5-b229-4e62-b6c5-e63e5cee75df None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:03.559024 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:03.570611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-f26f35b5-b229-4e62-b6c5-e63e5cee75df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:30:03.570611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:03.570611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:03.570611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:03.570611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:03.570611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:03.570611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:03.570611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:03.570611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:03.570611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:03.570611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:03.570611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:03.570611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:30:03.570611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:30:03.570611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:30:03.571561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:30:03.571561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:03.571561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:03.571561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:03.571561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:03.571561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:03.571561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:03.571561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:03.571561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:03.571561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:03.571561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:03.571561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:03.571561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:03.571561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:03.571561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:03.571561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:03.571561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:03.572421 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:30:03.572421 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:30:03.572421 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:30:03.572421 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:03.572421 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 488/978] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:30:03.578208 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6cd58-307e-4b4f-9214-120758f99eda None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:03.681457 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6cd58-307e-4b4f-9214-120758f99eda None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:03.715834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d05951-b0cd-4d28-b4c0-bb578292afb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:03.716496 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d05951-b0cd-4d28-b4c0-bb578292afb7 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:03.716783 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d05951-b0cd-4d28-b4c0-bb578292afb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:03.717059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d05951-b0cd-4d28-b4c0-bb578292afb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:03.717811 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d05951-b0cd-4d28-b4c0-bb578292afb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:03.718122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d05951-b0cd-4d28-b4c0-bb578292afb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:03.719522 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d05951-b0cd-4d28-b4c0-bb578292afb7 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:03.732442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 491/979] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:03.738625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f35b5-b229-4e62-b6c5-e63e5cee75df None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:03.849668 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f35b5-b229-4e62-b6c5-e63e5cee75df None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:03.885855 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4166b1b-1776-4fa5-95bb-841124a35e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:03.886653 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4166b1b-1776-4fa5-95bb-841124a35e66 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:03.886937 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4166b1b-1776-4fa5-95bb-841124a35e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:03.887212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4166b1b-1776-4fa5-95bb-841124a35e66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:03.894333 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4166b1b-1776-4fa5-95bb-841124a35e66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:03.895787 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4166b1b-1776-4fa5-95bb-841124a35e66 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:03.909713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-a4166b1b-1776-4fa5-95bb-841124a35e66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:30:03.909713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:03.909713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:03.909713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:03.909713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:03.909713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:03.909713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:03.909713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:03.909713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:03.909713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:03.909713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:03.909713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:03.909713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:30:03.909713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:30:03.909713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:30:03.910606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:30:03.910606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:03.910606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:03.910606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:03.910606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:03.910606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:03.910606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:03.910606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:03.910606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:03.910606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:03.910606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:03.910606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:03.910606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:03.910606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:03.910606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:03.910606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:03.910606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:03.911482 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:30:03.911482 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:30:03.911482 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:30:03.911482 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:30:03.911482 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:30:03.911482 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:30:03.911482 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:30:03.911482 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:03.911482 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 489/980] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:30:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:03.917922 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d05951-b0cd-4d28-b4c0-bb578292afb7 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:03.942250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:04.022057 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d05951-b0cd-4d28-b4c0-bb578292afb7 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:04.055826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b3517-f0bb-4d21-b497-927e8462e051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:04.056491 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b3517-f0bb-4d21-b497-927e8462e051 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:04.056776 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b3517-f0bb-4d21-b497-927e8462e051 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:04.057058 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b3517-f0bb-4d21-b497-927e8462e051 None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:04.057875 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b3517-f0bb-4d21-b497-927e8462e051 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:04.058190 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b3517-f0bb-4d21-b497-927e8462e051 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:04.059620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b3517-f0bb-4d21-b497-927e8462e051 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:04.072749 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 492/981] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:30:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:04.078470 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4166b1b-1776-4fa5-95bb-841124a35e66 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:04.138008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:04.181362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4166b1b-1776-4fa5-95bb-841124a35e66 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:04.217445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6630f87-dd96-48a5-8306-cde0487b5462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:04.218132 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6630f87-dd96-48a5-8306-cde0487b5462 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:04.218418 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6630f87-dd96-48a5-8306-cde0487b5462 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:04.219300 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6630f87-dd96-48a5-8306-cde0487b5462 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:04.220187 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6630f87-dd96-48a5-8306-cde0487b5462 None admin] RBAC: Adding query filter params (role.id=04984986168e4190919081ad55f01b76, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=d16be8774cb842199cfb9e3b9965bd7c) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:04.220506 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6630f87-dd96-48a5-8306-cde0487b5462 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:04.222022 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6630f87-dd96-48a5-8306-cde0487b5462 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:04.229099 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 490/982] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:30:04 2022] GET /identity/v3/role_assignments?user.id=d16be8774cb842199cfb9e3b9965bd7c&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=04984986168e4190919081ad55f01b76 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:30:04.270254 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623c628-1eb2-418a-98e0-4f9de415fa85 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:04.270565 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623c628-1eb2-418a-98e0-4f9de415fa85 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:04.270820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623c628-1eb2-418a-98e0-4f9de415fa85 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:04.272363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 493/983] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:04.277960 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28deb76-43d2-4d45-ad2c-a64a7dfab87d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:04.278249 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28deb76-43d2-4d45-ad2c-a64a7dfab87d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:04.278537 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28deb76-43d2-4d45-ad2c-a64a7dfab87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:04.297735 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d28deb76-43d2-4d45-ad2c-a64a7dfab87d None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:04.299078 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d28deb76-43d2-4d45-ad2c-a64a7dfab87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:04.371503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 491/984] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:04.396630 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623c628-1eb2-418a-98e0-4f9de415fa85 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:04.485970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:04.507658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623c628-1eb2-418a-98e0-4f9de415fa85 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:04.543557 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9413e2-4393-4a27-bf7d-3812d2306a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:04.544479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9413e2-4393-4a27-bf7d-3812d2306a01 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:04.544824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9413e2-4393-4a27-bf7d-3812d2306a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:04.545048 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9413e2-4393-4a27-bf7d-3812d2306a01 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:04.545787 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9413e2-4393-4a27-bf7d-3812d2306a01 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:04.547816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9413e2-4393-4a27-bf7d-3812d2306a01 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:04.559967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-1e9413e2-4393-4a27-bf7d-3812d2306a01 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 19:30:04.559967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:04.559967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:30:04.559967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:30:04.559967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:30:04.559967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:30:04.559967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:30:04.559967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:30:04.559967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 19:30:04.559967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:04.559967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:30:04.559967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:04.559967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:04.559967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:04.559967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:04.559967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:04.559967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:04.561028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:04.561028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:04.561028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:04.561028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:04.561028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:04.561028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:04.561028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:30:04.561028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:30:04.561028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:30:04.561028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:30:04.561028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:04.561028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:04.561028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:04.561028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:04.561028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:04.561028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:04.562336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:04.562336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:04.562336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:04.562336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:04.562336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:04.562336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:04.562336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:04.562336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:04.562336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:04.562336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:04.562336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:30:04.562336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:30:04.562336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 19:30:04.562336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:04.562336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 494/985] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jun 14 19:30:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:04.569016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28deb76-43d2-4d45-ad2c-a64a7dfab87d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:04.624024 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:04.670471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28deb76-43d2-4d45-ad2c-a64a7dfab87d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:04.705129 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1a8cc-7d40-42b4-87a5-72608554c5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:04.705825 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1a8cc-7d40-42b4-87a5-72608554c5ac None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:04.706111 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1a8cc-7d40-42b4-87a5-72608554c5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:04.706389 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1a8cc-7d40-42b4-87a5-72608554c5ac None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:04.707116 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1a8cc-7d40-42b4-87a5-72608554c5ac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:04.707425 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1a8cc-7d40-42b4-87a5-72608554c5ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:04.708798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1a8cc-7d40-42b4-87a5-72608554c5ac None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:04.717478 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 492/986] 10.222.0.44 () {56 vars in 1122 bytes} [Tue Jun 14 19:30:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:04.721259 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9413e2-4393-4a27-bf7d-3812d2306a01 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:04.829503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9413e2-4393-4a27-bf7d-3812d2306a01 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:04.864359 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4a991-81dc-4406-a2bb-5b079653e856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:04.865018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4a991-81dc-4406-a2bb-5b079653e856 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:04.865304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4a991-81dc-4406-a2bb-5b079653e856 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:04.865612 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4a991-81dc-4406-a2bb-5b079653e856 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:04.866315 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4a991-81dc-4406-a2bb-5b079653e856 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:04.866622 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4a991-81dc-4406-a2bb-5b079653e856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:04.867982 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4a991-81dc-4406-a2bb-5b079653e856 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:04.877531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 495/987] 10.222.0.44 () {56 vars in 1122 bytes} [Tue Jun 14 19:30:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:04.879361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1a8cc-7d40-42b4-87a5-72608554c5ac None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:04.982506 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1a8cc-7d40-42b4-87a5-72608554c5ac None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:05.000305 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:05.018885 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca0d1f-7478-4750-b2bc-533705ad3912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:05.019634 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca0d1f-7478-4750-b2bc-533705ad3912 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:05.019991 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca0d1f-7478-4750-b2bc-533705ad3912 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:05.020337 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca0d1f-7478-4750-b2bc-533705ad3912 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:05.021210 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca0d1f-7478-4750-b2bc-533705ad3912 None admin] RBAC: Adding query filter params (interface=admin, service_id=7677afec823547d78332b520bb5d28aa, region_id=RegionOne) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:05.021620 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca0d1f-7478-4750-b2bc-533705ad3912 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:05.023058 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca0d1f-7478-4750-b2bc-533705ad3912 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:05.032881 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 493/988] 10.222.0.44 () {56 vars in 1249 bytes} [Tue Jun 14 19:30:04 2022] GET /identity/v3/endpoints?service_id=7677afec823547d78332b520bb5d28aa&interface=admin®ion_id=RegionOne => generated 193 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:05.034376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4a991-81dc-4406-a2bb-5b079653e856 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:05.050899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:05.144435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4a991-81dc-4406-a2bb-5b079653e856 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:05.177912 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa0e52-52bb-4fa2-ba53-97c99a920a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:05.178575 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa0e52-52bb-4fa2-ba53-97c99a920a78 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:05.178875 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa0e52-52bb-4fa2-ba53-97c99a920a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:05.179139 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa0e52-52bb-4fa2-ba53-97c99a920a78 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:05.179819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa0e52-52bb-4fa2-ba53-97c99a920a78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:05.181175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa0e52-52bb-4fa2-ba53-97c99a920a78 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:05.193464 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 496/989] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jun 14 19:30:05 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:30:05.436451 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902eb44e-a075-4e3b-b8d3-cb4a0236ad65 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:05.436747 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902eb44e-a075-4e3b-b8d3-cb4a0236ad65 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:05.436947 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902eb44e-a075-4e3b-b8d3-cb4a0236ad65 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:05.438722 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 494/990] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:05.443692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07d389-29cf-4977-9f11-a741e8082fc0 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:05.443980 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07d389-29cf-4977-9f11-a741e8082fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:05.444256 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb07d389-29cf-4977-9f11-a741e8082fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:05.461648 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-fb07d389-29cf-4977-9f11-a741e8082fc0 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:05.463129 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-fb07d389-29cf-4977-9f11-a741e8082fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:05.530436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 497/991] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:05.554408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902eb44e-a075-4e3b-b8d3-cb4a0236ad65 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:05.654781 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902eb44e-a075-4e3b-b8d3-cb4a0236ad65 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:05.690413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab1bb8-ee30-442e-b6e2-96d2146c7a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:05.691135 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab1bb8-ee30-442e-b6e2-96d2146c7a82 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:05.691420 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab1bb8-ee30-442e-b6e2-96d2146c7a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:05.691698 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab1bb8-ee30-442e-b6e2-96d2146c7a82 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:05.692349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab1bb8-ee30-442e-b6e2-96d2146c7a82 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:05.693773 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab1bb8-ee30-442e-b6e2-96d2146c7a82 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:05.706240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-06ab1bb8-ee30-442e-b6e2-96d2146c7a82 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 19:30:05.706240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:05.706240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:30:05.706240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:30:05.706240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:30:05.706240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:30:05.706240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:30:05.706240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:30:05.706240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 19:30:05.706240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:05.706240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:30:05.706240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:05.706240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:05.706240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:05.706240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:05.706240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:05.706240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:05.707208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:05.707208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:05.707208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:05.707208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:05.707208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:05.707208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:05.707208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:30:05.707208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:30:05.707208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:30:05.707208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:30:05.707208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:05.707208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:05.707208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:05.707208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:05.707208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:05.707208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:05.708051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:05.708051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:05.708051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:05.708051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:05.708051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:05.708051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:05.708051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:05.708051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:05.708051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:05.708051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:05.708051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:30:05.708051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:30:05.708051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 19:30:05.708051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:05.708051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 495/992] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:30:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:05.714675 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07d389-29cf-4977-9f11-a741e8082fc0 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:05.716840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:05.823854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb07d389-29cf-4977-9f11-a741e8082fc0 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:05.862943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d6edc-23d3-4371-9da9-ccf8ce5d7200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:05.863613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d6edc-23d3-4371-9da9-ccf8ce5d7200 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:05.863897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d6edc-23d3-4371-9da9-ccf8ce5d7200 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:05.864171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d6edc-23d3-4371-9da9-ccf8ce5d7200 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:05.864881 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d6edc-23d3-4371-9da9-ccf8ce5d7200 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:05.865189 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d6edc-23d3-4371-9da9-ccf8ce5d7200 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:05.866598 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d6edc-23d3-4371-9da9-ccf8ce5d7200 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:05.876753 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 498/993] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jun 14 19:30:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:05.877715 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab1bb8-ee30-442e-b6e2-96d2146c7a82 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:05.926562 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:05.981819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab1bb8-ee30-442e-b6e2-96d2146c7a82 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:06.015307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5551b4-1e82-40d8-94a5-52a6b9969a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:06.016493 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5551b4-1e82-40d8-94a5-52a6b9969a33 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:06.016773 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5551b4-1e82-40d8-94a5-52a6b9969a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:06.017045 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5551b4-1e82-40d8-94a5-52a6b9969a33 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:06.017768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5551b4-1e82-40d8-94a5-52a6b9969a33 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:06.018075 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5551b4-1e82-40d8-94a5-52a6b9969a33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:06.019440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5551b4-1e82-40d8-94a5-52a6b9969a33 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:06.028828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 496/994] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jun 14 19:30:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:06.030106 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d6edc-23d3-4371-9da9-ccf8ce5d7200 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:06.097100 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:06.131619 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d6edc-23d3-4371-9da9-ccf8ce5d7200 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:06.165822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12be73-a9a9-453e-8f4a-409cf63ad089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:06.166475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12be73-a9a9-453e-8f4a-409cf63ad089 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:06.166759 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12be73-a9a9-453e-8f4a-409cf63ad089 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:06.167037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12be73-a9a9-453e-8f4a-409cf63ad089 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:06.167820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12be73-a9a9-453e-8f4a-409cf63ad089 None admin] RBAC: Adding query filter params (interface=public, service_id=78baf4f7d36f48ea8fa6da18053652e6, region_id=RegionOne) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:06.168136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12be73-a9a9-453e-8f4a-409cf63ad089 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:06.169519 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d12be73-a9a9-453e-8f4a-409cf63ad089 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:06.179090 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 499/995] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jun 14 19:30:06 2022] GET /identity/v3/endpoints?service_id=78baf4f7d36f48ea8fa6da18053652e6&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:06.180271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5551b4-1e82-40d8-94a5-52a6b9969a33 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:06.282102 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5551b4-1e82-40d8-94a5-52a6b9969a33 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:06.293891 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:06.318721 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a014e0d-60f8-4ddc-b877-650bb3dfd089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:06.319405 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a014e0d-60f8-4ddc-b877-650bb3dfd089 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:06.319689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a014e0d-60f8-4ddc-b877-650bb3dfd089 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:06.319962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a014e0d-60f8-4ddc-b877-650bb3dfd089 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:06.320657 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a014e0d-60f8-4ddc-b877-650bb3dfd089 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:06.322101 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a014e0d-60f8-4ddc-b877-650bb3dfd089 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:06.329988 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 497/996] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jun 14 19:30:06 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:30:06.395849 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacdf49-5c32-431d-8f2e-5dd243a1047f None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:06.396184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacdf49-5c32-431d-8f2e-5dd243a1047f None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:06.396415 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacdf49-5c32-431d-8f2e-5dd243a1047f None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:06.398071 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 500/997] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:06.403681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c307a8c-89b1-4ace-98c5-e24d203f635c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:06.403981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c307a8c-89b1-4ace-98c5-e24d203f635c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:06.404248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c307a8c-89b1-4ace-98c5-e24d203f635c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:06.424294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-4c307a8c-89b1-4ace-98c5-e24d203f635c None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:06.425540 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4c307a8c-89b1-4ace-98c5-e24d203f635c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:06.506657 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 498/998] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:06.528506 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacdf49-5c32-431d-8f2e-5dd243a1047f None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:06.633884 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacdf49-5c32-431d-8f2e-5dd243a1047f None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:06.662418 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:06.669840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73ee0b-c5a2-4d91-a86d-7e64c9348ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:06.670631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73ee0b-c5a2-4d91-a86d-7e64c9348ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:06.670914 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73ee0b-c5a2-4d91-a86d-7e64c9348ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:06.671195 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73ee0b-c5a2-4d91-a86d-7e64c9348ce4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:06.672395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73ee0b-c5a2-4d91-a86d-7e64c9348ce4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:06.673769 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73ee0b-c5a2-4d91-a86d-7e64c9348ce4 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:06.685330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-ee73ee0b-c5a2-4d91-a86d-7e64c9348ce4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 19:30:06.685330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:06.685330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:30:06.685330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:30:06.685330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:30:06.685330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:30:06.685330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:30:06.685330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:30:06.685330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 19:30:06.685330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:06.685330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:30:06.685330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:06.685330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:06.685330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:06.685330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:06.685330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:06.685330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:06.686395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:06.686395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:06.686395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:06.686395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:06.686395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:06.686395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:06.686395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:30:06.686395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:30:06.686395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:30:06.686395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:30:06.686395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:06.686395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:06.686395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:06.686395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:06.686395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:06.686395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:06.687220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:06.687220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:06.687220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:06.687220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:06.687220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:06.687220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:06.687220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:06.687220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:06.687220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:06.687220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:06.687220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:30:06.687220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:30:06.687220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 19:30:06.687220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:06.687220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 501/999] 10.222.0.44 () {56 vars in 1105 bytes} [Tue Jun 14 19:30:06 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:06.694603 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c307a8c-89b1-4ace-98c5-e24d203f635c None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:06.797635 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c307a8c-89b1-4ace-98c5-e24d203f635c None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:06.800035 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:06.839309 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0e86c-d07e-47c0-8bbf-ff4b92ee76fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:06.839976 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0e86c-d07e-47c0-8bbf-ff4b92ee76fd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:06.840261 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0e86c-d07e-47c0-8bbf-ff4b92ee76fd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:06.840536 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0e86c-d07e-47c0-8bbf-ff4b92ee76fd None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:06.841234 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0e86c-d07e-47c0-8bbf-ff4b92ee76fd None admin] RBAC: Adding query filter params (name=image) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:06.841570 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0e86c-d07e-47c0-8bbf-ff4b92ee76fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:06.842941 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0e86c-d07e-47c0-8bbf-ff4b92ee76fd None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:06.852505 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 499/1000] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:30:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:06.853820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73ee0b-c5a2-4d91-a86d-7e64c9348ce4 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:06.957902 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73ee0b-c5a2-4d91-a86d-7e64c9348ce4 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:06.991979 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618713e6-5425-40ea-bc21-3c841c4adad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:06.992643 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618713e6-5425-40ea-bc21-3c841c4adad3 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:06.992930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618713e6-5425-40ea-bc21-3c841c4adad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:06.993212 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618713e6-5425-40ea-bc21-3c841c4adad3 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:06.993955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618713e6-5425-40ea-bc21-3c841c4adad3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:06.994265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618713e6-5425-40ea-bc21-3c841c4adad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:06.995632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618713e6-5425-40ea-bc21-3c841c4adad3 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:07.001012 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 502/1001] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:30:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:07.352432 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c336a-c2b4-410f-8370-5b3a1f652583 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:07.352817 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c336a-c2b4-410f-8370-5b3a1f652583 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:07.353009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70c336a-c2b4-410f-8370-5b3a1f652583 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:07.354437 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 500/1002] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:07.359954 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff4b27-d5d3-40ad-b036-5103fde384b1 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:07.360318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff4b27-d5d3-40ad-b036-5103fde384b1 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:07.360673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff4b27-d5d3-40ad-b036-5103fde384b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:07.378469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-62ff4b27-d5d3-40ad-b036-5103fde384b1 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:07.379647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-62ff4b27-d5d3-40ad-b036-5103fde384b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:07.434901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:07.451456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 503/1003] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:07.475571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c336a-c2b4-410f-8370-5b3a1f652583 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:07.581486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70c336a-c2b4-410f-8370-5b3a1f652583 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:07.614951 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e3d15-4919-411a-8c3e-1ec5039e7212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:07.615675 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e3d15-4919-411a-8c3e-1ec5039e7212 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:07.615955 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e3d15-4919-411a-8c3e-1ec5039e7212 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:07.616227 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e3d15-4919-411a-8c3e-1ec5039e7212 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:07.616866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e3d15-4919-411a-8c3e-1ec5039e7212 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:07.618289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e3d15-4919-411a-8c3e-1ec5039e7212 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:07.630980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-ff6e3d15-4919-411a-8c3e-1ec5039e7212 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 19:30:07.630980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:07.630980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:30:07.630980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:30:07.630980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:30:07.630980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:30:07.630980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:30:07.630980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:30:07.630980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 19:30:07.630980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:07.630980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:30:07.630980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:07.630980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:07.630980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:07.630980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:07.630980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:07.630980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:07.631962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:07.631962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:07.631962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:07.631962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:07.631962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:07.631962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:07.631962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:30:07.631962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:30:07.631962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:30:07.631962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:30:07.631962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:07.631962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:07.631962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:07.631962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:07.631962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:07.631962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:07.637734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:07.637734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:07.637734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:07.637734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:07.637734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:07.637734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:07.637734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:07.637734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:07.637734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:07.637734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:07.637734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:30:07.637734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:30:07.637734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 14 19:30:07.637734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:07.637734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 501/1004] 10.222.0.44 () {56 vars in 1126 bytes} [Tue Jun 14 19:30:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:07.640199 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff4b27-d5d3-40ad-b036-5103fde384b1 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:07.742603 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff4b27-d5d3-40ad-b036-5103fde384b1 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:07.778754 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba847472-80aa-4cb3-95d4-1a5a406b8706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:07.779422 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba847472-80aa-4cb3-95d4-1a5a406b8706 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:07.779705 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba847472-80aa-4cb3-95d4-1a5a406b8706 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:07.779981 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba847472-80aa-4cb3-95d4-1a5a406b8706 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:07.780685 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba847472-80aa-4cb3-95d4-1a5a406b8706 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:07.781141 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba847472-80aa-4cb3-95d4-1a5a406b8706 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:07.782632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba847472-80aa-4cb3-95d4-1a5a406b8706 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:07.787932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 504/1005] 10.222.0.44 () {56 vars in 1122 bytes} [Tue Jun 14 19:30:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:07.794335 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e3d15-4919-411a-8c3e-1ec5039e7212 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:07.831572 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:07.906869 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e3d15-4919-411a-8c3e-1ec5039e7212 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:07.940577 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f7117-d676-4fa6-ac26-fd1662332ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:07.941230 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f7117-d676-4fa6-ac26-fd1662332ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:07.941545 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f7117-d676-4fa6-ac26-fd1662332ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:07.941824 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f7117-d676-4fa6-ac26-fd1662332ed4 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:07.942520 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f7117-d676-4fa6-ac26-fd1662332ed4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:07.942825 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f7117-d676-4fa6-ac26-fd1662332ed4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:07.944186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f7117-d676-4fa6-ac26-fd1662332ed4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:07.953627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 502/1006] 10.222.0.44 () {56 vars in 1122 bytes} [Tue Jun 14 19:30:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:30:07.955319 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba847472-80aa-4cb3-95d4-1a5a406b8706 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:08.010351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:08.059942 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba847472-80aa-4cb3-95d4-1a5a406b8706 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:08.094994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eb3606-73fd-463a-8f7b-c7ee29f86481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:08.095647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb3606-73fd-463a-8f7b-c7ee29f86481 None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:08.095931 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb3606-73fd-463a-8f7b-c7ee29f86481 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:08.096206 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb3606-73fd-463a-8f7b-c7ee29f86481 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:08.096942 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb3606-73fd-463a-8f7b-c7ee29f86481 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:08.098433 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eb3606-73fd-463a-8f7b-c7ee29f86481 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:08.116405 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 505/1007] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jun 14 19:30:07 2022] POST /identity/v3/endpoints => generated 325 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:30:08.532733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b324ce8-6562-43d3-869c-5f7ebcedc095 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:08.533122 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b324ce8-6562-43d3-869c-5f7ebcedc095 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:08.533301 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b324ce8-6562-43d3-869c-5f7ebcedc095 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:08.534840 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 503/1008] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:08.540242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad16fbd-6170-4c03-a3ff-ca48bf5b49b7 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:08.540538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad16fbd-6170-4c03-a3ff-ca48bf5b49b7 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:08.540818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad16fbd-6170-4c03-a3ff-ca48bf5b49b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:08.558230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-4ad16fbd-6170-4c03-a3ff-ca48bf5b49b7 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:08.559411 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-4ad16fbd-6170-4c03-a3ff-ca48bf5b49b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:08.632742 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 506/1009] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:08 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:08.655708 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b324ce8-6562-43d3-869c-5f7ebcedc095 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:08.754055 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:08.762053 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b324ce8-6562-43d3-869c-5f7ebcedc095 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:08.797199 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78c145-df6d-41da-af2a-b6175a06968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:08.797851 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78c145-df6d-41da-af2a-b6175a06968e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:08.797948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78c145-df6d-41da-af2a-b6175a06968e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:08.798208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78c145-df6d-41da-af2a-b6175a06968e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:08.798857 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78c145-df6d-41da-af2a-b6175a06968e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:08.800260 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78c145-df6d-41da-af2a-b6175a06968e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:08.813361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-2a78c145-df6d-41da-af2a-b6175a06968e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 19:30:08.813361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:08.813361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:30:08.813361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:30:08.813361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:30:08.813361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:30:08.813361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:30:08.813361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:30:08.813361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 19:30:08.813361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:08.813361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:30:08.813361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:08.813361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:08.813361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:08.813361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:08.813361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:08.813361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:08.814428 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:08.814428 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:08.814428 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:08.814428 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:08.814428 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:08.814428 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:08.814428 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:30:08.814428 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:30:08.814428 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:30:08.814428 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:30:08.814428 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:08.814428 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:08.814428 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:08.814428 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:08.814428 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:08.814428 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:08.815253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:08.815253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:08.815253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:08.815253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:08.815253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:08.815253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:08.815253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:08.815253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:08.815253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:08.815253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:08.815253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:30:08.815253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:30:08.815253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 14 19:30:08.815253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:08.818587 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 504/1010] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:30:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:08.823169 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad16fbd-6170-4c03-a3ff-ca48bf5b49b7 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:08.866807 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:08.931707 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad16fbd-6170-4c03-a3ff-ca48bf5b49b7 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:08.967396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf167a38-9fa9-4d74-abd0-7024da47c598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:08.968171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf167a38-9fa9-4d74-abd0-7024da47c598 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:08.968937 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf167a38-9fa9-4d74-abd0-7024da47c598 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:08.969764 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf167a38-9fa9-4d74-abd0-7024da47c598 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:08.970479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf167a38-9fa9-4d74-abd0-7024da47c598 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:08.970788 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf167a38-9fa9-4d74-abd0-7024da47c598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:08.972211 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf167a38-9fa9-4d74-abd0-7024da47c598 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:08.981862 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 507/1011] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jun 14 19:30:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:08.983375 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78c145-df6d-41da-af2a-b6175a06968e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:09.086883 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78c145-df6d-41da-af2a-b6175a06968e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:09.124430 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d26d43-c316-4b61-981e-e807cd970b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:09.126099 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d26d43-c316-4b61-981e-e807cd970b30 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:09.126305 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d26d43-c316-4b61-981e-e807cd970b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:09.126588 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d26d43-c316-4b61-981e-e807cd970b30 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:09.127303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d26d43-c316-4b61-981e-e807cd970b30 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:09.127615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d26d43-c316-4b61-981e-e807cd970b30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:09.128999 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d26d43-c316-4b61-981e-e807cd970b30 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:09.134366 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 505/1012] 10.222.0.44 () {56 vars in 1112 bytes} [Tue Jun 14 19:30:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:09.139844 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf167a38-9fa9-4d74-abd0-7024da47c598 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:09.162847 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbe456-8f82-41a3-83b1-23e18aa6c929 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:09.163148 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbe456-8f82-41a3-83b1-23e18aa6c929 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:09.163526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbe456-8f82-41a3-83b1-23e18aa6c929 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:09.165127 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 506/1013] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:30:09.169959 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb60ae6-0115-44c2-b86a-8507c8729d84 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:09.170245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb60ae6-0115-44c2-b86a-8507c8729d84 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:09.170515 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb60ae6-0115-44c2-b86a-8507c8729d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:09.189196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9fb60ae6-0115-44c2-b86a-8507c8729d84 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:09.190395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9fb60ae6-0115-44c2-b86a-8507c8729d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:09.208374 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:09.261239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf167a38-9fa9-4d74-abd0-7024da47c598 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:09.262993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:09.264579 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 507/1014] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:09 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:09.287314 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb60ae6-0115-44c2-b86a-8507c8729d84 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:09.303015 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa4dc02-ebf3-4236-ac7f-7539ba223156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:09.303683 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4dc02-ebf3-4236-ac7f-7539ba223156 None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:09.303970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4dc02-ebf3-4236-ac7f-7539ba223156 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:09.304249 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4dc02-ebf3-4236-ac7f-7539ba223156 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:09.305002 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4dc02-ebf3-4236-ac7f-7539ba223156 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:09.306405 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa4dc02-ebf3-4236-ac7f-7539ba223156 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:09.329415 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 508/1015] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jun 14 19:30:09 2022] POST /identity/v3/endpoints => generated 334 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:30:09.410429 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb60ae6-0115-44c2-b86a-8507c8729d84 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:09.454238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615b5480-89a4-4383-b265-8453c9c73266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:09.455219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b5480-89a4-4383-b265-8453c9c73266 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:09.455658 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b5480-89a4-4383-b265-8453c9c73266 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:09.456137 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b5480-89a4-4383-b265-8453c9c73266 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:09.457088 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b5480-89a4-4383-b265-8453c9c73266 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:09.458670 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615b5480-89a4-4383-b265-8453c9c73266 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:09.476591 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 508/1016] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jun 14 19:30:09 2022] POST /identity/v3/services => generated 242 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:30:10.325035 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192253b-06bd-4650-98d3-5cd4f4ad0f59 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:10.325623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192253b-06bd-4650-98d3-5cd4f4ad0f59 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:10.325623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192253b-06bd-4650-98d3-5cd4f4ad0f59 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:10.327175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 509/1017] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:10.332861 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49248cb8-6458-4321-b2c0-1cc19c111c47 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:10.333251 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49248cb8-6458-4321-b2c0-1cc19c111c47 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:10.333456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49248cb8-6458-4321-b2c0-1cc19c111c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:10.349881 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-49248cb8-6458-4321-b2c0-1cc19c111c47 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:10.351070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-49248cb8-6458-4321-b2c0-1cc19c111c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:10.354676 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:10.428149 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 509/1018] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:10.451472 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192253b-06bd-4650-98d3-5cd4f4ad0f59 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:10.555411 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192253b-06bd-4650-98d3-5cd4f4ad0f59 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:10.592263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf80730-23a4-4e8a-a22e-d1baefe0a044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:10.593035 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf80730-23a4-4e8a-a22e-d1baefe0a044 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:10.593888 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf80730-23a4-4e8a-a22e-d1baefe0a044 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:10.594170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf80730-23a4-4e8a-a22e-d1baefe0a044 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:10.595339 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf80730-23a4-4e8a-a22e-d1baefe0a044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:10.596763 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf80730-23a4-4e8a-a22e-d1baefe0a044 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:10.603098 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 510/1019] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:30:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:10.604311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49248cb8-6458-4321-b2c0-1cc19c111c47 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:10.706809 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49248cb8-6458-4321-b2c0-1cc19c111c47 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:10.741265 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb5437-1063-44f4-9bd7-5a320a856e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:10.741956 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb5437-1063-44f4-9bd7-5a320a856e31 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:10.742243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb5437-1063-44f4-9bd7-5a320a856e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:10.742518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb5437-1063-44f4-9bd7-5a320a856e31 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:10.743221 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb5437-1063-44f4-9bd7-5a320a856e31 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:10.744660 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb5437-1063-44f4-9bd7-5a320a856e31 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:10.748826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:10.779576 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 510/1020] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jun 14 19:30:10 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:30:11.623338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b252e-6097-480b-90bc-bf0ce9cfd0d5 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:11.623912 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b252e-6097-480b-90bc-bf0ce9cfd0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:11.623912 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b252e-6097-480b-90bc-bf0ce9cfd0d5 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:11.626162 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 511/1021] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:11.631656 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da863121-0af0-48e8-a1a3-4e9bafaf6e7b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:11.632156 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da863121-0af0-48e8-a1a3-4e9bafaf6e7b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:11.632260 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da863121-0af0-48e8-a1a3-4e9bafaf6e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:11.650160 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-da863121-0af0-48e8-a1a3-4e9bafaf6e7b None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:11.651342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-da863121-0af0-48e8-a1a3-4e9bafaf6e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:11.672735 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9349bf5-55c7-4d38-874c-8aaef4431077 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:11.673035 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9349bf5-55c7-4d38-874c-8aaef4431077 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:11.673324 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9349bf5-55c7-4d38-874c-8aaef4431077 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:11.674865 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 512/1022] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:30:11.679663 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62c8df-350e-4c0c-a696-43974de23991 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:11.679954 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62c8df-350e-4c0c-a696-43974de23991 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:11.680239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62c8df-350e-4c0c-a696-43974de23991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:11.697473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-db62c8df-350e-4c0c-a696-43974de23991 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:11.698669 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-db62c8df-350e-4c0c-a696-43974de23991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:11.720119 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:11.721805 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 511/1023] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:11.746195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da863121-0af0-48e8-a1a3-4e9bafaf6e7b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:11.776531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 513/1024] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 19:30:11.803592 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62c8df-350e-4c0c-a696-43974de23991 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:11.872120 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da863121-0af0-48e8-a1a3-4e9bafaf6e7b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:11.890572 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:11.910652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551db806-c37b-4a50-b16c-b6b078c45de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:11.911487 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551db806-c37b-4a50-b16c-b6b078c45de1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:11.911772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551db806-c37b-4a50-b16c-b6b078c45de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:11.912055 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551db806-c37b-4a50-b16c-b6b078c45de1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:11.923614 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551db806-c37b-4a50-b16c-b6b078c45de1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:30:11.924197 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62c8df-350e-4c0c-a696-43974de23991 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:11.931798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-551db806-c37b-4a50-b16c-b6b078c45de1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 19:30:11.931798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:11.931798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:11.931798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:11.931798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:11.931798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:11.931798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:11.931798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:11.931798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:11.931798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:11.931798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:11.931798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:11.931798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:30:11.931798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:30:11.931798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:30:11.931798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:30:11.932849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:30:11.932849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:30:11.932849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:30:11.932849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:30:11.932849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:11.932849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:11.932849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:11.932849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:11.932849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:11.932849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:11.932849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:11.932849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:11.932849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:11.932849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:11.932849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:11.932849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:11.933931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:11.933931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:11.933931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:11.933931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:11.933931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:30:11.933931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:30:11.933931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:30:11.933931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:30:11.933931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:30:11.933931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:30:11.933931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 19:30:11.933931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:11.938700 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 512/1025] 10.222.0.44 () {56 vars in 1120 bytes} [Tue Jun 14 19:30:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:30:11.939394 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551db806-c37b-4a50-b16c-b6b078c45de1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:11.965239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659df0a-b43d-447a-9ed1-48166ee48c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:11.966356 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659df0a-b43d-447a-9ed1-48166ee48c1f None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:11.966905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659df0a-b43d-447a-9ed1-48166ee48c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:11.967403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659df0a-b43d-447a-9ed1-48166ee48c1f None admin] PATH_INFO: `/v3/services/image` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:11.968354 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659df0a-b43d-447a-9ed1-48166ee48c1f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:11.970011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e659df0a-b43d-447a-9ed1-48166ee48c1f None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:11.982510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-e659df0a-b43d-447a-9ed1-48166ee48c1f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 19:30:11.982510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:11.982510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:30:11.982510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:30:11.982510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:30:11.982510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:30:11.982510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:30:11.982510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:30:11.982510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 19:30:11.982510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:11.982510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:30:11.982510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:11.982510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:11.982510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:11.982510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:11.982510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:11.982510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:11.984265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:11.984265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:11.984265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:11.984265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:11.984265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:11.984265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:11.984265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:30:11.984265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:30:11.984265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:30:11.984265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:30:11.984265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:11.984265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:11.984265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:11.984265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:11.984265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:11.984265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:11.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:11.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:11.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:11.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:11.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:11.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:11.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:11.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:11.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:11.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:11.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:30:11.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:30:11.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 19:30:11.985403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:11.988021 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 514/1026] 10.222.0.44 () {56 vars in 1105 bytes} [Tue Jun 14 19:30:11 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:30:11.993505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659df0a-b43d-447a-9ed1-48166ee48c1f None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:12.016082 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:12.045915 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551db806-c37b-4a50-b16c-b6b078c45de1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:12.082233 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cea50-a8d4-45f0-9849-003f3fe7fc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:12.082898 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cea50-a8d4-45f0-9849-003f3fe7fc24 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:12.083176 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cea50-a8d4-45f0-9849-003f3fe7fc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:12.083459 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cea50-a8d4-45f0-9849-003f3fe7fc24 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:12.084203 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cea50-a8d4-45f0-9849-003f3fe7fc24 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:12.084513 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cea50-a8d4-45f0-9849-003f3fe7fc24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:12.085916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cea50-a8d4-45f0-9849-003f3fe7fc24 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:12.094610 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 513/1027] 10.222.0.44 () {56 vars in 1115 bytes} [Tue Jun 14 19:30:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:12.099922 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cea50-a8d4-45f0-9849-003f3fe7fc24 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:12.101567 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659df0a-b43d-447a-9ed1-48166ee48c1f None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:12.138802 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0198f7-bd84-4ca3-aca6-83fd72d8cb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:12.139924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0198f7-bd84-4ca3-aca6-83fd72d8cb18 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:12.140456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0198f7-bd84-4ca3-aca6-83fd72d8cb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:12.140983 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0198f7-bd84-4ca3-aca6-83fd72d8cb18 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:12.142236 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0198f7-bd84-4ca3-aca6-83fd72d8cb18 None admin] RBAC: Adding query filter params (name=image) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:12.142719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0198f7-bd84-4ca3-aca6-83fd72d8cb18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:12.143959 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:12.144343 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0198f7-bd84-4ca3-aca6-83fd72d8cb18 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:12.154455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 515/1028] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:30:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:30:12.156245 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0198f7-bd84-4ca3-aca6-83fd72d8cb18 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:12.210296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cea50-a8d4-45f0-9849-003f3fe7fc24 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:12.244183 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3356839-9aeb-4e5a-ab7e-15724796bf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:12.244975 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3356839-9aeb-4e5a-ab7e-15724796bf68 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:12.245260 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3356839-9aeb-4e5a-ab7e-15724796bf68 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:12.245567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3356839-9aeb-4e5a-ab7e-15724796bf68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:12.247247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:12.257022 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3356839-9aeb-4e5a-ab7e-15724796bf68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:12.258656 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3356839-9aeb-4e5a-ab7e-15724796bf68 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:12.269644 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0198f7-bd84-4ca3-aca6-83fd72d8cb18 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:12.275892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-c3356839-9aeb-4e5a-ab7e-15724796bf68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:30:12.275892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:12.275892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:12.275892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:12.275892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:12.275892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:12.275892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:12.275892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:12.275892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:12.275892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:12.275892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:12.275892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:12.275892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:30:12.275892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:30:12.275892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:30:12.276772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:30:12.276772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:12.276772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:12.276772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:12.276772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:12.276772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:12.276772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:12.276772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:12.276772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:12.276772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:12.276772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:12.276772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:12.276772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:12.276772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:12.276772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:12.276772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:12.276772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:12.277736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:30:12.277736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:30:12.277736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:30:12.277736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:12.277736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 514/1029] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:30:12.283476 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3356839-9aeb-4e5a-ab7e-15724796bf68 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:12.307876 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba648a8-7c8f-4ace-aa0c-cf56c96f0660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:12.308540 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba648a8-7c8f-4ace-aa0c-cf56c96f0660 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:12.308824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba648a8-7c8f-4ace-aa0c-cf56c96f0660 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:12.309103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba648a8-7c8f-4ace-aa0c-cf56c96f0660 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:12.309839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba648a8-7c8f-4ace-aa0c-cf56c96f0660 None admin] RBAC: Adding query filter params (type=image) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:12.310150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba648a8-7c8f-4ace-aa0c-cf56c96f0660 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:12.311538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba648a8-7c8f-4ace-aa0c-cf56c96f0660 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:12.321545 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 516/1030] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:30:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:30:12.322490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba648a8-7c8f-4ace-aa0c-cf56c96f0660 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:12.382366 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:12.392891 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3356839-9aeb-4e5a-ab7e-15724796bf68 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:12.429015 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dda9cc-5da9-4509-94dd-a9fcc3036622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:12.429459 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dda9cc-5da9-4509-94dd-a9fcc3036622 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:12.429744 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dda9cc-5da9-4509-94dd-a9fcc3036622 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:12.430014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dda9cc-5da9-4509-94dd-a9fcc3036622 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:12.430749 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dda9cc-5da9-4509-94dd-a9fcc3036622 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:12.431096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dda9cc-5da9-4509-94dd-a9fcc3036622 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:12.432427 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dda9cc-5da9-4509-94dd-a9fcc3036622 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:12.436811 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba648a8-7c8f-4ace-aa0c-cf56c96f0660 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:12.446628 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 515/1031] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:30:12.451972 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dda9cc-5da9-4509-94dd-a9fcc3036622 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:12.480953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdddc9-e042-42c0-a296-8c002677dd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:12.481706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdddc9-e042-42c0-a296-8c002677dd80 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:12.481924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdddc9-e042-42c0-a296-8c002677dd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:12.482197 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cdddc9-e042-42c0-a296-8c002677dd80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:12.483094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdddc9-e042-42c0-a296-8c002677dd80 None admin] RBAC: Adding query filter params (interface=public, service_id=0b9b9ef426454b419e89c3c18f1af337, region_id=RegionOne) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:12.483285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdddc9-e042-42c0-a296-8c002677dd80 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:12.485185 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cdddc9-e042-42c0-a296-8c002677dd80 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:12.491348 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 517/1032] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jun 14 19:30:12 2022] GET /identity/v3/endpoints?service_id=0b9b9ef426454b419e89c3c18f1af337&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:30:12.496677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdddc9-e042-42c0-a296-8c002677dd80 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:12.512790 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:12.565112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dda9cc-5da9-4509-94dd-a9fcc3036622 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:12.601413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adeccb7-da76-4240-8484-b7c98ae65a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:12.601615 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cdddc9-e042-42c0-a296-8c002677dd80 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:12.602593 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adeccb7-da76-4240-8484-b7c98ae65a81 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:12.603086 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adeccb7-da76-4240-8484-b7c98ae65a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:12.603663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adeccb7-da76-4240-8484-b7c98ae65a81 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:12.612018 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adeccb7-da76-4240-8484-b7c98ae65a81 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:12.613629 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adeccb7-da76-4240-8484-b7c98ae65a81 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:12.629706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-0adeccb7-da76-4240-8484-b7c98ae65a81 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 19:30:12.629706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:12.629706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:12.629706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:12.629706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:12.629706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:12.629706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:12.629706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:12.629706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:12.629706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:12.629706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:12.629706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:12.629706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:30:12.629706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:30:12.629706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:30:12.629706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:30:12.630681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:12.630681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:12.630681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:30:12.630681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:30:12.630681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:30:12.630681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:30:12.630681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:12.630681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:12.630681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:12.630681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:12.630681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:12.630681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:12.630681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:12.630681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:12.630681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:12.630681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:12.630681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:12.630681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:12.631609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:12.631609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:12.631609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:30:12.631609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:30:12.631609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:30:12.631609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:30:12.631609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:30:12.631609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:30:12.631609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 19:30:12.631609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:12.631609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 516/1033] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jun 14 19:30:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:30:12.636541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adeccb7-da76-4240-8484-b7c98ae65a81 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:12.639221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262697fa-9bf3-4af5-902a-ae7c65eb2fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:12.639887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262697fa-9bf3-4af5-902a-ae7c65eb2fef None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:12.640205 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262697fa-9bf3-4af5-902a-ae7c65eb2fef None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:12.640483 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262697fa-9bf3-4af5-902a-ae7c65eb2fef None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:12.641169 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262697fa-9bf3-4af5-902a-ae7c65eb2fef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:12.642566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262697fa-9bf3-4af5-902a-ae7c65eb2fef None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:12.649469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 518/1034] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jun 14 19:30:12 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:30:12.661186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:12.756621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adeccb7-da76-4240-8484-b7c98ae65a81 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:12.794376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd44a06-fc94-4248-9a99-4e789b3c82a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:12.795064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd44a06-fc94-4248-9a99-4e789b3c82a1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:12.795350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd44a06-fc94-4248-9a99-4e789b3c82a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:12.795625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd44a06-fc94-4248-9a99-4e789b3c82a1 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:12.796516 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd44a06-fc94-4248-9a99-4e789b3c82a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:12.796826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd44a06-fc94-4248-9a99-4e789b3c82a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:12.798312 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd44a06-fc94-4248-9a99-4e789b3c82a1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:12.818014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 517/1035] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jun 14 19:30:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:30:12.823293 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262697fa-9bf3-4af5-902a-ae7c65eb2fef None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:12.907122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:12.934384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262697fa-9bf3-4af5-902a-ae7c65eb2fef None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:12.969743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91df16-c4d1-4c50-8f7d-4191228cccb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:12.970390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91df16-c4d1-4c50-8f7d-4191228cccb7 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:12.970671 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91df16-c4d1-4c50-8f7d-4191228cccb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:12.970945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91df16-c4d1-4c50-8f7d-4191228cccb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:12.976134 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c36839-66f5-4726-bb02-1eaea86744c7 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:12.976423 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c36839-66f5-4726-bb02-1eaea86744c7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:12.976702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c36839-66f5-4726-bb02-1eaea86744c7 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:12.978228 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 518/1036] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:30:12.982966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314a87b-56ee-4a98-bd73-12f0a1b4a685 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:12.983257 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314a87b-56ee-4a98-bd73-12f0a1b4a685 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:12.983537 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314a87b-56ee-4a98-bd73-12f0a1b4a685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:13.000936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6314a87b-56ee-4a98-bd73-12f0a1b4a685 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:13.002167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6314a87b-56ee-4a98-bd73-12f0a1b4a685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:13.045974 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91df16-c4d1-4c50-8f7d-4191228cccb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:13.047444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91df16-c4d1-4c50-8f7d-4191228cccb7 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:13.073830 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:13.086777 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 519/1037] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 19:30:13.104224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314a87b-56ee-4a98-bd73-12f0a1b4a685 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:13.125965 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:13.151787 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 519/1038] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:30:12 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 14 19:30:13.157406 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91df16-c4d1-4c50-8f7d-4191228cccb7 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:13.211073 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314a87b-56ee-4a98-bd73-12f0a1b4a685 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:13.246407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7473743-5095-407a-9c6e-19c8dd2d4c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:13.247466 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7473743-5095-407a-9c6e-19c8dd2d4c39 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:13.247757 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7473743-5095-407a-9c6e-19c8dd2d4c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:13.248191 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7473743-5095-407a-9c6e-19c8dd2d4c39 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:13.250216 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7473743-5095-407a-9c6e-19c8dd2d4c39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:13.251664 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7473743-5095-407a-9c6e-19c8dd2d4c39 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:13.253973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 520/1039] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:30:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:30:13.259263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7473743-5095-407a-9c6e-19c8dd2d4c39 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:13.269319 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91df16-c4d1-4c50-8f7d-4191228cccb7 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:13.309329 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348e3b4-4a2b-46f4-9b81-df365d7ea75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:13.310140 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348e3b4-4a2b-46f4-9b81-df365d7ea75b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:13.310421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348e3b4-4a2b-46f4-9b81-df365d7ea75b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:13.310696 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348e3b4-4a2b-46f4-9b81-df365d7ea75b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:13.322794 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348e3b4-4a2b-46f4-9b81-df365d7ea75b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:13.324382 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348e3b4-4a2b-46f4-9b81-df365d7ea75b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:13.329366 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:13.345213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-5348e3b4-4a2b-46f4-9b81-df365d7ea75b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:30:13.345213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:13.345213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:13.345213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:13.345213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:13.345213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:13.345213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:13.345213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:13.345213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:13.345213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:13.345213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:13.345213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:13.345213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:30:13.345213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:30:13.345213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:30:13.346214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:30:13.346214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:13.346214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:13.346214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:13.346214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:13.346214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:13.346214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:13.346214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:13.346214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:13.346214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:13.346214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:13.346214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:13.346214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:13.346214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:13.346214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:13.346214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:13.346214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:13.347120 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:30:13.347120 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:30:13.347120 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:30:13.347120 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:13.347120 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 520/1040] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:13.351855 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348e3b4-4a2b-46f4-9b81-df365d7ea75b None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:13.367173 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7473743-5095-407a-9c6e-19c8dd2d4c39 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:13.384630 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:13.404912 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2a7a2-3002-4e00-aa70-98faea9aa93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:13.405648 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2a7a2-3002-4e00-aa70-98faea9aa93e None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:13.406472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2a7a2-3002-4e00-aa70-98faea9aa93e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:13.406761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2a7a2-3002-4e00-aa70-98faea9aa93e None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:13.407522 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2a7a2-3002-4e00-aa70-98faea9aa93e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:13.408899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2a7a2-3002-4e00-aa70-98faea9aa93e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:13.431792 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 521/1041] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jun 14 19:30:13 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:30:13.477707 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348e3b4-4a2b-46f4-9b81-df365d7ea75b None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:13.518427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f63cb-1580-4222-98b4-d9302d4f4a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:13.519102 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f63cb-1580-4222-98b4-d9302d4f4a08 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:13.519383 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f63cb-1580-4222-98b4-d9302d4f4a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:13.519656 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f63cb-1580-4222-98b4-d9302d4f4a08 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:13.520394 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f63cb-1580-4222-98b4-d9302d4f4a08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:13.520699 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f63cb-1580-4222-98b4-d9302d4f4a08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:13.522181 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f63cb-1580-4222-98b4-d9302d4f4a08 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:13.540649 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 521/1042] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:30:13.542274 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2a7a2-3002-4e00-aa70-98faea9aa93e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:13.656813 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2a7a2-3002-4e00-aa70-98faea9aa93e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:13.682042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:13.695425 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bf2e5-be0f-4508-9ae2-12fd8cecc822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:13.696220 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bf2e5-be0f-4508-9ae2-12fd8cecc822 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:13.696500 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bf2e5-be0f-4508-9ae2-12fd8cecc822 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:13.696770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029bf2e5-be0f-4508-9ae2-12fd8cecc822 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:13.704300 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bf2e5-be0f-4508-9ae2-12fd8cecc822 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:13.705770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029bf2e5-be0f-4508-9ae2-12fd8cecc822 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:13.721042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-029bf2e5-be0f-4508-9ae2-12fd8cecc822 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:30:13.721042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:13.721042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:13.721042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:13.721042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:13.721042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:13.721042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:13.721042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:13.721042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:13.721042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:13.721042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:13.721042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:13.721042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:30:13.721042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:30:13.721042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:30:13.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:30:13.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:13.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:13.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:13.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:13.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:13.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:13.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:13.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:13.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:13.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:13.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:13.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:13.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:13.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:13.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:13.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:13.723080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:30:13.723080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:30:13.723080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:30:13.723080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:30:13.723080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:30:13.723080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:30:13.723080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:30:13.723080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:13.723080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 522/1043] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:30:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:13.731537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f63cb-1580-4222-98b4-d9302d4f4a08 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:13.834102 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:13.847261 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f63cb-1580-4222-98b4-d9302d4f4a08 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:13.883461 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc7699-0b4f-46e1-b957-43fa9c63b7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:13.884577 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc7699-0b4f-46e1-b957-43fa9c63b7bd None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:13.885092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc7699-0b4f-46e1-b957-43fa9c63b7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:13.885645 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc7699-0b4f-46e1-b957-43fa9c63b7bd None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:13.887149 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc7699-0b4f-46e1-b957-43fa9c63b7bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:13.887708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc7699-0b4f-46e1-b957-43fa9c63b7bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:13.891000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc7699-0b4f-46e1-b957-43fa9c63b7bd None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:13.913453 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 522/1044] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:30:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:13.915040 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bf2e5-be0f-4508-9ae2-12fd8cecc822 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:14.019363 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029bf2e5-be0f-4508-9ae2-12fd8cecc822 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:14.053687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86c892-47aa-405c-9a3c-6cfe5bb04519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:14.054337 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86c892-47aa-405c-9a3c-6cfe5bb04519 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:14.054625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86c892-47aa-405c-9a3c-6cfe5bb04519 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:14.054892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86c892-47aa-405c-9a3c-6cfe5bb04519 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:14.055708 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86c892-47aa-405c-9a3c-6cfe5bb04519 None admin] RBAC: Adding query filter params (role.id=04984986168e4190919081ad55f01b76, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=37c521e20aea4cad9758568a4f082fbd) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:14.056014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86c892-47aa-405c-9a3c-6cfe5bb04519 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:14.057480 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86c892-47aa-405c-9a3c-6cfe5bb04519 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:14.063731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 523/1045] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:30:13 2022] GET /identity/v3/role_assignments?user.id=37c521e20aea4cad9758568a4f082fbd&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=04984986168e4190919081ad55f01b76 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:14.839417 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac14977-3440-42d7-ab6f-a0de5635aad7 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:14.839918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac14977-3440-42d7-ab6f-a0de5635aad7 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:14.840023 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac14977-3440-42d7-ab6f-a0de5635aad7 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:14.841532 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 523/1046] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:14.846571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09abfad-40cd-4956-b2dd-83716b9ec4ea None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:14.846951 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09abfad-40cd-4956-b2dd-83716b9ec4ea None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:14.847141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09abfad-40cd-4956-b2dd-83716b9ec4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:14.864339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c09abfad-40cd-4956-b2dd-83716b9ec4ea None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:14.865555 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c09abfad-40cd-4956-b2dd-83716b9ec4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:14.908927 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:14.933718 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 524/1047] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:14.956783 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac14977-3440-42d7-ab6f-a0de5635aad7 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:15.061272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac14977-3440-42d7-ab6f-a0de5635aad7 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:15.100777 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4f8a4-1bf0-4e45-8fdf-2e7a0c14c587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:15.101533 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4f8a4-1bf0-4e45-8fdf-2e7a0c14c587 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:15.101819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4f8a4-1bf0-4e45-8fdf-2e7a0c14c587 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:15.102094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf4f8a4-1bf0-4e45-8fdf-2e7a0c14c587 None admin] PATH_INFO: `/v3/services/image` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:15.102753 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4f8a4-1bf0-4e45-8fdf-2e7a0c14c587 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:15.104145 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf4f8a4-1bf0-4e45-8fdf-2e7a0c14c587 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:15.121038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-2cf4f8a4-1bf0-4e45-8fdf-2e7a0c14c587 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 19:30:15.121038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:15.121038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:30:15.121038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:30:15.121038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:30:15.121038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:30:15.121038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:30:15.121038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:30:15.121038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 19:30:15.121038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:15.121038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:30:15.121038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:15.121038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:15.121038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:15.121038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:15.121038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:15.121038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:15.122133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:15.122133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:15.122133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:15.122133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:15.122133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:15.122133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:15.122133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:30:15.122133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:30:15.122133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:30:15.122133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:30:15.122133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:15.122133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:15.122133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:15.122133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:15.122133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:15.122133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:15.122957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:15.122957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:15.122957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:15.122957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:15.122957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:15.122957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:15.122957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:15.122957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:15.122957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:15.122957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:15.122957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:30:15.122957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:30:15.122957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 14 19:30:15.122957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:15.127879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 524/1048] 10.222.0.44 () {56 vars in 1105 bytes} [Tue Jun 14 19:30:14 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:15.129304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09abfad-40cd-4956-b2dd-83716b9ec4ea None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:15.248584 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09abfad-40cd-4956-b2dd-83716b9ec4ea None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:15.286074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7700aa-fc02-4d8b-9ca7-f3879ede1299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:15.286738 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7700aa-fc02-4d8b-9ca7-f3879ede1299 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:15.287021 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7700aa-fc02-4d8b-9ca7-f3879ede1299 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:15.287296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7700aa-fc02-4d8b-9ca7-f3879ede1299 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:15.287992 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7700aa-fc02-4d8b-9ca7-f3879ede1299 None admin] RBAC: Adding query filter params (name=image) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:15.288348 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7700aa-fc02-4d8b-9ca7-f3879ede1299 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:15.289997 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7700aa-fc02-4d8b-9ca7-f3879ede1299 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:15.299557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 525/1049] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:30:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:15.300758 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4f8a4-1bf0-4e45-8fdf-2e7a0c14c587 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:15.336862 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:15.429457 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf4f8a4-1bf0-4e45-8fdf-2e7a0c14c587 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:15.462626 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce244530-7eda-42a4-b2de-07cd5786496b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:15.463338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce244530-7eda-42a4-b2de-07cd5786496b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:15.463621 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce244530-7eda-42a4-b2de-07cd5786496b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:15.463897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce244530-7eda-42a4-b2de-07cd5786496b None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:15.464602 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce244530-7eda-42a4-b2de-07cd5786496b None admin] RBAC: Adding query filter params (type=image) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:15.464907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce244530-7eda-42a4-b2de-07cd5786496b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:15.466286 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce244530-7eda-42a4-b2de-07cd5786496b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:15.488726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7700aa-fc02-4d8b-9ca7-f3879ede1299 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:15.491451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 525/1050] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:30:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:15.571635 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:15.643607 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7700aa-fc02-4d8b-9ca7-f3879ede1299 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:15.675548 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe75fa-4074-4095-9c71-86433dfcae1c None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:15.675831 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe75fa-4074-4095-9c71-86433dfcae1c None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:15.676112 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe75fa-4074-4095-9c71-86433dfcae1c None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:15.680566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 526/1051] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:30:15.685012 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f25e18-c461-4963-ba4b-27f951ab46ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:15.685012 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f25e18-c461-4963-ba4b-27f951ab46ac None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:15.685012 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f25e18-c461-4963-ba4b-27f951ab46ac None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:15.685333 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c51107-6801-4a59-99b4-37ec3f071d2c None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:15.685721 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f25e18-c461-4963-ba4b-27f951ab46ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:15.685817 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c51107-6801-4a59-99b4-37ec3f071d2c None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:15.685817 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c51107-6801-4a59-99b4-37ec3f071d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:15.685984 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f25e18-c461-4963-ba4b-27f951ab46ac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:15.685984 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f25e18-c461-4963-ba4b-27f951ab46ac None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:15.703256 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-46c51107-6801-4a59-99b4-37ec3f071d2c None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:15.704432 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-46c51107-6801-4a59-99b4-37ec3f071d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:15.709747 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 526/1052] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jun 14 19:30:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:30:15.830982 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 527/1053] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:15.850753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f25e18-c461-4963-ba4b-27f951ab46ac None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:15.963063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:15.967381 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f25e18-c461-4963-ba4b-27f951ab46ac None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:16.004018 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055f52ae-2820-4933-8e38-c66d37cd4e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:16.004818 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f52ae-2820-4933-8e38-c66d37cd4e22 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:16.005101 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f52ae-2820-4933-8e38-c66d37cd4e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:16.005406 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055f52ae-2820-4933-8e38-c66d37cd4e22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:16.016158 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055f52ae-2820-4933-8e38-c66d37cd4e22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:30:16.023814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-055f52ae-2820-4933-8e38-c66d37cd4e22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:30:16.023814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:16.023814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:16.023814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:16.023814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:16.023814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:16.023814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:16.023814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:16.023814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:16.023814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:16.023814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:16.023814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:16.023814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:30:16.023814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:30:16.023814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:30:16.023814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:30:16.024725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:30:16.024725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:30:16.024725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:30:16.024725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:30:16.024725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:16.024725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:16.024725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:16.024725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:16.024725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:16.024725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:16.024725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:16.024725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:16.024725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:16.024725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:16.024725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:16.024725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:16.025713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:16.025713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:16.025713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:16.025713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:16.025713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:30:16.025713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:30:16.025713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:30:16.025713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:30:16.025713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:30:16.025713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:30:16.025713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:30:16.025713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:16.025713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 527/1054] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:30:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:16.031460 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c51107-6801-4a59-99b4-37ec3f071d2c None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:16.033845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:16.143859 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c51107-6801-4a59-99b4-37ec3f071d2c None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:16.182195 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc4238-8e84-4e6b-82cf-325db00d7539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:16.183270 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc4238-8e84-4e6b-82cf-325db00d7539 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:16.183673 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df511a-2aba-47de-afc3-b587e4af6e6e None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:16.183822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc4238-8e84-4e6b-82cf-325db00d7539 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:16.184007 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df511a-2aba-47de-afc3-b587e4af6e6e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:16.184118 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc4238-8e84-4e6b-82cf-325db00d7539 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:16.184280 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62df511a-2aba-47de-afc3-b587e4af6e6e None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:16.184775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc4238-8e84-4e6b-82cf-325db00d7539 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:16.185087 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc4238-8e84-4e6b-82cf-325db00d7539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:16.185793 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 528/1055] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:16.186490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc4238-8e84-4e6b-82cf-325db00d7539 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:16.190656 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec21806-a313-41a3-b3df-d872b5d1fcd2 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:16.190948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec21806-a313-41a3-b3df-d872b5d1fcd2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:16.191230 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec21806-a313-41a3-b3df-d872b5d1fcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:16.200185 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 528/1056] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:30:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:16.201214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc4238-8e84-4e6b-82cf-325db00d7539 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:16.209164 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-2ec21806-a313-41a3-b3df-d872b5d1fcd2 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:16.210545 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2ec21806-a313-41a3-b3df-d872b5d1fcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:16.272124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:16.287115 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 529/1057] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 19:30:16.310602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec21806-a313-41a3-b3df-d872b5d1fcd2 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:16.312446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc4238-8e84-4e6b-82cf-325db00d7539 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:16.346260 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccee8b7-1325-4ec8-ac21-d02a797178d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:16.347160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccee8b7-1325-4ec8-ac21-d02a797178d4 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:16.347436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccee8b7-1325-4ec8-ac21-d02a797178d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:16.347708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccee8b7-1325-4ec8-ac21-d02a797178d4 None admin] PATH_INFO: `/v3/users/d2bda2aa1a9a4418a38cd24643349c4c` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:16.366743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccee8b7-1325-4ec8-ac21-d02a797178d4 None admin] RBAC: Authorizing `identity:get_user(user_id=d2bda2aa1a9a4418a38cd24643349c4c)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:16.368404 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccee8b7-1325-4ec8-ac21-d02a797178d4 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:16.370751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 529/1058] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:30:16 2022] GET /identity/v3/users/d2bda2aa1a9a4418a38cd24643349c4c => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:16.376867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccee8b7-1325-4ec8-ac21-d02a797178d4 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:16.407621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:16.420215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec21806-a313-41a3-b3df-d872b5d1fcd2 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:16.455915 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c76dd-b11b-44e6-892f-efaf781dca0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:16.456739 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c76dd-b11b-44e6-892f-efaf781dca0d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:16.457023 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c76dd-b11b-44e6-892f-efaf781dca0d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:16.457297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c76dd-b11b-44e6-892f-efaf781dca0d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:16.471045 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c76dd-b11b-44e6-892f-efaf781dca0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:30:16.479905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-040c76dd-b11b-44e6-892f-efaf781dca0d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 19:30:16.479905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:16.479905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:16.479905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:16.479905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:16.479905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:16.479905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:16.479905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:16.479905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:16.479905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:16.479905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:16.479905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:16.479905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:30:16.479905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:30:16.479905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:30:16.479905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:30:16.480822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:30:16.480822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:30:16.480822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:30:16.480822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:30:16.480822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:16.480822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:16.480822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:16.480822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:16.480822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:16.480822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:16.480822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:16.480822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:16.480822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:16.480822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:16.480822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:16.480822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:16.481808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:16.481808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:16.481808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:16.481808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:16.481808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:30:16.481808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:30:16.481808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:30:16.481808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:30:16.481808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:30:16.481808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:30:16.481808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 19:30:16.481808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:16.481808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 530/1059] 10.222.0.44 () {56 vars in 1120 bytes} [Tue Jun 14 19:30:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:30:16.488043 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c76dd-b11b-44e6-892f-efaf781dca0d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:16.490166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccee8b7-1325-4ec8-ac21-d02a797178d4 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:16.513629 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:16.527432 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c99b51-8cfb-41a0-8946-b8cbf52ed3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:16.528019 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c99b51-8cfb-41a0-8946-b8cbf52ed3af None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:16.528305 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c99b51-8cfb-41a0-8946-b8cbf52ed3af None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:16.528584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c99b51-8cfb-41a0-8946-b8cbf52ed3af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:16.598362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c76dd-b11b-44e6-892f-efaf781dca0d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:16.602361 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c99b51-8cfb-41a0-8946-b8cbf52ed3af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:16.603812 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c99b51-8cfb-41a0-8946-b8cbf52ed3af None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:16.633299 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb3885-f496-4152-976e-8c6a36986a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:16.633993 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb3885-f496-4152-976e-8c6a36986a3c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:16.634277 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb3885-f496-4152-976e-8c6a36986a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:16.634543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb3885-f496-4152-976e-8c6a36986a3c None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:16.635287 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb3885-f496-4152-976e-8c6a36986a3c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:16.635595 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb3885-f496-4152-976e-8c6a36986a3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:16.636968 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb3885-f496-4152-976e-8c6a36986a3c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:16.650447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 531/1060] 10.222.0.44 () {56 vars in 1115 bytes} [Tue Jun 14 19:30:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:30:16.651440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb3885-f496-4152-976e-8c6a36986a3c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:16.664998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:16.722412 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 530/1061] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:30:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 19:30:16.728484 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c99b51-8cfb-41a0-8946-b8cbf52ed3af None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:16.754030 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:16.760061 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb3885-f496-4152-976e-8c6a36986a3c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:16.798130 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cf22e-e033-4afb-b127-e705454b894d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:16.798966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cf22e-e033-4afb-b127-e705454b894d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:16.799248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cf22e-e033-4afb-b127-e705454b894d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:16.799522 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8cf22e-e033-4afb-b127-e705454b894d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:16.814564 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cf22e-e033-4afb-b127-e705454b894d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:16.816174 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8cf22e-e033-4afb-b127-e705454b894d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:16.837408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-4e8cf22e-e033-4afb-b127-e705454b894d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:30:16.837408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:16.837408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:16.837408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:16.837408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:16.837408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:16.837408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:16.837408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:16.837408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:16.837408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:16.837408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:16.837408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:16.837408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:30:16.837408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:30:16.837408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:30:16.838364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:30:16.838364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:16.838364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:16.838364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:16.838364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:16.838364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:16.838364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:16.838364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:16.838364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:16.838364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:16.838364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:16.838364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:16.838364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:16.838364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:16.838364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:16.838364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:16.838364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:16.839251 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:30:16.839251 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:30:16.839251 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:30:16.839251 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:16.839251 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 532/1062] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:30:16.844385 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cf22e-e033-4afb-b127-e705454b894d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:16.845412 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c99b51-8cfb-41a0-8946-b8cbf52ed3af None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:16.887157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fd8c3-dc70-4cd3-8dc5-0ec61e121c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:16.888028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fd8c3-dc70-4cd3-8dc5-0ec61e121c72 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:16.888313 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fd8c3-dc70-4cd3-8dc5-0ec61e121c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:16.890841 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0fd8c3-dc70-4cd3-8dc5-0ec61e121c72 None admin] PATH_INFO: `/v3/projects/b642196229884c96936c01db0eafab96` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:16.892396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0fd8c3-dc70-4cd3-8dc5-0ec61e121c72 None admin] RBAC: Authorizing `identity:get_project(project_id=b642196229884c96936c01db0eafab96)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:16.893837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0fd8c3-dc70-4cd3-8dc5-0ec61e121c72 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:16.900815 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 531/1063] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:30:16 2022] GET /identity/v3/projects/b642196229884c96936c01db0eafab96 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:16.902035 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fd8c3-dc70-4cd3-8dc5-0ec61e121c72 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:16.915964 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:16.959242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8cf22e-e033-4afb-b127-e705454b894d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:17.009410 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbae30-2865-44bc-9902-11e3be40c41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:17.009410 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbae30-2865-44bc-9902-11e3be40c41c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:17.009410 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbae30-2865-44bc-9902-11e3be40c41c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:17.009410 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbae30-2865-44bc-9902-11e3be40c41c None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:17.009844 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dbae30-2865-44bc-9902-11e3be40c41c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:17.009844 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dbae30-2865-44bc-9902-11e3be40c41c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:17.010761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dbae30-2865-44bc-9902-11e3be40c41c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:17.011910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:17.022184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0fd8c3-dc70-4cd3-8dc5-0ec61e121c72 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:17.024521 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 533/1064] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:30:17.030186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbae30-2865-44bc-9902-11e3be40c41c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:17.060512 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac3e6a-34bb-42fc-9f70-2095e6f35e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:17.061100 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac3e6a-34bb-42fc-9f70-2095e6f35e5f None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:17.061402 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac3e6a-34bb-42fc-9f70-2095e6f35e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:17.062324 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac3e6a-34bb-42fc-9f70-2095e6f35e5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:17.063150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac3e6a-34bb-42fc-9f70-2095e6f35e5f None admin] RBAC: Adding query filter params (role.id=1e2bb0d759694428ada2b52285de933b, scope.project.id=b642196229884c96936c01db0eafab96, user.id=d2bda2aa1a9a4418a38cd24643349c4c) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:17.063461 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac3e6a-34bb-42fc-9f70-2095e6f35e5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:17.064867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac3e6a-34bb-42fc-9f70-2095e6f35e5f None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:17.081423 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 532/1065] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:30:16 2022] GET /identity/v3/role_assignments?user.id=d2bda2aa1a9a4418a38cd24643349c4c&scope.project.id=b642196229884c96936c01db0eafab96&role.id=1e2bb0d759694428ada2b52285de933b => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:17.157403 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbae30-2865-44bc-9902-11e3be40c41c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:17.184530 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:17.198450 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5943c-ed5e-4810-97fe-f7a261873a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:17.199267 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5943c-ed5e-4810-97fe-f7a261873a11 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:17.199552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5943c-ed5e-4810-97fe-f7a261873a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:17.199829 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5943c-ed5e-4810-97fe-f7a261873a11 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:17.208198 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5943c-ed5e-4810-97fe-f7a261873a11 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:17.209725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5943c-ed5e-4810-97fe-f7a261873a11 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:17.228371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-e2b5943c-ed5e-4810-97fe-f7a261873a11 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 19:30:17.228371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:17.228371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:17.228371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:17.228371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:17.228371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:17.228371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:17.228371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:17.228371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:17.228371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:17.228371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:17.228371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:17.228371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:30:17.228371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:30:17.228371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:30:17.228371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:30:17.229397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:17.229397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:17.229397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:30:17.229397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:30:17.229397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:30:17.229397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:30:17.229397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:17.229397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:17.229397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:17.229397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:17.229397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:17.229397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:17.229397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:17.229397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:17.229397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:17.229397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:17.229397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:17.229397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:17.230376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:17.230376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:17.230376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:30:17.230376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:30:17.230376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:30:17.230376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:30:17.230376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:30:17.230376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:30:17.230376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 19:30:17.230376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:17.230376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 534/1066] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jun 14 19:30:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:30:17.235777 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac3e6a-34bb-42fc-9f70-2095e6f35e5f None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:17.340306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac3e6a-34bb-42fc-9f70-2095e6f35e5f None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:17.375481 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1151ea0-e185-46e4-b04e-aed3d6e9d99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:17.376147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1151ea0-e185-46e4-b04e-aed3d6e9d99a None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:17.376428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1151ea0-e185-46e4-b04e-aed3d6e9d99a None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:17.376701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1151ea0-e185-46e4-b04e-aed3d6e9d99a None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:17.377559 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1151ea0-e185-46e4-b04e-aed3d6e9d99a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:17.377868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1151ea0-e185-46e4-b04e-aed3d6e9d99a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:17.379293 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1151ea0-e185-46e4-b04e-aed3d6e9d99a None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:17.402075 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 533/1067] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jun 14 19:30:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:17.403678 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5943c-ed5e-4810-97fe-f7a261873a11 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:17.513880 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5943c-ed5e-4810-97fe-f7a261873a11 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:17.552735 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54634808-b31b-4060-a45d-903a11353e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:17.553584 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54634808-b31b-4060-a45d-903a11353e7f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:17.553891 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54634808-b31b-4060-a45d-903a11353e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:17.554171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54634808-b31b-4060-a45d-903a11353e7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:17.564579 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54634808-b31b-4060-a45d-903a11353e7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:17.566068 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54634808-b31b-4060-a45d-903a11353e7f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:17.583680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-54634808-b31b-4060-a45d-903a11353e7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:30:17.583680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:17.583680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:17.583680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:17.583680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:17.583680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:17.583680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:17.583680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:17.583680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:17.583680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:17.583680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:17.583680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:17.583680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:30:17.583680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:30:17.583680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:30:17.584589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:30:17.584589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:17.584589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:17.584589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:17.584589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:17.584589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:17.584589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:17.584589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:17.584589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:17.584589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:17.584589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:17.584589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:17.584589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:17.584589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:17.584589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:17.584589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:17.584589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:17.585921 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:30:17.585921 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:30:17.585921 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:30:17.585921 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:17.589525 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 535/1068] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:17.590854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1151ea0-e185-46e4-b04e-aed3d6e9d99a None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:17.606722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:17.698263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1151ea0-e185-46e4-b04e-aed3d6e9d99a None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:17.733648 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29460066-ffae-44a0-8a68-1b69d0836db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:17.734308 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29460066-ffae-44a0-8a68-1b69d0836db1 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:17.734590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29460066-ffae-44a0-8a68-1b69d0836db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:17.734865 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29460066-ffae-44a0-8a68-1b69d0836db1 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:17.735583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29460066-ffae-44a0-8a68-1b69d0836db1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:17.735891 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29460066-ffae-44a0-8a68-1b69d0836db1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:17.737243 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29460066-ffae-44a0-8a68-1b69d0836db1 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:17.750304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 534/1069] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:17.756173 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54634808-b31b-4060-a45d-903a11353e7f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:17.792282 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:17.869330 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54634808-b31b-4060-a45d-903a11353e7f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:17.908310 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62871641-abec-47da-b14c-3d30231142e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:17.909101 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62871641-abec-47da-b14c-3d30231142e4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:17.909399 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62871641-abec-47da-b14c-3d30231142e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:17.909683 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62871641-abec-47da-b14c-3d30231142e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:17.916786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62871641-abec-47da-b14c-3d30231142e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:17.918253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62871641-abec-47da-b14c-3d30231142e4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:17.932065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-62871641-abec-47da-b14c-3d30231142e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:30:17.932065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:17.932065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:17.932065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:17.932065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:17.932065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:17.932065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:17.932065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:17.932065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:17.932065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:17.932065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:17.932065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:17.932065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:30:17.932065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:30:17.932065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:30:17.932925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:30:17.932925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:17.932925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:17.932925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:17.932925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:17.932925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:17.932925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:17.932925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:17.932925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:17.932925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:17.932925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:17.932925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:17.932925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:17.932925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:17.932925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:17.932925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:17.932925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:17.939054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:30:17.939054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:30:17.939054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:30:17.939054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:30:17.939054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:30:17.939054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:30:17.939054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:30:17.939054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:17.939054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 536/1070] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:30:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:17.939975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb978f7-48d1-4ae2-a988-e1379550a2ed None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:17.940265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb978f7-48d1-4ae2-a988-e1379550a2ed None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:17.940542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb978f7-48d1-4ae2-a988-e1379550a2ed None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:17.940731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62871641-abec-47da-b14c-3d30231142e4 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:17.942067 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 535/1071] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:30:17.953019 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899c01e-dc1f-4dc6-b6ff-ab8251da356a None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:17.953281 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899c01e-dc1f-4dc6-b6ff-ab8251da356a None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:17.953590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899c01e-dc1f-4dc6-b6ff-ab8251da356a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:17.971612 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-9899c01e-dc1f-4dc6-b6ff-ab8251da356a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:17.972786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-9899c01e-dc1f-4dc6-b6ff-ab8251da356a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:18.046768 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 536/1072] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 19:30:18.049280 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:18.057137 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62871641-abec-47da-b14c-3d30231142e4 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:18.070340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899c01e-dc1f-4dc6-b6ff-ab8251da356a None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:18.074232 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:18.097411 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6bdf1-0799-4f11-89c1-0fcac5727dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:18.098310 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6bdf1-0799-4f11-89c1-0fcac5727dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:18.098593 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6bdf1-0799-4f11-89c1-0fcac5727dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:18.098872 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6bdf1-0799-4f11-89c1-0fcac5727dd9 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:18.099658 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6bdf1-0799-4f11-89c1-0fcac5727dd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:18.099967 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6bdf1-0799-4f11-89c1-0fcac5727dd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:18.101420 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6bdf1-0799-4f11-89c1-0fcac5727dd9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:18.114992 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 537/1073] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:30:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:18.120638 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6bdf1-0799-4f11-89c1-0fcac5727dd9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:18.187482 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899c01e-dc1f-4dc6-b6ff-ab8251da356a None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:18.223584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4b57d-2338-49a4-9915-e2658f6fe577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:18.224235 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4b57d-2338-49a4-9915-e2658f6fe577 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:18.224520 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4b57d-2338-49a4-9915-e2658f6fe577 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:18.226617 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4b57d-2338-49a4-9915-e2658f6fe577 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:18.231633 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6bdf1-0799-4f11-89c1-0fcac5727dd9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:18.269498 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ff733-a318-4728-afdf-120b64a836c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:18.270386 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ff733-a318-4728-afdf-120b64a836c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:18.270659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ff733-a318-4728-afdf-120b64a836c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:18.270931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8ff733-a318-4728-afdf-120b64a836c3 None admin] PATH_INFO: `/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/37c521e20aea4cad9758568a4f082fbd/roles/04984986168e4190919081ad55f01b76` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:18.273212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ff733-a318-4728-afdf-120b64a836c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d3e177b11504cb3b19d25ed5850ef12, user_id=37c521e20aea4cad9758568a4f082fbd, role_id=04984986168e4190919081ad55f01b76)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:18.274664 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8ff733-a318-4728-afdf-120b64a836c3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:18.293401 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 538/1074] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:30:18 2022] PUT /identity/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/37c521e20aea4cad9758568a4f082fbd/roles/04984986168e4190919081ad55f01b76 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:30:18.299184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4b57d-2338-49a4-9915-e2658f6fe577 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:18.300655 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4b57d-2338-49a4-9915-e2658f6fe577 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:18.303171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:18.426593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 537/1075] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:30:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 14 19:30:18.428270 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ff733-a318-4728-afdf-120b64a836c3 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:18.447113 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:18.541675 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8ff733-a318-4728-afdf-120b64a836c3 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:18.577676 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58b025-e446-40c2-9b73-695e7b2cb3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:18.578462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58b025-e446-40c2-9b73-695e7b2cb3eb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:18.578738 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58b025-e446-40c2-9b73-695e7b2cb3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:18.579006 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58b025-e446-40c2-9b73-695e7b2cb3eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:18.589637 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58b025-e446-40c2-9b73-695e7b2cb3eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:18.591075 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58b025-e446-40c2-9b73-695e7b2cb3eb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:18.609151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-ca58b025-e446-40c2-9b73-695e7b2cb3eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:30:18.609151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:18.609151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:18.609151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:18.609151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:18.609151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:18.609151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:18.609151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:18.609151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:18.609151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:18.609151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:18.609151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:18.609151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:30:18.609151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:30:18.609151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:30:18.610239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:30:18.610239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:18.610239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:18.610239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:18.610239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:18.610239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:18.610239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:18.610239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:18.610239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:18.610239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:18.610239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:18.610239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:18.610239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:18.610239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:18.610239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:18.610239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:18.610239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:18.611164 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:30:18.611164 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:30:18.611164 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:30:18.611164 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:18.611164 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 539/1076] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:18.618864 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4b57d-2338-49a4-9915-e2658f6fe577 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:18.726017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4b57d-2338-49a4-9915-e2658f6fe577 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:18.727763 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:18.763428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaafc40-f5aa-4e36-b050-cfc1d62341f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:18.764464 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaafc40-f5aa-4e36-b050-cfc1d62341f4 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:18.764986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaafc40-f5aa-4e36-b050-cfc1d62341f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:18.765626 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaafc40-f5aa-4e36-b050-cfc1d62341f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:18.766592 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaafc40-f5aa-4e36-b050-cfc1d62341f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:18.767045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaafc40-f5aa-4e36-b050-cfc1d62341f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:18.768585 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaafc40-f5aa-4e36-b050-cfc1d62341f4 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:18.781716 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 538/1077] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:19.212449 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b9da6-5101-4041-8fa8-d4dd9af62ec1 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:19.212972 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b9da6-5101-4041-8fa8-d4dd9af62ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:19.212972 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b9da6-5101-4041-8fa8-d4dd9af62ec1 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:19.214351 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 540/1078] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:19.220353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa6552-ed3c-4fda-a1bb-a5690de9dc6c None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:19.220780 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa6552-ed3c-4fda-a1bb-a5690de9dc6c None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:19.220919 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa6552-ed3c-4fda-a1bb-a5690de9dc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:19.238145 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-19fa6552-ed3c-4fda-a1bb-a5690de9dc6c None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:19.239407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-19fa6552-ed3c-4fda-a1bb-a5690de9dc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:19.306424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 539/1079] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 19:30:19.329653 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b9da6-5101-4041-8fa8-d4dd9af62ec1 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:19.400038 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:19.436351 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b9da6-5101-4041-8fa8-d4dd9af62ec1 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:19.471955 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a4597-f0d2-4860-a2fb-1451d3ba260c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:19.472752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a4597-f0d2-4860-a2fb-1451d3ba260c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:19.473036 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a4597-f0d2-4860-a2fb-1451d3ba260c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:19.473315 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a4597-f0d2-4860-a2fb-1451d3ba260c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:19.483508 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a4597-f0d2-4860-a2fb-1451d3ba260c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:30:19.491119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-f36a4597-f0d2-4860-a2fb-1451d3ba260c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:30:19.491119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:19.491119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:19.491119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:19.491119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:19.491119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:19.491119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:19.491119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:19.491119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:19.491119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:19.491119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:19.491119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:19.491119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:30:19.491119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:30:19.491119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:30:19.491119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:30:19.492032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:30:19.492032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:30:19.492032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:30:19.492032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:30:19.492032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:19.492032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:19.492032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:19.492032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:19.492032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:19.492032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:19.492032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:19.492032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:19.492032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:19.492032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:19.492032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:19.492032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:19.493026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:19.493026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:19.493026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:19.493026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:19.493026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:30:19.493026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:30:19.493026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:30:19.493026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:30:19.493026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:30:19.493026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:30:19.493026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:30:19.493026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:19.493026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 541/1080] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:30:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:19.498405 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa6552-ed3c-4fda-a1bb-a5690de9dc6c None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:19.588346 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:19.598032 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa6552-ed3c-4fda-a1bb-a5690de9dc6c None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:19.631642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fa5e5-b7d4-4c8d-bf3d-93afcd814c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:19.632293 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fa5e5-b7d4-4c8d-bf3d-93afcd814c35 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:19.632571 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fa5e5-b7d4-4c8d-bf3d-93afcd814c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:19.632839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3fa5e5-b7d4-4c8d-bf3d-93afcd814c35 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:19.633593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fa5e5-b7d4-4c8d-bf3d-93afcd814c35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:19.633898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fa5e5-b7d4-4c8d-bf3d-93afcd814c35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:19.635235 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3fa5e5-b7d4-4c8d-bf3d-93afcd814c35 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:19.644300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 540/1081] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:30:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:19.650108 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a4597-f0d2-4860-a2fb-1451d3ba260c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:19.749916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a4597-f0d2-4860-a2fb-1451d3ba260c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:19.774329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:19.784974 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17139dcd-51dd-4dbe-b413-640de3349bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:19.785862 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17139dcd-51dd-4dbe-b413-640de3349bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:19.786146 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17139dcd-51dd-4dbe-b413-640de3349bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:19.786419 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17139dcd-51dd-4dbe-b413-640de3349bb2 None admin] PATH_INFO: `/v3/users/d2bda2aa1a9a4418a38cd24643349c4c` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:19.787618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17139dcd-51dd-4dbe-b413-640de3349bb2 None admin] RBAC: Authorizing `identity:get_user(user_id=d2bda2aa1a9a4418a38cd24643349c4c)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:19.789302 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17139dcd-51dd-4dbe-b413-640de3349bb2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:19.790939 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 542/1082] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:30:19 2022] GET /identity/v3/users/d2bda2aa1a9a4418a38cd24643349c4c => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:30:19.796677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fa5e5-b7d4-4c8d-bf3d-93afcd814c35 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:19.902785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3fa5e5-b7d4-4c8d-bf3d-93afcd814c35 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:19.936168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b086f9b-4bc3-4299-943b-0d67884bd236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:19.937745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b086f9b-4bc3-4299-943b-0d67884bd236 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:19.938092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b086f9b-4bc3-4299-943b-0d67884bd236 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:19.938376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b086f9b-4bc3-4299-943b-0d67884bd236 None admin] PATH_INFO: `/v3/projects/b642196229884c96936c01db0eafab96` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:19.939566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b086f9b-4bc3-4299-943b-0d67884bd236 None admin] RBAC: Authorizing `identity:get_project(project_id=b642196229884c96936c01db0eafab96)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:19.940992 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b086f9b-4bc3-4299-943b-0d67884bd236 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:19.942724 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 541/1083] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:30:19 2022] GET /identity/v3/projects/b642196229884c96936c01db0eafab96 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:30:19.948614 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17139dcd-51dd-4dbe-b413-640de3349bb2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:20.049070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17139dcd-51dd-4dbe-b413-640de3349bb2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:20.081728 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8828b-4f67-4b61-922a-32b4664ad299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:20.082608 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8828b-4f67-4b61-922a-32b4664ad299 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:20.082889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8828b-4f67-4b61-922a-32b4664ad299 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:20.083162 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8828b-4f67-4b61-922a-32b4664ad299 None admin] PATH_INFO: `/v3/projects/b642196229884c96936c01db0eafab96/users/d2bda2aa1a9a4418a38cd24643349c4c/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:20.085109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8828b-4f67-4b61-922a-32b4664ad299 None admin] RBAC: Authorizing `identity:create_grant(project_id=b642196229884c96936c01db0eafab96, user_id=d2bda2aa1a9a4418a38cd24643349c4c, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:20.086588 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8828b-4f67-4b61-922a-32b4664ad299 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:20.099247 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 543/1084] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:30:19 2022] PUT /identity/v3/projects/b642196229884c96936c01db0eafab96/users/d2bda2aa1a9a4418a38cd24643349c4c/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:30:20.434985 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78eb55b-8343-485a-b6c4-801f5d73472d None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:20.435470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78eb55b-8343-485a-b6c4-801f5d73472d None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:20.435470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78eb55b-8343-485a-b6c4-801f5d73472d None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:20.437911 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 542/1085] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:20.442991 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c7d63-d1d2-4dc8-adc0-df004ea75599 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:20.443446 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c7d63-d1d2-4dc8-adc0-df004ea75599 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:20.443540 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c7d63-d1d2-4dc8-adc0-df004ea75599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:20.461437 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-165c7d63-d1d2-4dc8-adc0-df004ea75599 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:20.462611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-165c7d63-d1d2-4dc8-adc0-df004ea75599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:20.511439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:20.531180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 544/1086] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:20.554907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78eb55b-8343-485a-b6c4-801f5d73472d None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:20.582782 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:20.668154 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78eb55b-8343-485a-b6c4-801f5d73472d None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:20.702522 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f17303-840a-4967-a1a0-a631096ca566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:20.703258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f17303-840a-4967-a1a0-a631096ca566 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:20.703538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f17303-840a-4967-a1a0-a631096ca566 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:20.703812 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f17303-840a-4967-a1a0-a631096ca566 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:20.714190 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f17303-840a-4967-a1a0-a631096ca566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:30:20.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-37f17303-840a-4967-a1a0-a631096ca566 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 19:30:20.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:20.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:20.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:20.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:20.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:20.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:20.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:20.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:20.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:20.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:20.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:20.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:30:20.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:30:20.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:30:20.722175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:30:20.723268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:30:20.723268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:30:20.723268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:30:20.723268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:30:20.723268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:20.723268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:20.723268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:20.723268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:20.723268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:20.723268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:20.723268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:20.723268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:20.723268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:20.723268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:20.723268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:20.723268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:20.724204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:20.724204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:20.724204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:20.724204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:20.724204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:30:20.724204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:30:20.724204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:30:20.724204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:30:20.724204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:30:20.724204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:30:20.724204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 14 19:30:20.724204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:20.724204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 543/1087] 10.222.0.44 () {56 vars in 1120 bytes} [Tue Jun 14 19:30:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:20.731349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c7d63-d1d2-4dc8-adc0-df004ea75599 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:20.835394 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c7d63-d1d2-4dc8-adc0-df004ea75599 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:20.870797 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafaf92-908f-4c84-bbfa-30e14031a8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:20.871466 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafaf92-908f-4c84-bbfa-30e14031a8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:20.871746 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafaf92-908f-4c84-bbfa-30e14031a8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:20.872022 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deafaf92-908f-4c84-bbfa-30e14031a8d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:20.872764 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafaf92-908f-4c84-bbfa-30e14031a8d0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:20.873071 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafaf92-908f-4c84-bbfa-30e14031a8d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:20.875095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deafaf92-908f-4c84-bbfa-30e14031a8d0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:20.883464 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 545/1088] 10.222.0.44 () {56 vars in 1115 bytes} [Tue Jun 14 19:30:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:20.889191 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f17303-840a-4967-a1a0-a631096ca566 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:20.973225 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:20.993477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f17303-840a-4967-a1a0-a631096ca566 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:21.027335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6acd39-8749-4d66-9752-58e39c1ba02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:21.028117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6acd39-8749-4d66-9752-58e39c1ba02f None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:21.028399 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6acd39-8749-4d66-9752-58e39c1ba02f None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:21.028674 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6acd39-8749-4d66-9752-58e39c1ba02f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:21.039494 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6acd39-8749-4d66-9752-58e39c1ba02f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:21.040927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6acd39-8749-4d66-9752-58e39c1ba02f None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:21.058486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-6c6acd39-8749-4d66-9752-58e39c1ba02f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:30:21.058486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:21.058486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:21.058486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:21.058486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:21.058486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:21.058486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:21.058486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:21.058486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:21.058486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:21.058486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:21.058486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:21.058486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:30:21.058486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:30:21.058486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:30:21.059345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:30:21.059345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:21.059345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:21.059345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:21.059345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:21.059345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:21.059345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:21.059345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:21.059345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:21.059345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:21.059345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:21.059345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:21.059345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:21.059345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:21.059345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:21.059345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:21.059345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:21.060257 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:30:21.060257 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:30:21.060257 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:30:21.060257 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:21.061830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 544/1089] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:30:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:21.065263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafaf92-908f-4c84-bbfa-30e14031a8d0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:21.116446 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:21.172645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deafaf92-908f-4c84-bbfa-30e14031a8d0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:21.216343 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17181552-d7e9-4fab-98d6-a26469ff2422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:21.217001 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17181552-d7e9-4fab-98d6-a26469ff2422 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:21.217287 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17181552-d7e9-4fab-98d6-a26469ff2422 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:21.218113 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17181552-d7e9-4fab-98d6-a26469ff2422 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:21.218918 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17181552-d7e9-4fab-98d6-a26469ff2422 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:21.219229 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17181552-d7e9-4fab-98d6-a26469ff2422 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:21.220596 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17181552-d7e9-4fab-98d6-a26469ff2422 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:21.238135 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 546/1090] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:21.239099 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6acd39-8749-4d66-9752-58e39c1ba02f None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:21.341137 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6acd39-8749-4d66-9752-58e39c1ba02f None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:21.386882 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43026fba-7187-4ad2-ae51-c918e80e14b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:21.387740 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43026fba-7187-4ad2-ae51-c918e80e14b6 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:21.388092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43026fba-7187-4ad2-ae51-c918e80e14b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:21.388433 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43026fba-7187-4ad2-ae51-c918e80e14b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:21.390765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:21.398825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43026fba-7187-4ad2-ae51-c918e80e14b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:21.400274 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43026fba-7187-4ad2-ae51-c918e80e14b6 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:21.415159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-43026fba-7187-4ad2-ae51-c918e80e14b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 14 19:30:21.415159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:21.415159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:21.415159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:21.415159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:21.415159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:21.415159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:21.415159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:21.415159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:21.415159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:21.415159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:21.415159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:21.415159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:30:21.415159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:30:21.415159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:30:21.415159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:30:21.416094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:21.416094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:21.416094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:30:21.416094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:30:21.416094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:30:21.416094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:30:21.416094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:21.416094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:21.416094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:21.416094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:21.416094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:21.416094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:21.416094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:21.416094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:21.416094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:21.416094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:21.416094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:21.416094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:21.417027 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:21.417027 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:21.417027 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:30:21.417027 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:30:21.417027 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:30:21.417027 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:30:21.417027 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:30:21.417027 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:30:21.417027 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 14 19:30:21.417027 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:21.417027 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 545/1091] 10.222.0.44 () {56 vars in 1093 bytes} [Tue Jun 14 19:30:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:21.422722 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17181552-d7e9-4fab-98d6-a26469ff2422 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:21.519363 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17181552-d7e9-4fab-98d6-a26469ff2422 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:21.526550 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:21.555534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df44d4d-3367-4d7e-94ee-f92900730faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:21.556187 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df44d4d-3367-4d7e-94ee-f92900730faa None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:21.556477 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df44d4d-3367-4d7e-94ee-f92900730faa None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:21.556751 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df44d4d-3367-4d7e-94ee-f92900730faa None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:21.557602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df44d4d-3367-4d7e-94ee-f92900730faa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:21.557904 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df44d4d-3367-4d7e-94ee-f92900730faa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:21.559325 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df44d4d-3367-4d7e-94ee-f92900730faa None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:21.581796 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 547/1092] 10.222.0.44 () {56 vars in 1133 bytes} [Tue Jun 14 19:30:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:21.582862 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43026fba-7187-4ad2-ae51-c918e80e14b6 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:21.691544 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43026fba-7187-4ad2-ae51-c918e80e14b6 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:21.726597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597ae3d-8b60-42ba-8438-7587b8316a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:21.727249 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597ae3d-8b60-42ba-8438-7587b8316a7b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:21.727542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597ae3d-8b60-42ba-8438-7587b8316a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:21.727798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597ae3d-8b60-42ba-8438-7587b8316a7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:21.793870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:21.801825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597ae3d-8b60-42ba-8438-7587b8316a7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:21.803292 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597ae3d-8b60-42ba-8438-7587b8316a7b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:21.913525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 546/1093] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:30:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 14 19:30:21.913996 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df44d4d-3367-4d7e-94ee-f92900730faa None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:22.016833 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df44d4d-3367-4d7e-94ee-f92900730faa None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:22.051471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea24bf-4e5e-4921-8597-a2eb91801906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:22.052202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea24bf-4e5e-4921-8597-a2eb91801906 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:22.052487 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea24bf-4e5e-4921-8597-a2eb91801906 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:22.052769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea24bf-4e5e-4921-8597-a2eb91801906 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:22.063693 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea24bf-4e5e-4921-8597-a2eb91801906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:22.065151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea24bf-4e5e-4921-8597-a2eb91801906 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:22.084168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-52ea24bf-4e5e-4921-8597-a2eb91801906 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:30:22.084168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:22.084168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:22.084168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:22.084168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:22.084168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:22.084168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:22.084168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:22.084168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:22.084168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:22.084168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:22.084168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:22.084168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:30:22.084168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:30:22.084168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:30:22.085328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:30:22.085328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:22.085328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:22.085328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:22.085328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:22.085328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:22.085328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:22.085328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:22.085328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:22.085328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:22.085328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:22.085328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:22.085328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:22.085328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:22.085328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:22.085328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:22.085328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:22.086849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:30:22.086849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:30:22.086849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:30:22.086849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:22.086849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 548/1094] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:30:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:30:22.090972 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597ae3d-8b60-42ba-8438-7587b8316a7b None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:22.185486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:22.193578 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597ae3d-8b60-42ba-8438-7587b8316a7b None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:22.228554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b2e92-cd09-41ce-b6d6-68e044889ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:22.229207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b2e92-cd09-41ce-b6d6-68e044889ecd None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:22.229521 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b2e92-cd09-41ce-b6d6-68e044889ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:22.229794 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b2e92-cd09-41ce-b6d6-68e044889ecd None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:22.230502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b2e92-cd09-41ce-b6d6-68e044889ecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:22.230804 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b2e92-cd09-41ce-b6d6-68e044889ecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:22.232173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b2e92-cd09-41ce-b6d6-68e044889ecd None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:22.243712 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 547/1095] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:22.249815 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b2e92-cd09-41ce-b6d6-68e044889ecd None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:22.249985 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9523e74-7282-4205-8536-905fd8729c8d None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:22.250418 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9523e74-7282-4205-8536-905fd8729c8d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:22.250702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9523e74-7282-4205-8536-905fd8729c8d None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:22.252253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 549/1096] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:22.257285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00185d-3d19-4f08-8669-14535bcd43ce None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:22.257610 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00185d-3d19-4f08-8669-14535bcd43ce None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:22.257892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c00185d-3d19-4f08-8669-14535bcd43ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:22.274285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1c00185d-3d19-4f08-8669-14535bcd43ce None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:22.275469 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1c00185d-3d19-4f08-8669-14535bcd43ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:22.286114 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:22.342941 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 550/1097] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 19:30:22.348992 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b2e92-cd09-41ce-b6d6-68e044889ecd None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:22.366211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00185d-3d19-4f08-8669-14535bcd43ce None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:22.384641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e1130-0786-4ccb-b3f8-f4030b41b1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:22.385458 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e1130-0786-4ccb-b3f8-f4030b41b1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:22.385753 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e1130-0786-4ccb-b3f8-f4030b41b1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:22.386033 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5e1130-0786-4ccb-b3f8-f4030b41b1c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:22.393038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e1130-0786-4ccb-b3f8-f4030b41b1c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:22.394525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5e1130-0786-4ccb-b3f8-f4030b41b1c8 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:22.409969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-eb5e1130-0786-4ccb-b3f8-f4030b41b1c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:30:22.409969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:22.409969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:22.409969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:22.409969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:22.409969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:22.409969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:22.409969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:22.409969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:22.409969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:22.409969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:22.409969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:22.409969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:30:22.409969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:30:22.409969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:30:22.411034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:30:22.411034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:22.411034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:22.411034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:22.411034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:22.411034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:22.411034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:22.411034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:22.411034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:22.411034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:22.411034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:22.411034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:22.411034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:22.411034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:22.411034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:22.411034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:22.411034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:22.411996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:30:22.411996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:30:22.411996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:30:22.411996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:30:22.411996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:30:22.411996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:30:22.411996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:30:22.411996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:22.411996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 548/1098] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:30:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:30:22.417284 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e1130-0786-4ccb-b3f8-f4030b41b1c8 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:22.432879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:22.473719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c00185d-3d19-4f08-8669-14535bcd43ce None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:22.507514 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c5da9-1144-47bc-9312-8f61bb7b72d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:22.508300 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c5da9-1144-47bc-9312-8f61bb7b72d3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:22.508583 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c5da9-1144-47bc-9312-8f61bb7b72d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:22.508859 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c5da9-1144-47bc-9312-8f61bb7b72d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:22.518598 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5e1130-0786-4ccb-b3f8-f4030b41b1c8 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:22.519562 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c5da9-1144-47bc-9312-8f61bb7b72d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:30:22.527259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-108c5da9-1144-47bc-9312-8f61bb7b72d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:30:22.527259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:22.527259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:22.527259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:22.527259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:22.527259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:22.527259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:22.527259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:22.527259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:22.527259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:22.527259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:22.527259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:22.527259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:30:22.527259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:30:22.527259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:30:22.527259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:30:22.528263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:30:22.528263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:30:22.528263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:30:22.528263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:30:22.528263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:22.528263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:22.528263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:22.528263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:22.528263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:22.528263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:22.528263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:22.528263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:22.528263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:22.528263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:22.528263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:22.528263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:22.529104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:22.529104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:22.529104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:22.529104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:22.529104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:30:22.529104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:30:22.529104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:30:22.529104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:30:22.529104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:30:22.529104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:30:22.529104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:30:22.529104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:22.529104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 551/1099] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:30:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:30:22.534958 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c5da9-1144-47bc-9312-8f61bb7b72d3 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:22.544006 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:22.556118 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88aceb3-2781-4f5e-9a26-23b7228c82f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:22.556785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88aceb3-2781-4f5e-9a26-23b7228c82f1 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:22.557072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88aceb3-2781-4f5e-9a26-23b7228c82f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:22.557353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88aceb3-2781-4f5e-9a26-23b7228c82f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:22.558179 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88aceb3-2781-4f5e-9a26-23b7228c82f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:22.558491 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88aceb3-2781-4f5e-9a26-23b7228c82f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:22.559917 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88aceb3-2781-4f5e-9a26-23b7228c82f1 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:22.572892 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 549/1100] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:30:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:30:22.578860 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88aceb3-2781-4f5e-9a26-23b7228c82f1 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:22.637631 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c5da9-1144-47bc-9312-8f61bb7b72d3 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:22.651739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:22.673306 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32c3ac-fcd9-4773-baf4-8f72f865e6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:22.674137 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32c3ac-fcd9-4773-baf4-8f72f865e6eb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:22.676120 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32c3ac-fcd9-4773-baf4-8f72f865e6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:22.676120 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32c3ac-fcd9-4773-baf4-8f72f865e6eb None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:22.676120 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32c3ac-fcd9-4773-baf4-8f72f865e6eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:22.676120 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32c3ac-fcd9-4773-baf4-8f72f865e6eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:22.677100 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32c3ac-fcd9-4773-baf4-8f72f865e6eb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:22.680662 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88aceb3-2781-4f5e-9a26-23b7228c82f1 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:22.685362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 552/1101] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:30:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:30:22.691727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32c3ac-fcd9-4773-baf4-8f72f865e6eb None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:22.715030 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f1f14-5c11-4151-8cf3-14d4235aa48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:22.715683 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f1f14-5c11-4151-8cf3-14d4235aa48b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:22.715960 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f1f14-5c11-4151-8cf3-14d4235aa48b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:22.716237 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f1f14-5c11-4151-8cf3-14d4235aa48b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:22.717061 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f1f14-5c11-4151-8cf3-14d4235aa48b None admin] RBAC: Adding query filter params (role.id=04984986168e4190919081ad55f01b76, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=37c521e20aea4cad9758568a4f082fbd) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:22.717368 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f1f14-5c11-4151-8cf3-14d4235aa48b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:22.728333 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f1f14-5c11-4151-8cf3-14d4235aa48b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:22.749410 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 550/1102] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:30:22 2022] GET /identity/v3/role_assignments?user.id=37c521e20aea4cad9758568a4f082fbd&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=04984986168e4190919081ad55f01b76 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:30:22.758824 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:22.799876 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32c3ac-fcd9-4773-baf4-8f72f865e6eb None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:22.837836 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d1b41-80f1-4607-8963-f91f32d4b599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:22.838715 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d1b41-80f1-4607-8963-f91f32d4b599 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:22.838995 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d1b41-80f1-4607-8963-f91f32d4b599 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:22.839269 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d1b41-80f1-4607-8963-f91f32d4b599 None admin] PATH_INFO: `/v3/users/d2bda2aa1a9a4418a38cd24643349c4c` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:22.840488 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d1b41-80f1-4607-8963-f91f32d4b599 None admin] RBAC: Authorizing `identity:get_user(user_id=d2bda2aa1a9a4418a38cd24643349c4c)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:22.841977 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2d1b41-80f1-4607-8963-f91f32d4b599 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:22.844820 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 553/1103] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:30:22 2022] GET /identity/v3/users/d2bda2aa1a9a4418a38cd24643349c4c => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:30:22.850709 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f1f14-5c11-4151-8cf3-14d4235aa48b None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:22.956614 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f1f14-5c11-4151-8cf3-14d4235aa48b None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:22.991399 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a3cb8-88de-4dc0-9ef5-ad506622fd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:22.992328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a3cb8-88de-4dc0-9ef5-ad506622fd7b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:22.992610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a3cb8-88de-4dc0-9ef5-ad506622fd7b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:22.992889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a3cb8-88de-4dc0-9ef5-ad506622fd7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:23.003950 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:23.067170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a3cb8-88de-4dc0-9ef5-ad506622fd7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:23.068611 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a3cb8-88de-4dc0-9ef5-ad506622fd7b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:23.172455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 551/1104] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:30:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 19:30:23.178437 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d1b41-80f1-4607-8963-f91f32d4b599 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:23.284331 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d1b41-80f1-4607-8963-f91f32d4b599 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:23.321846 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f5f13-688a-4195-91f2-7e50dd3f2ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:23.322705 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f5f13-688a-4195-91f2-7e50dd3f2ffb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:23.322991 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f5f13-688a-4195-91f2-7e50dd3f2ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:23.323269 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f5f13-688a-4195-91f2-7e50dd3f2ffb None admin] PATH_INFO: `/v3/projects/b642196229884c96936c01db0eafab96` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:23.324523 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f5f13-688a-4195-91f2-7e50dd3f2ffb None admin] RBAC: Authorizing `identity:get_project(project_id=b642196229884c96936c01db0eafab96)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:23.326120 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f5f13-688a-4195-91f2-7e50dd3f2ffb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:23.328164 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 554/1105] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:30:23 2022] GET /identity/v3/projects/b642196229884c96936c01db0eafab96 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:23.334451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a3cb8-88de-4dc0-9ef5-ad506622fd7b None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:23.377615 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:23.452697 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a3cb8-88de-4dc0-9ef5-ad506622fd7b None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:23.488180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48668b69-579a-40e3-8ed7-842f035b367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:23.488835 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48668b69-579a-40e3-8ed7-842f035b367d None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:23.489117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48668b69-579a-40e3-8ed7-842f035b367d None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:23.489430 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48668b69-579a-40e3-8ed7-842f035b367d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:23.490834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48668b69-579a-40e3-8ed7-842f035b367d None admin] RBAC: Adding query filter params (role.id=1e2bb0d759694428ada2b52285de933b, scope.project.id=b642196229884c96936c01db0eafab96, user.id=d2bda2aa1a9a4418a38cd24643349c4c) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:23.490834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48668b69-579a-40e3-8ed7-842f035b367d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:23.491981 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48668b69-579a-40e3-8ed7-842f035b367d None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:23.498149 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 552/1106] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:30:23 2022] GET /identity/v3/role_assignments?user.id=d2bda2aa1a9a4418a38cd24643349c4c&scope.project.id=b642196229884c96936c01db0eafab96&role.id=1e2bb0d759694428ada2b52285de933b => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:25.644096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e7b17-285c-404e-bc21-a285c9b2a682 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:25.644624 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e7b17-285c-404e-bc21-a285c9b2a682 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:25.644624 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e7b17-285c-404e-bc21-a285c9b2a682 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:25.646040 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 555/1107] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:25.651407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a641fb-faeb-4c2c-90f7-7ae42f1594a5 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:25.651821 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a641fb-faeb-4c2c-90f7-7ae42f1594a5 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:25.651971 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a641fb-faeb-4c2c-90f7-7ae42f1594a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:25.669547 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-e1a641fb-faeb-4c2c-90f7-7ae42f1594a5 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:25.670764 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e1a641fb-faeb-4c2c-90f7-7ae42f1594a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:25.736037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 553/1108] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 19:30:25.761037 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e7b17-285c-404e-bc21-a285c9b2a682 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:25.765549 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:25.862557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e7b17-285c-404e-bc21-a285c9b2a682 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:25.897045 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed37dc-1ede-4932-aa37-12fc5a792495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:25.897807 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed37dc-1ede-4932-aa37-12fc5a792495 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:25.898098 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed37dc-1ede-4932-aa37-12fc5a792495 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:25.898376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed37dc-1ede-4932-aa37-12fc5a792495 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:25.899534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed37dc-1ede-4932-aa37-12fc5a792495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:25.900974 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed37dc-1ede-4932-aa37-12fc5a792495 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:25.902608 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 556/1109] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:30:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:25.908323 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a641fb-faeb-4c2c-90f7-7ae42f1594a5 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:25.939830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:26.008878 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a641fb-faeb-4c2c-90f7-7ae42f1594a5 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:26.042949 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd586e8-5efe-4b02-b943-f6c0fa4e4014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:26.043640 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd586e8-5efe-4b02-b943-f6c0fa4e4014 None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:26.043924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd586e8-5efe-4b02-b943-f6c0fa4e4014 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:26.044203 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd586e8-5efe-4b02-b943-f6c0fa4e4014 None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:26.044920 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd586e8-5efe-4b02-b943-f6c0fa4e4014 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:26.047737 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd586e8-5efe-4b02-b943-f6c0fa4e4014 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:26.070660 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 554/1110] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jun 14 19:30:25 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:30:28.245411 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cc2ba-2085-486e-b35c-beadb864156e None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:28.245411 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cc2ba-2085-486e-b35c-beadb864156e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:28.245411 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cc2ba-2085-486e-b35c-beadb864156e None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:28.246670 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 557/1111] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:28.252164 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc66bad-9781-436b-8f39-a85e6e5e8f01 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:28.252560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc66bad-9781-436b-8f39-a85e6e5e8f01 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:28.252737 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc66bad-9781-436b-8f39-a85e6e5e8f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:28.270238 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-4bc66bad-9781-436b-8f39-a85e6e5e8f01 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:28.271424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-4bc66bad-9781-436b-8f39-a85e6e5e8f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:28.337117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 555/1112] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:28.361510 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cc2ba-2085-486e-b35c-beadb864156e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:28.430755 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:28.460390 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cc2ba-2085-486e-b35c-beadb864156e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:28.492886 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1252cb9-da87-4464-8337-dbdf19ac44ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:28.493761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1252cb9-da87-4464-8337-dbdf19ac44ba None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:28.494048 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1252cb9-da87-4464-8337-dbdf19ac44ba None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:28.494325 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1252cb9-da87-4464-8337-dbdf19ac44ba None admin] PATH_INFO: `/v3/roles/1302d95e46b4422d84f581f8838d5aac` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:28.495830 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1252cb9-da87-4464-8337-dbdf19ac44ba None admin] RBAC: Authorizing `identity:get_role(role_id=1302d95e46b4422d84f581f8838d5aac)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:28.497152 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1252cb9-da87-4464-8337-dbdf19ac44ba None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:28.498565 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 558/1113] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:30:28 2022] GET /identity/v3/roles/1302d95e46b4422d84f581f8838d5aac => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:28.504481 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc66bad-9781-436b-8f39-a85e6e5e8f01 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:28.522975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:28.602357 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc66bad-9781-436b-8f39-a85e6e5e8f01 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:28.636569 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3ef32-f55c-45a5-a737-f72c28292e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:28.637452 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3ef32-f55c-45a5-a737-f72c28292e2b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:28.637731 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3ef32-f55c-45a5-a737-f72c28292e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:28.638003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3ef32-f55c-45a5-a737-f72c28292e2b None admin] PATH_INFO: `/v3/users/92a1c8d2e4884edfb9c47b81dff2ccd3` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:28.651501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3ef32-f55c-45a5-a737-f72c28292e2b None admin] RBAC: Authorizing `identity:get_user(user_id=92a1c8d2e4884edfb9c47b81dff2ccd3)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:28.652922 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3ef32-f55c-45a5-a737-f72c28292e2b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:28.654601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 556/1114] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:30:28 2022] GET /identity/v3/users/92a1c8d2e4884edfb9c47b81dff2ccd3 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:28.660960 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1252cb9-da87-4464-8337-dbdf19ac44ba None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:28.758341 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1252cb9-da87-4464-8337-dbdf19ac44ba None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:28.791819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37055628-1d29-4728-ab22-cad5ef90d08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:28.792447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37055628-1d29-4728-ab22-cad5ef90d08d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:28.792730 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37055628-1d29-4728-ab22-cad5ef90d08d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:28.793007 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37055628-1d29-4728-ab22-cad5ef90d08d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:28.803160 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:28.860112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37055628-1d29-4728-ab22-cad5ef90d08d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:28.861585 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37055628-1d29-4728-ab22-cad5ef90d08d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:28.958567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 559/1115] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:30:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 19:30:28.964449 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3ef32-f55c-45a5-a737-f72c28292e2b None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:29.038878 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:29.061591 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3ef32-f55c-45a5-a737-f72c28292e2b None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:29.094987 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c46765-45e7-4f8f-9c89-f6127b0e9bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:29.095838 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c46765-45e7-4f8f-9c89-f6127b0e9bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:29.096122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c46765-45e7-4f8f-9c89-f6127b0e9bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:29.096400 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c46765-45e7-4f8f-9c89-f6127b0e9bd8 None admin] PATH_INFO: `/v3/projects/b642196229884c96936c01db0eafab96` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:29.097588 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c46765-45e7-4f8f-9c89-f6127b0e9bd8 None admin] RBAC: Authorizing `identity:get_project(project_id=b642196229884c96936c01db0eafab96)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:29.099011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c46765-45e7-4f8f-9c89-f6127b0e9bd8 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:29.100686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 557/1116] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:30:28 2022] GET /identity/v3/projects/b642196229884c96936c01db0eafab96 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:29.106833 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37055628-1d29-4728-ab22-cad5ef90d08d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:29.146936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:29.204761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37055628-1d29-4728-ab22-cad5ef90d08d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:29.237034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb48e0-9530-4dbe-8742-4d3c1723bfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:29.237696 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb48e0-9530-4dbe-8742-4d3c1723bfd9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:29.237980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb48e0-9530-4dbe-8742-4d3c1723bfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:29.238252 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb48e0-9530-4dbe-8742-4d3c1723bfd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:29.239072 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb48e0-9530-4dbe-8742-4d3c1723bfd9 None admin] RBAC: Adding query filter params (role.id=1302d95e46b4422d84f581f8838d5aac, scope.project.id=b642196229884c96936c01db0eafab96, user.id=92a1c8d2e4884edfb9c47b81dff2ccd3) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:29.239381 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb48e0-9530-4dbe-8742-4d3c1723bfd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:29.240799 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb48e0-9530-4dbe-8742-4d3c1723bfd9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:29.246134 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 560/1117] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:30:29 2022] GET /identity/v3/role_assignments?user.id=92a1c8d2e4884edfb9c47b81dff2ccd3&scope.project.id=b642196229884c96936c01db0eafab96&role.id=1302d95e46b4422d84f581f8838d5aac => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:31.314943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a303e6-b74d-4ac3-a140-8d179adf4d55 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:31.315497 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a303e6-b74d-4ac3-a140-8d179adf4d55 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:31.315497 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a303e6-b74d-4ac3-a140-8d179adf4d55 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:31.316865 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 558/1118] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:31.321926 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e04e3-8451-40db-b8a1-10cb579a2611 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:31.322370 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e04e3-8451-40db-b8a1-10cb579a2611 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:31.322473 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e04e3-8451-40db-b8a1-10cb579a2611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:31.338967 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-606e04e3-8451-40db-b8a1-10cb579a2611 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:31.340142 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-606e04e3-8451-40db-b8a1-10cb579a2611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:31.405826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 561/1119] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:31.429172 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a303e6-b74d-4ac3-a140-8d179adf4d55 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:31.528527 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a303e6-b74d-4ac3-a140-8d179adf4d55 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:31.563334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da850ed-9505-4751-a6c8-49ef9e848b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:31.564173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da850ed-9505-4751-a6c8-49ef9e848b4c None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:31.564452 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da850ed-9505-4751-a6c8-49ef9e848b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:31.564723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da850ed-9505-4751-a6c8-49ef9e848b4c None admin] PATH_INFO: `/v3/roles/1302d95e46b4422d84f581f8838d5aac` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:31.566238 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da850ed-9505-4751-a6c8-49ef9e848b4c None admin] RBAC: Authorizing `identity:get_role(role_id=1302d95e46b4422d84f581f8838d5aac)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:31.567533 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da850ed-9505-4751-a6c8-49ef9e848b4c None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:31.568872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 559/1120] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:30:31 2022] GET /identity/v3/roles/1302d95e46b4422d84f581f8838d5aac => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:31.574786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e04e3-8451-40db-b8a1-10cb579a2611 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:31.607277 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:31.672150 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e04e3-8451-40db-b8a1-10cb579a2611 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:31.704906 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f432ae-7be0-43db-b01a-9ba29919b539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:31.705804 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f432ae-7be0-43db-b01a-9ba29919b539 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:31.706085 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f432ae-7be0-43db-b01a-9ba29919b539 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:31.706360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f432ae-7be0-43db-b01a-9ba29919b539 None admin] PATH_INFO: `/v3/users/92a1c8d2e4884edfb9c47b81dff2ccd3` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:31.707521 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f432ae-7be0-43db-b01a-9ba29919b539 None admin] RBAC: Authorizing `identity:get_user(user_id=92a1c8d2e4884edfb9c47b81dff2ccd3)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:31.708950 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f432ae-7be0-43db-b01a-9ba29919b539 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:31.710595 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 562/1121] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:30:31 2022] GET /identity/v3/users/92a1c8d2e4884edfb9c47b81dff2ccd3 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:31.716466 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da850ed-9505-4751-a6c8-49ef9e848b4c None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:31.731483 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:31.816290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da850ed-9505-4751-a6c8-49ef9e848b4c None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:31.850395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c6f711-a07f-4723-bb6e-4d152be232ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:31.851240 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6f711-a07f-4723-bb6e-4d152be232ba None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:31.851518 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6f711-a07f-4723-bb6e-4d152be232ba None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:31.851786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c6f711-a07f-4723-bb6e-4d152be232ba None admin] PATH_INFO: `/v3/projects/b642196229884c96936c01db0eafab96` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:31.852931 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6f711-a07f-4723-bb6e-4d152be232ba None admin] RBAC: Authorizing `identity:get_project(project_id=b642196229884c96936c01db0eafab96)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:31.854374 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c6f711-a07f-4723-bb6e-4d152be232ba None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:31.856043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 560/1122] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:30:31 2022] GET /identity/v3/projects/b642196229884c96936c01db0eafab96 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:31.862647 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f432ae-7be0-43db-b01a-9ba29919b539 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:31.960076 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f432ae-7be0-43db-b01a-9ba29919b539 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:31.961585 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:31.993900 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391fe00-daca-4f96-bf23-c4806e14969b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:31.994773 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391fe00-daca-4f96-bf23-c4806e14969b None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:31.995056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391fe00-daca-4f96-bf23-c4806e14969b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:31.995330 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391fe00-daca-4f96-bf23-c4806e14969b None admin] PATH_INFO: `/v3/projects/b642196229884c96936c01db0eafab96/users/92a1c8d2e4884edfb9c47b81dff2ccd3/roles/1302d95e46b4422d84f581f8838d5aac` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:31.997516 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391fe00-daca-4f96-bf23-c4806e14969b None admin] RBAC: Authorizing `identity:create_grant(project_id=b642196229884c96936c01db0eafab96, user_id=92a1c8d2e4884edfb9c47b81dff2ccd3, role_id=1302d95e46b4422d84f581f8838d5aac)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:31.999132 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391fe00-daca-4f96-bf23-c4806e14969b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:32.012017 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 563/1123] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:30:31 2022] PUT /identity/v3/projects/b642196229884c96936c01db0eafab96/users/92a1c8d2e4884edfb9c47b81dff2ccd3/roles/1302d95e46b4422d84f581f8838d5aac => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:30:34.129004 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf1ed3-0878-45c1-83ce-d3376f06b598 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:34.129526 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf1ed3-0878-45c1-83ce-d3376f06b598 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:34.129526 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf1ed3-0878-45c1-83ce-d3376f06b598 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:34.130892 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 561/1124] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:34.136139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107e14b-d638-4689-ad6f-5624dc81df44 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:34.136546 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107e14b-d638-4689-ad6f-5624dc81df44 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:34.136699 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107e14b-d638-4689-ad6f-5624dc81df44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:34.153140 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1107e14b-d638-4689-ad6f-5624dc81df44 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:34.154903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1107e14b-d638-4689-ad6f-5624dc81df44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:34.220244 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 564/1125] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:34.244014 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf1ed3-0878-45c1-83ce-d3376f06b598 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:34.324561 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:34.346128 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf1ed3-0878-45c1-83ce-d3376f06b598 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:34.379498 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589d320-4d82-4227-aeb2-ed423eefed75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:34.380287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589d320-4d82-4227-aeb2-ed423eefed75 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:34.380571 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589d320-4d82-4227-aeb2-ed423eefed75 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:34.380844 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589d320-4d82-4227-aeb2-ed423eefed75 None admin] PATH_INFO: `/v3/roles/1302d95e46b4422d84f581f8838d5aac` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:34.382307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589d320-4d82-4227-aeb2-ed423eefed75 None admin] RBAC: Authorizing `identity:get_role(role_id=1302d95e46b4422d84f581f8838d5aac)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:34.383656 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589d320-4d82-4227-aeb2-ed423eefed75 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:34.384999 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 562/1126] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:30:34 2022] GET /identity/v3/roles/1302d95e46b4422d84f581f8838d5aac => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:34.391847 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107e14b-d638-4689-ad6f-5624dc81df44 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:34.481354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:34.491053 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1107e14b-d638-4689-ad6f-5624dc81df44 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:34.523851 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e45f5e-d5fd-4254-b6d5-546434f47141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:34.524710 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e45f5e-d5fd-4254-b6d5-546434f47141 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:34.525001 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e45f5e-d5fd-4254-b6d5-546434f47141 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:34.525278 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e45f5e-d5fd-4254-b6d5-546434f47141 None admin] PATH_INFO: `/v3/users/92a1c8d2e4884edfb9c47b81dff2ccd3` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:34.526474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e45f5e-d5fd-4254-b6d5-546434f47141 None admin] RBAC: Authorizing `identity:get_user(user_id=92a1c8d2e4884edfb9c47b81dff2ccd3)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:34.527905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e45f5e-d5fd-4254-b6d5-546434f47141 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:34.530251 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 565/1127] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:30:34 2022] GET /identity/v3/users/92a1c8d2e4884edfb9c47b81dff2ccd3 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:34.536374 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589d320-4d82-4227-aeb2-ed423eefed75 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:34.633714 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589d320-4d82-4227-aeb2-ed423eefed75 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:34.666679 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5434ae-2300-44f4-bfc4-94fb69d80149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:34.667320 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5434ae-2300-44f4-bfc4-94fb69d80149 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:34.667603 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5434ae-2300-44f4-bfc4-94fb69d80149 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:34.667879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5434ae-2300-44f4-bfc4-94fb69d80149 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:34.684922 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:34.733523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5434ae-2300-44f4-bfc4-94fb69d80149 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:34.734949 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5434ae-2300-44f4-bfc4-94fb69d80149 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:34.831712 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 563/1128] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:30:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 19:30:34.837828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e45f5e-d5fd-4254-b6d5-546434f47141 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:34.938239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e45f5e-d5fd-4254-b6d5-546434f47141 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:34.970524 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f74d0-4b32-42d6-9f77-f6152af11416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:34.971372 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f74d0-4b32-42d6-9f77-f6152af11416 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:34.971660 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f74d0-4b32-42d6-9f77-f6152af11416 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:34.971937 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f74d0-4b32-42d6-9f77-f6152af11416 None admin] PATH_INFO: `/v3/projects/b642196229884c96936c01db0eafab96` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:34.973094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f74d0-4b32-42d6-9f77-f6152af11416 None admin] RBAC: Authorizing `identity:get_project(project_id=b642196229884c96936c01db0eafab96)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:34.974565 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f74d0-4b32-42d6-9f77-f6152af11416 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:34.976254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 566/1129] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:30:34 2022] GET /identity/v3/projects/b642196229884c96936c01db0eafab96 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:34.983121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5434ae-2300-44f4-bfc4-94fb69d80149 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:35.030844 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:35.080487 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5434ae-2300-44f4-bfc4-94fb69d80149 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:35.113654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dfd13-d44d-4549-9932-17980d959871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:35.114302 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dfd13-d44d-4549-9932-17980d959871 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:35.114589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dfd13-d44d-4549-9932-17980d959871 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:35.114867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dfd13-d44d-4549-9932-17980d959871 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:35.115696 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608dfd13-d44d-4549-9932-17980d959871 None admin] RBAC: Adding query filter params (role.id=1302d95e46b4422d84f581f8838d5aac, scope.project.id=b642196229884c96936c01db0eafab96, user.id=92a1c8d2e4884edfb9c47b81dff2ccd3) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:35.116010 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608dfd13-d44d-4549-9932-17980d959871 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:35.117447 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608dfd13-d44d-4549-9932-17980d959871 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:35.123910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 564/1130] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:30:34 2022] GET /identity/v3/role_assignments?user.id=92a1c8d2e4884edfb9c47b81dff2ccd3&scope.project.id=b642196229884c96936c01db0eafab96&role.id=1302d95e46b4422d84f581f8838d5aac => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:37.290072 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ba812-9f53-4ebe-90d6-a05bfaf03199 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:37.290611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ba812-9f53-4ebe-90d6-a05bfaf03199 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:37.290611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ba812-9f53-4ebe-90d6-a05bfaf03199 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:37.291971 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 567/1131] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:37.298344 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fc900-46fc-4ee9-a8ff-84b759b276ad None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:37.298797 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fc900-46fc-4ee9-a8ff-84b759b276ad None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:37.298987 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fc900-46fc-4ee9-a8ff-84b759b276ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:37.317744 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-0a8fc900-46fc-4ee9-a8ff-84b759b276ad None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:37.318918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-0a8fc900-46fc-4ee9-a8ff-84b759b276ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:37.387263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 565/1132] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:37.411714 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ba812-9f53-4ebe-90d6-a05bfaf03199 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:37.441569 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:37.517611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ba812-9f53-4ebe-90d6-a05bfaf03199 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:37.553475 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334a639-079e-49bd-be53-ec9f0c978e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:37.554204 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334a639-079e-49bd-be53-ec9f0c978e2c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:37.554532 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334a639-079e-49bd-be53-ec9f0c978e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:37.554755 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334a639-079e-49bd-be53-ec9f0c978e2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:37.555929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334a639-079e-49bd-be53-ec9f0c978e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:37.557408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334a639-079e-49bd-be53-ec9f0c978e2c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:37.559014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 568/1133] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:30:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:37.564948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fc900-46fc-4ee9-a8ff-84b759b276ad None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:37.612087 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:37.670752 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fc900-46fc-4ee9-a8ff-84b759b276ad None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:37.705043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5026a748-df81-4b3e-8433-c0f6a0e9abeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:37.705743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026a748-df81-4b3e-8433-c0f6a0e9abeb None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:37.706031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026a748-df81-4b3e-8433-c0f6a0e9abeb None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:37.706312 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5026a748-df81-4b3e-8433-c0f6a0e9abeb None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:37.707059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5026a748-df81-4b3e-8433-c0f6a0e9abeb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:37.708457 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5026a748-df81-4b3e-8433-c0f6a0e9abeb None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:37.736087 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 566/1134] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jun 14 19:30:37 2022] POST /identity/v3/projects => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:30:39.923187 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481548ca-43bd-4ddd-996f-4f47fc825857 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:39.923702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481548ca-43bd-4ddd-996f-4f47fc825857 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:39.923816 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481548ca-43bd-4ddd-996f-4f47fc825857 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:39.925106 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 569/1135] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:39.930500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd0d47-5b95-4b37-b8e3-89571f8c6a49 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:39.930934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd0d47-5b95-4b37-b8e3-89571f8c6a49 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:39.931075 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd0d47-5b95-4b37-b8e3-89571f8c6a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:39.947952 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-46fd0d47-5b95-4b37-b8e3-89571f8c6a49 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:39.949136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-46fd0d47-5b95-4b37-b8e3-89571f8c6a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:40.018590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 567/1136] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:40.045446 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481548ca-43bd-4ddd-996f-4f47fc825857 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:40.141361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:40.148957 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481548ca-43bd-4ddd-996f-4f47fc825857 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:40.184080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd650a9-9254-4be8-9acf-63565a095ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:40.184873 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd650a9-9254-4be8-9acf-63565a095ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:40.185246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd650a9-9254-4be8-9acf-63565a095ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:40.186050 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd650a9-9254-4be8-9acf-63565a095ca3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:40.187247 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd650a9-9254-4be8-9acf-63565a095ca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:40.188694 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd650a9-9254-4be8-9acf-63565a095ca3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:40.190338 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 570/1137] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:30:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:40.196266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd0d47-5b95-4b37-b8e3-89571f8c6a49 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:40.223006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:40.301365 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd0d47-5b95-4b37-b8e3-89571f8c6a49 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:40.335612 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72060836-4fc2-4633-b66b-e9c6e6781e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:40.336310 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72060836-4fc2-4633-b66b-e9c6e6781e9b None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:40.336591 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72060836-4fc2-4633-b66b-e9c6e6781e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:40.336866 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72060836-4fc2-4633-b66b-e9c6e6781e9b None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:40.337621 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72060836-4fc2-4633-b66b-e9c6e6781e9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:40.339061 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72060836-4fc2-4633-b66b-e9c6e6781e9b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:40.359346 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 568/1138] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jun 14 19:30:40 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:30:42.543964 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad7121-2686-4104-b7f4-f63c6fe1dc85 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:42.544999 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad7121-2686-4104-b7f4-f63c6fe1dc85 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:42.545089 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad7121-2686-4104-b7f4-f63c6fe1dc85 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:42.546552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 571/1139] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:42.551944 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f4171-7b72-4fe4-a8f7-f9900ebddd64 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:42.552352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f4171-7b72-4fe4-a8f7-f9900ebddd64 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:42.552507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f4171-7b72-4fe4-a8f7-f9900ebddd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:42.569720 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-8d1f4171-7b72-4fe4-a8f7-f9900ebddd64 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:42.570897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-8d1f4171-7b72-4fe4-a8f7-f9900ebddd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:42.636431 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 569/1140] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:42.659853 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad7121-2686-4104-b7f4-f63c6fe1dc85 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:42.761679 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad7121-2686-4104-b7f4-f63c6fe1dc85 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:42.795618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a36b29-b308-4d21-b794-5d22d424eec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:42.796343 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a36b29-b308-4d21-b794-5d22d424eec3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:42.796633 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a36b29-b308-4d21-b794-5d22d424eec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:42.796907 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a36b29-b308-4d21-b794-5d22d424eec3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:42.807114 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a36b29-b308-4d21-b794-5d22d424eec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:30:42.815350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-77a36b29-b308-4d21-b794-5d22d424eec3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:30:42.815350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:42.815350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:42.815350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:42.815350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:42.815350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:42.815350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:42.815350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:42.815350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:42.815350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:42.815350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:42.815350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:42.815350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:30:42.815350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:30:42.815350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:30:42.815350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:30:42.816328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:30:42.816328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:30:42.816328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:30:42.816328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:30:42.816328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:42.816328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:42.816328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:42.816328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:42.816328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:42.816328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:42.816328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:42.816328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:42.816328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:42.816328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:42.816328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:42.816328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:42.817414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:42.817414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:42.817414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:42.817414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:42.817414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:30:42.817414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:30:42.817414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:30:42.817414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:30:42.817414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:30:42.817414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:30:42.817414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:30:42.817414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:42.817414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 572/1141] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:30:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:42.822221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f4171-7b72-4fe4-a8f7-f9900ebddd64 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:42.834649 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:42.940784 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f4171-7b72-4fe4-a8f7-f9900ebddd64 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:42.984909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8a38f-79d0-45b3-a8e5-fba8fd724577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:42.985606 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8a38f-79d0-45b3-a8e5-fba8fd724577 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:42.985942 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8a38f-79d0-45b3-a8e5-fba8fd724577 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:42.986214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8a38f-79d0-45b3-a8e5-fba8fd724577 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:42.987622 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8a38f-79d0-45b3-a8e5-fba8fd724577 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:42.987932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8a38f-79d0-45b3-a8e5-fba8fd724577 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:42.989336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8a38f-79d0-45b3-a8e5-fba8fd724577 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:42.997290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 570/1142] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:30:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:30:43.003289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a36b29-b308-4d21-b794-5d22d424eec3 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:43.029500 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:43.103873 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a36b29-b308-4d21-b794-5d22d424eec3 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:43.137325 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640ad1d-38cb-41fc-ac83-f81cd5676598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:43.138690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640ad1d-38cb-41fc-ac83-f81cd5676598 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:43.139078 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640ad1d-38cb-41fc-ac83-f81cd5676598 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:43.139444 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7640ad1d-38cb-41fc-ac83-f81cd5676598 None admin] PATH_INFO: `/v3/users/4933ad1446ff480382ac1327c079a96e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:43.152397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640ad1d-38cb-41fc-ac83-f81cd5676598 None admin] RBAC: Authorizing `identity:get_user(user_id=4933ad1446ff480382ac1327c079a96e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:43.154875 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7640ad1d-38cb-41fc-ac83-f81cd5676598 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:43.156679 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 573/1143] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:30:43 2022] GET /identity/v3/users/4933ad1446ff480382ac1327c079a96e => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:30:43.162333 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8a38f-79d0-45b3-a8e5-fba8fd724577 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:43.234072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:43.264280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8a38f-79d0-45b3-a8e5-fba8fd724577 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:43.298575 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138ad91-02bd-46ae-ac88-32398935a96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:43.299396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138ad91-02bd-46ae-ac88-32398935a96a None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:43.299683 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138ad91-02bd-46ae-ac88-32398935a96a None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:43.299959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138ad91-02bd-46ae-ac88-32398935a96a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:43.366138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138ad91-02bd-46ae-ac88-32398935a96a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:43.367497 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138ad91-02bd-46ae-ac88-32398935a96a None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:43.436696 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:43.467330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 571/1144] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:30:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 19:30:43.473286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640ad1d-38cb-41fc-ac83-f81cd5676598 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:43.554270 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:43.573095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7640ad1d-38cb-41fc-ac83-f81cd5676598 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:43.606420 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785cdc3a-8a0e-407b-a3e7-e0d2b375c4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:43.608348 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cdc3a-8a0e-407b-a3e7-e0d2b375c4ca None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:43.608624 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cdc3a-8a0e-407b-a3e7-e0d2b375c4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:43.608900 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cdc3a-8a0e-407b-a3e7-e0d2b375c4ca None admin] PATH_INFO: `/v3/projects/d6b1cec70bea4b85903fac911985fb91` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:43.610075 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785cdc3a-8a0e-407b-a3e7-e0d2b375c4ca None admin] RBAC: Authorizing `identity:get_project(project_id=d6b1cec70bea4b85903fac911985fb91)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:43.611500 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785cdc3a-8a0e-407b-a3e7-e0d2b375c4ca None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:43.613161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 574/1145] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:30:43 2022] GET /identity/v3/projects/d6b1cec70bea4b85903fac911985fb91 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:43.619289 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138ad91-02bd-46ae-ac88-32398935a96a None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:43.715345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138ad91-02bd-46ae-ac88-32398935a96a None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:43.749026 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725137b2-b6ad-4556-a9a2-858b41b54be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:43.749693 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725137b2-b6ad-4556-a9a2-858b41b54be3 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:43.749980 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725137b2-b6ad-4556-a9a2-858b41b54be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:43.750260 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725137b2-b6ad-4556-a9a2-858b41b54be3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:43.751084 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725137b2-b6ad-4556-a9a2-858b41b54be3 None admin] RBAC: Adding query filter params (role.id=1e2bb0d759694428ada2b52285de933b, scope.project.id=d6b1cec70bea4b85903fac911985fb91, user.id=4933ad1446ff480382ac1327c079a96e) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:43.751397 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725137b2-b6ad-4556-a9a2-858b41b54be3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:43.752821 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725137b2-b6ad-4556-a9a2-858b41b54be3 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:43.758211 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 572/1146] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:30:43 2022] GET /identity/v3/role_assignments?user.id=4933ad1446ff480382ac1327c079a96e&scope.project.id=d6b1cec70bea4b85903fac911985fb91&role.id=1e2bb0d759694428ada2b52285de933b => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:30:45.830237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d694-a7a5-4ffd-b63d-6e45c76772f9 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:45.830662 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d694-a7a5-4ffd-b63d-6e45c76772f9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:45.830795 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3d694-a7a5-4ffd-b63d-6e45c76772f9 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:45.832161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 575/1147] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:45.837234 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc6f47-d846-4688-9411-f83612dca6be None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:45.837679 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc6f47-d846-4688-9411-f83612dca6be None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:45.837817 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc6f47-d846-4688-9411-f83612dca6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:45.855027 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-41dc6f47-d846-4688-9411-f83612dca6be None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:45.856191 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-41dc6f47-d846-4688-9411-f83612dca6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:45.884925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:45.924002 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 573/1148] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:45.946227 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3d694-a7a5-4ffd-b63d-6e45c76772f9 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:46.045080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3d694-a7a5-4ffd-b63d-6e45c76772f9 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:46.077089 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51642ee-9025-45a2-a543-888c9f9d179e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:46.077820 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51642ee-9025-45a2-a543-888c9f9d179e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:46.078105 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51642ee-9025-45a2-a543-888c9f9d179e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:46.078379 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51642ee-9025-45a2-a543-888c9f9d179e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:46.094773 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51642ee-9025-45a2-a543-888c9f9d179e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:30:46.102316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-b51642ee-9025-45a2-a543-888c9f9d179e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:30:46.102316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:46.102316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:46.102316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:46.102316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:46.102316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:46.102316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:46.102316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:46.102316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:46.102316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:46.102316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:46.102316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:46.102316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:30:46.102316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:30:46.102316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:30:46.102316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:30:46.103377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:30:46.103377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:30:46.103377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:30:46.103377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:30:46.103377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:46.103377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:46.103377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:46.103377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:46.103377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:46.103377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:46.103377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:46.103377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:46.103377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:46.103377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:46.103377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:46.103377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:46.104543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:46.104543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:46.104543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:46.104543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:46.104543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:30:46.104543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:30:46.104543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:30:46.104543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:30:46.104543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:30:46.104543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:30:46.104543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:30:46.104543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:46.104543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 576/1149] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:30:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:46.110152 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc6f47-d846-4688-9411-f83612dca6be None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:46.209134 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc6f47-d846-4688-9411-f83612dca6be None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:46.241804 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad4c25-a022-459d-8ff9-d4006a7cf7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:46.242455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad4c25-a022-459d-8ff9-d4006a7cf7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:46.242738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad4c25-a022-459d-8ff9-d4006a7cf7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:46.243021 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad4c25-a022-459d-8ff9-d4006a7cf7b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:46.243756 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad4c25-a022-459d-8ff9-d4006a7cf7b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:46.244062 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad4c25-a022-459d-8ff9-d4006a7cf7b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:46.245438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad4c25-a022-459d-8ff9-d4006a7cf7b9 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:46.253240 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 574/1150] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:30:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:46.258874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51642ee-9025-45a2-a543-888c9f9d179e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:46.272367 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:46.358231 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51642ee-9025-45a2-a543-888c9f9d179e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:46.390220 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51320af7-6733-4e67-bb1f-146e18bb2149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:46.391077 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51320af7-6733-4e67-bb1f-146e18bb2149 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:46.391358 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51320af7-6733-4e67-bb1f-146e18bb2149 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:46.391631 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51320af7-6733-4e67-bb1f-146e18bb2149 None admin] PATH_INFO: `/v3/users/4933ad1446ff480382ac1327c079a96e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:46.392812 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51320af7-6733-4e67-bb1f-146e18bb2149 None admin] RBAC: Authorizing `identity:get_user(user_id=4933ad1446ff480382ac1327c079a96e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:46.394269 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51320af7-6733-4e67-bb1f-146e18bb2149 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:46.395872 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 577/1151] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:30:46 2022] GET /identity/v3/users/4933ad1446ff480382ac1327c079a96e => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:46.401627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad4c25-a022-459d-8ff9-d4006a7cf7b9 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:46.430196 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:46.500472 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad4c25-a022-459d-8ff9-d4006a7cf7b9 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:46.533278 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c3890-833a-4016-8324-f00ecd0bde87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:46.534142 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c3890-833a-4016-8324-f00ecd0bde87 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:46.534426 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c3890-833a-4016-8324-f00ecd0bde87 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:46.534702 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c3890-833a-4016-8324-f00ecd0bde87 None admin] PATH_INFO: `/v3/projects/d6b1cec70bea4b85903fac911985fb91` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:46.535854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c3890-833a-4016-8324-f00ecd0bde87 None admin] RBAC: Authorizing `identity:get_project(project_id=d6b1cec70bea4b85903fac911985fb91)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:46.537267 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c3890-833a-4016-8324-f00ecd0bde87 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:46.539216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 575/1152] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:30:46 2022] GET /identity/v3/projects/d6b1cec70bea4b85903fac911985fb91 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:46.545563 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51320af7-6733-4e67-bb1f-146e18bb2149 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:46.628268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:46.649538 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51320af7-6733-4e67-bb1f-146e18bb2149 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:46.681280 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e713a4-fbda-4ba2-a58c-836531f6d736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:46.682181 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e713a4-fbda-4ba2-a58c-836531f6d736 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:46.682465 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e713a4-fbda-4ba2-a58c-836531f6d736 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:46.682742 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e713a4-fbda-4ba2-a58c-836531f6d736 None admin] PATH_INFO: `/v3/projects/d6b1cec70bea4b85903fac911985fb91/users/4933ad1446ff480382ac1327c079a96e/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:46.684669 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e713a4-fbda-4ba2-a58c-836531f6d736 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6b1cec70bea4b85903fac911985fb91, user_id=4933ad1446ff480382ac1327c079a96e, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:46.686792 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e713a4-fbda-4ba2-a58c-836531f6d736 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:46.698967 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 578/1153] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:30:46 2022] PUT /identity/v3/projects/d6b1cec70bea4b85903fac911985fb91/users/4933ad1446ff480382ac1327c079a96e/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:30:48.824158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105b211-7dc6-47ec-bdc9-67550033ebe3 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:48.824604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105b211-7dc6-47ec-bdc9-67550033ebe3 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:48.824709 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105b211-7dc6-47ec-bdc9-67550033ebe3 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:48.826792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 576/1154] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:48.831999 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad4c40-7222-4c16-9f69-7e5274652bed None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:48.832422 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad4c40-7222-4c16-9f69-7e5274652bed None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:48.832558 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad4c40-7222-4c16-9f69-7e5274652bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:48.848922 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c3ad4c40-7222-4c16-9f69-7e5274652bed None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:48.850135 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c3ad4c40-7222-4c16-9f69-7e5274652bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:48.914769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 579/1155] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:48.938579 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105b211-7dc6-47ec-bdc9-67550033ebe3 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:49.030915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:49.037689 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105b211-7dc6-47ec-bdc9-67550033ebe3 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:49.070095 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28743f4-d7c1-4045-a20e-2462cbde6447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:49.070806 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28743f4-d7c1-4045-a20e-2462cbde6447 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:49.071090 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28743f4-d7c1-4045-a20e-2462cbde6447 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:49.071368 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28743f4-d7c1-4045-a20e-2462cbde6447 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:49.082235 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28743f4-d7c1-4045-a20e-2462cbde6447 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:30:49.089900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-c28743f4-d7c1-4045-a20e-2462cbde6447 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:30:49.089900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:49.089900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:49.089900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:49.089900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:49.089900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:49.089900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:49.089900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:49.089900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:49.089900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:49.089900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:49.089900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:49.089900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:30:49.089900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:30:49.089900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:30:49.089900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:30:49.090986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:30:49.090986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:30:49.090986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:30:49.090986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:30:49.090986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:49.090986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:49.090986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:49.090986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:49.090986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:49.090986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:49.090986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:49.090986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:49.090986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:49.090986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:49.090986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:49.090986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:49.092001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:49.092001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:49.092001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:49.092001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:49.092001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:30:49.092001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:30:49.092001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:30:49.092001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:30:49.092001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:30:49.092001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:30:49.092001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:30:49.092001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:30:49.092001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 577/1156] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:30:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:49.097124 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad4c40-7222-4c16-9f69-7e5274652bed None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:49.160901 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:49.194500 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad4c40-7222-4c16-9f69-7e5274652bed None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:49.226362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae190259-84c1-474c-a71b-a2203f09adeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:49.227016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae190259-84c1-474c-a71b-a2203f09adeb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:49.227304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae190259-84c1-474c-a71b-a2203f09adeb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:49.227586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae190259-84c1-474c-a71b-a2203f09adeb None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:49.228329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae190259-84c1-474c-a71b-a2203f09adeb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:49.228639 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae190259-84c1-474c-a71b-a2203f09adeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:49.230036 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae190259-84c1-474c-a71b-a2203f09adeb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:49.238540 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 580/1157] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:30:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:49.244217 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28743f4-d7c1-4045-a20e-2462cbde6447 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:49.339794 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28743f4-d7c1-4045-a20e-2462cbde6447 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:49.372604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f073c-5850-4fe6-89f6-561b15d949d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:49.373490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f073c-5850-4fe6-89f6-561b15d949d6 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:49.373774 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f073c-5850-4fe6-89f6-561b15d949d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:49.374050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f073c-5850-4fe6-89f6-561b15d949d6 None admin] PATH_INFO: `/v3/users/4933ad1446ff480382ac1327c079a96e` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:49.375224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f073c-5850-4fe6-89f6-561b15d949d6 None admin] RBAC: Authorizing `identity:get_user(user_id=4933ad1446ff480382ac1327c079a96e)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:49.376637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f073c-5850-4fe6-89f6-561b15d949d6 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:49.378250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 578/1158] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:30:49 2022] GET /identity/v3/users/4933ad1446ff480382ac1327c079a96e => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:49.383774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae190259-84c1-474c-a71b-a2203f09adeb None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:49.479330 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae190259-84c1-474c-a71b-a2203f09adeb None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:49.507011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:49.513202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5f301-aa45-4ba6-b4db-9b18e9ef05a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:49.513870 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5f301-aa45-4ba6-b4db-9b18e9ef05a7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:49.514151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5f301-aa45-4ba6-b4db-9b18e9ef05a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:49.514424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5f301-aa45-4ba6-b4db-9b18e9ef05a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:49.579543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5f301-aa45-4ba6-b4db-9b18e9ef05a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:49.580981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5f301-aa45-4ba6-b4db-9b18e9ef05a7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:49.677463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 581/1159] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:30:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 19:30:49.683158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f073c-5850-4fe6-89f6-561b15d949d6 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:49.708227 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:49.783132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f073c-5850-4fe6-89f6-561b15d949d6 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:49.817201 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5a377e-cf13-4729-a9b1-10b34a992c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:49.818074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a377e-cf13-4729-a9b1-10b34a992c52 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:49.818352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a377e-cf13-4729-a9b1-10b34a992c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:49.818621 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5a377e-cf13-4729-a9b1-10b34a992c52 None admin] PATH_INFO: `/v3/projects/d6b1cec70bea4b85903fac911985fb91` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:49.819876 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a377e-cf13-4729-a9b1-10b34a992c52 None admin] RBAC: Authorizing `identity:get_project(project_id=d6b1cec70bea4b85903fac911985fb91)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:49.821289 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5a377e-cf13-4729-a9b1-10b34a992c52 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:49.823002 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 579/1160] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:30:49 2022] GET /identity/v3/projects/d6b1cec70bea4b85903fac911985fb91 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:49.829083 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5f301-aa45-4ba6-b4db-9b18e9ef05a7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:49.859236 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:49.927274 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5f301-aa45-4ba6-b4db-9b18e9ef05a7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:49.959841 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114c3a1-1f06-4205-929e-2f1a0ff1846b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:49.960422 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114c3a1-1f06-4205-929e-2f1a0ff1846b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:49.960707 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114c3a1-1f06-4205-929e-2f1a0ff1846b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:49.960986 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114c3a1-1f06-4205-929e-2f1a0ff1846b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:49.961840 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114c3a1-1f06-4205-929e-2f1a0ff1846b None admin] RBAC: Adding query filter params (role.id=1e2bb0d759694428ada2b52285de933b, scope.project.id=d6b1cec70bea4b85903fac911985fb91, user.id=4933ad1446ff480382ac1327c079a96e) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:49.962153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114c3a1-1f06-4205-929e-2f1a0ff1846b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:49.963566 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2114c3a1-1f06-4205-929e-2f1a0ff1846b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:49.969826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 582/1161] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:30:49 2022] GET /identity/v3/role_assignments?user.id=4933ad1446ff480382ac1327c079a96e&scope.project.id=d6b1cec70bea4b85903fac911985fb91&role.id=1e2bb0d759694428ada2b52285de933b => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:52.132570 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bce449-5b0b-41b9-8daa-18c8c1c45908 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:52.133075 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bce449-5b0b-41b9-8daa-18c8c1c45908 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:52.133075 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bce449-5b0b-41b9-8daa-18c8c1c45908 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:52.134436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 580/1162] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:52.140792 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f70da-d630-49a6-89c7-698e3b92d4d5 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:52.141184 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f70da-d630-49a6-89c7-698e3b92d4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:52.141355 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f70da-d630-49a6-89c7-698e3b92d4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:52.157598 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b19f70da-d630-49a6-89c7-698e3b92d4d5 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:52.158778 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b19f70da-d630-49a6-89c7-698e3b92d4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:52.228092 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 583/1163] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:52.251133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bce449-5b0b-41b9-8daa-18c8c1c45908 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:52.340734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:52.350780 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bce449-5b0b-41b9-8daa-18c8c1c45908 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:52.386535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e11c4-e7dc-456c-b95f-783f8fc98587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:52.387110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e11c4-e7dc-456c-b95f-783f8fc98587 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:52.387399 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e11c4-e7dc-456c-b95f-783f8fc98587 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:52.387705 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6e11c4-e7dc-456c-b95f-783f8fc98587 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:52.452913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e11c4-e7dc-456c-b95f-783f8fc98587 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:52.454370 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6e11c4-e7dc-456c-b95f-783f8fc98587 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:52.541272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:52.551656 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 581/1164] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:30:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 19:30:52.557613 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f70da-d630-49a6-89c7-698e3b92d4d5 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:52.581341 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:52.653736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f70da-d630-49a6-89c7-698e3b92d4d5 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:52.686510 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99629f8c-829c-4ced-b877-c5b3880cbc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:52.687294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99629f8c-829c-4ced-b877-c5b3880cbc59 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:52.687579 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99629f8c-829c-4ced-b877-c5b3880cbc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:52.687854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99629f8c-829c-4ced-b877-c5b3880cbc59 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:52.694282 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99629f8c-829c-4ced-b877-c5b3880cbc59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:52.695718 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99629f8c-829c-4ced-b877-c5b3880cbc59 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:52.709369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-99629f8c-829c-4ced-b877-c5b3880cbc59 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 14 19:30:52.709369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:52.709369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 14 19:30:52.709369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 14 19:30:52.709369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:30:52.709369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:30:52.709369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:30:52.709369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:30:52.709369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 14 19:30:52.709369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:52.709369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:30:52.709369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:52.709369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:30:52.709369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:30:52.709369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:30:52.709369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:30:52.709369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:30:52.710644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:30:52.710644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:30:52.710644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:30:52.710644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:30:52.710644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:30:52.710644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:30:52.710644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:30:52.710644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:30:52.710644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:30:52.710644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:30:52.710644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:30:52.710644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:30:52.710644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:30:52.710644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:30:52.710644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:30:52.710644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:30:52.711748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:30:52.711748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:30:52.711748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:30:52.711748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:30:52.711748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:30:52.711748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:30:52.711748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:30:52.711748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:30:52.711748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:30:52.711748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:30:52.711748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 14 19:30:52.711748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:30:52.711748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 14 19:30:52.711748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:30:52.711748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 584/1165] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jun 14 19:30:52 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:30:52.717003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e11c4-e7dc-456c-b95f-783f8fc98587 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:52.811869 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6e11c4-e7dc-456c-b95f-783f8fc98587 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:52.844957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3650c6-e083-4379-879a-869a182b91d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:52.845633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3650c6-e083-4379-879a-869a182b91d3 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:52.845913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3650c6-e083-4379-879a-869a182b91d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:52.846183 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3650c6-e083-4379-879a-869a182b91d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:52.846888 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3650c6-e083-4379-879a-869a182b91d3 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:30:52.847187 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3650c6-e083-4379-879a-869a182b91d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:52.848522 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3650c6-e083-4379-879a-869a182b91d3 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:52.855406 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 582/1166] 10.222.0.44 () {56 vars in 1115 bytes} [Tue Jun 14 19:30:52 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:54.939239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ae294-1727-42ba-9b1c-89c3b7e2f8d7 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:54.939781 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ae294-1727-42ba-9b1c-89c3b7e2f8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:54.939781 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ae294-1727-42ba-9b1c-89c3b7e2f8d7 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:54.941149 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 585/1167] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:54.946219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cf371-f8e1-449d-95cc-88a7140f2ade None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:54.946603 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cf371-f8e1-449d-95cc-88a7140f2ade None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:54.946776 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cf371-f8e1-449d-95cc-88a7140f2ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:54.963128 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-805cf371-f8e1-449d-95cc-88a7140f2ade None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:54.964289 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-805cf371-f8e1-449d-95cc-88a7140f2ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:55.012780 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:55.028739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 583/1168] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:55.051994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ae294-1727-42ba-9b1c-89c3b7e2f8d7 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:55.134907 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:55.151272 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ae294-1727-42ba-9b1c-89c3b7e2f8d7 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:55.184901 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7d578-b700-4b03-a4a4-a83d45c42c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:55.185578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7d578-b700-4b03-a4a4-a83d45c42c65 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:55.185866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7d578-b700-4b03-a4a4-a83d45c42c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:55.186145 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7d578-b700-4b03-a4a4-a83d45c42c65 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:55.186888 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7d578-b700-4b03-a4a4-a83d45c42c65 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:55.188248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7d578-b700-4b03-a4a4-a83d45c42c65 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:55.202257 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 586/1169] 10.222.0.44 () {60 vars in 1138 bytes} [Tue Jun 14 19:30:55 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:30:57.336990 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f6016-9028-44b4-8c7a-f0408c687f76 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:57.337581 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f6016-9028-44b4-8c7a-f0408c687f76 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:57.337581 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f6016-9028-44b4-8c7a-f0408c687f76 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:57.338941 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 584/1170] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:57.344874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50b406-d0fd-49b9-b206-1241314b34ee None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:57.345285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50b406-d0fd-49b9-b206-1241314b34ee None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:57.345468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50b406-d0fd-49b9-b206-1241314b34ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:57.362394 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-db50b406-d0fd-49b9-b206-1241314b34ee None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:57.363567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-db50b406-d0fd-49b9-b206-1241314b34ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:30:57.428804 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 587/1171] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:30:57.453227 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f6016-9028-44b4-8c7a-f0408c687f76 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:57.551636 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f6016-9028-44b4-8c7a-f0408c687f76 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:57.584285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27cf52-c740-4cd0-aad6-743a205597f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:57.585126 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27cf52-c740-4cd0-aad6-743a205597f5 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:57.585433 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27cf52-c740-4cd0-aad6-743a205597f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:57.585715 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27cf52-c740-4cd0-aad6-743a205597f5 None admin] PATH_INFO: `/v3/domains/7139570a734a4794b4bc60a82cf2c70a` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:57.596552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27cf52-c740-4cd0-aad6-743a205597f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7139570a734a4794b4bc60a82cf2c70a)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:57.597956 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27cf52-c740-4cd0-aad6-743a205597f5 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:57.599547 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 585/1172] 10.222.0.44 () {56 vars in 1183 bytes} [Tue Jun 14 19:30:57 2022] GET /identity/v3/domains/7139570a734a4794b4bc60a82cf2c70a => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:30:57.605255 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50b406-d0fd-49b9-b206-1241314b34ee None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:30:57.679375 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:30:57.704339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50b406-d0fd-49b9-b206-1241314b34ee None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:30:57.738842 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b79b89-8036-46f7-ba45-bb53516c5df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:30:57.739494 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b79b89-8036-46f7-ba45-bb53516c5df5 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:57.739779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b79b89-8036-46f7-ba45-bb53516c5df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:57.740055 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b79b89-8036-46f7-ba45-bb53516c5df5 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:57.740756 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b79b89-8036-46f7-ba45-bb53516c5df5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:30:57.742218 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b79b89-8036-46f7-ba45-bb53516c5df5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:30:57.766859 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 588/1173] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jun 14 19:30:57 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:30:59.923989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7be192-f041-4859-8237-0ebbe58dbea5 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:59.924509 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7be192-f041-4859-8237-0ebbe58dbea5 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:59.924616 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7be192-f041-4859-8237-0ebbe58dbea5 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:59.925937 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 586/1174] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:30:59.931186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ecb09-cb8c-4e82-b06c-2b197ee64bf4 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:30:59.931619 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ecb09-cb8c-4e82-b06c-2b197ee64bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:30:59.931787 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ecb09-cb8c-4e82-b06c-2b197ee64bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:30:59.948769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c60ecb09-cb8c-4e82-b06c-2b197ee64bf4 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:30:59.950018 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c60ecb09-cb8c-4e82-b06c-2b197ee64bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:31:00.014410 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 589/1175] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:30:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:31:00.039665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7be192-f041-4859-8237-0ebbe58dbea5 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:31:00.086466 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:31:00.139998 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7be192-f041-4859-8237-0ebbe58dbea5 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:31:00.173253 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdb8ae-82c5-4fda-9ae3-c8f9c4a4661b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:31:00.174122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdb8ae-82c5-4fda-9ae3-c8f9c4a4661b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:00.174403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdb8ae-82c5-4fda-9ae3-c8f9c4a4661b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:00.174675 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdb8ae-82c5-4fda-9ae3-c8f9c4a4661b None admin] PATH_INFO: `/v3/domains/7139570a734a4794b4bc60a82cf2c70a` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:00.175839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdb8ae-82c5-4fda-9ae3-c8f9c4a4661b None admin] RBAC: Authorizing `identity:get_domain(domain_id=7139570a734a4794b4bc60a82cf2c70a)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:31:00.177252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdb8ae-82c5-4fda-9ae3-c8f9c4a4661b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:31:00.178887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 587/1176] 10.222.0.44 () {56 vars in 1183 bytes} [Tue Jun 14 19:31:00 2022] GET /identity/v3/domains/7139570a734a4794b4bc60a82cf2c70a => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:31:00.186009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ecb09-cb8c-4e82-b06c-2b197ee64bf4 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:31:00.241355 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:31:00.284509 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ecb09-cb8c-4e82-b06c-2b197ee64bf4 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:31:00.317615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0e973-7051-4d96-8299-fe9d94481e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:31:00.318264 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0e973-7051-4d96-8299-fe9d94481e89 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:00.318544 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0e973-7051-4d96-8299-fe9d94481e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:00.318816 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0e973-7051-4d96-8299-fe9d94481e89 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:00.319521 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0e973-7051-4d96-8299-fe9d94481e89 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:31:00.320940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0e973-7051-4d96-8299-fe9d94481e89 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:31:00.341434 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 590/1177] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jun 14 19:31:00 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:31:02.482518 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbd6e6-92b5-4781-ab20-1918cc53a66e None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:02.483053 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbd6e6-92b5-4781-ab20-1918cc53a66e None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:02.483053 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbd6e6-92b5-4781-ab20-1918cc53a66e None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:02.484437 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 588/1178] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:31:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:31:02.489446 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbab06c-1557-4f99-920c-5832173176cf None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:02.489878 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbab06c-1557-4f99-920c-5832173176cf None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:02.490004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbab06c-1557-4f99-920c-5832173176cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:02.506672 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-4cbab06c-1557-4f99-920c-5832173176cf None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:31:02.507840 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4cbab06c-1557-4f99-920c-5832173176cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:31:02.573462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 591/1179] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:31:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:31:02.597066 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbd6e6-92b5-4781-ab20-1918cc53a66e None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:31:02.695368 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cbd6e6-92b5-4781-ab20-1918cc53a66e None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:31:02.708970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:31:02.729194 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23404f-1d4e-4d92-be3e-bde3e06902ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:31:02.730000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23404f-1d4e-4d92-be3e-bde3e06902ae None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:02.730285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23404f-1d4e-4d92-be3e-bde3e06902ae None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:02.730590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23404f-1d4e-4d92-be3e-bde3e06902ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:02.741002 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23404f-1d4e-4d92-be3e-bde3e06902ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:31:02.748905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-1b23404f-1d4e-4d92-be3e-bde3e06902ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:31:02.748905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:31:02.748905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:31:02.748905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:31:02.748905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:31:02.748905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:31:02.748905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:31:02.748905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:31:02.748905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:31:02.748905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:31:02.748905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:31:02.748905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:31:02.748905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:31:02.748905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:31:02.748905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:31:02.748905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:31:02.750037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:31:02.750037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:31:02.750037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:31:02.750037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:31:02.750037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:31:02.750037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:31:02.750037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:31:02.750037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:31:02.750037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:31:02.750037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:31:02.750037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:31:02.750037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:31:02.750037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:31:02.750037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:31:02.750037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:31:02.750037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:31:02.751070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:31:02.751070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:31:02.751070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:31:02.751070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:31:02.751070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:31:02.751070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:31:02.751070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:31:02.751070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:31:02.751070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:31:02.751070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:31:02.751070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:31:02.751070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:31:02.751070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 589/1180] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:31:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:31:02.756012 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbab06c-1557-4f99-920c-5832173176cf None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:31:02.799040 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:31:02.855690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbab06c-1557-4f99-920c-5832173176cf None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:31:02.889052 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0deb9a-6e9c-4a3e-95c1-3e2431784c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:31:02.889730 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0deb9a-6e9c-4a3e-95c1-3e2431784c55 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:02.890014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0deb9a-6e9c-4a3e-95c1-3e2431784c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:02.890292 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0deb9a-6e9c-4a3e-95c1-3e2431784c55 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:02.891029 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0deb9a-6e9c-4a3e-95c1-3e2431784c55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:31:02.891334 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0deb9a-6e9c-4a3e-95c1-3e2431784c55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:31:02.892698 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0deb9a-6e9c-4a3e-95c1-3e2431784c55 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:31:02.900396 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 592/1181] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:31:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:31:02.907664 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23404f-1d4e-4d92-be3e-bde3e06902ae None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:31:03.014331 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23404f-1d4e-4d92-be3e-bde3e06902ae None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:31:03.047670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f8618-67c6-42b5-8461-82acd4a8333f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:31:03.048519 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f8618-67c6-42b5-8461-82acd4a8333f None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:03.048796 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f8618-67c6-42b5-8461-82acd4a8333f None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:03.049066 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f8618-67c6-42b5-8461-82acd4a8333f None admin] PATH_INFO: `/v3/users/2ecd70c4671f404484d439409aa6a028` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:03.062547 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f8618-67c6-42b5-8461-82acd4a8333f None admin] RBAC: Authorizing `identity:get_user(user_id=2ecd70c4671f404484d439409aa6a028)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:31:03.063974 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f8618-67c6-42b5-8461-82acd4a8333f None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:31:03.065617 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 590/1182] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:31:02 2022] GET /identity/v3/users/2ecd70c4671f404484d439409aa6a028 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:31:03.071312 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0deb9a-6e9c-4a3e-95c1-3e2431784c55 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:31:03.167658 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0deb9a-6e9c-4a3e-95c1-3e2431784c55 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:31:03.170645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:31:03.201851 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be4252-97c7-4303-af0a-8848aafe3c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:31:03.202481 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be4252-97c7-4303-af0a-8848aafe3c31 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:03.202764 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be4252-97c7-4303-af0a-8848aafe3c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:03.203039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6be4252-97c7-4303-af0a-8848aafe3c31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:03.268434 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be4252-97c7-4303-af0a-8848aafe3c31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:31:03.269852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6be4252-97c7-4303-af0a-8848aafe3c31 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:31:03.365925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 593/1183] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:31:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 19:31:03.372296 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f8618-67c6-42b5-8461-82acd4a8333f None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:31:03.402851 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:31:03.470604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f8618-67c6-42b5-8461-82acd4a8333f None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:31:03.503724 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b38455a-b842-4513-838a-6bb6e63037c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:31:03.504567 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38455a-b842-4513-838a-6bb6e63037c9 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:03.504851 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38455a-b842-4513-838a-6bb6e63037c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:03.505128 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b38455a-b842-4513-838a-6bb6e63037c9 None admin] PATH_INFO: `/v3/projects/e189765e22d84319a14867037dfaab08` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:03.506327 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38455a-b842-4513-838a-6bb6e63037c9 None admin] RBAC: Authorizing `identity:get_project(project_id=e189765e22d84319a14867037dfaab08)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:31:03.507753 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b38455a-b842-4513-838a-6bb6e63037c9 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:31:03.509465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 591/1184] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:31:03 2022] GET /identity/v3/projects/e189765e22d84319a14867037dfaab08 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:31:03.515680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be4252-97c7-4303-af0a-8848aafe3c31 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:31:03.518785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:31:03.612138 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6be4252-97c7-4303-af0a-8848aafe3c31 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:31:03.644818 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9fbcf-55cf-44b2-9da5-e29c0a8f3189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:31:03.645493 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9fbcf-55cf-44b2-9da5-e29c0a8f3189 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:03.645780 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9fbcf-55cf-44b2-9da5-e29c0a8f3189 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:03.646059 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9fbcf-55cf-44b2-9da5-e29c0a8f3189 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:03.646876 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9fbcf-55cf-44b2-9da5-e29c0a8f3189 None admin] RBAC: Adding query filter params (role.id=1e2bb0d759694428ada2b52285de933b, scope.project.id=e189765e22d84319a14867037dfaab08, user.id=2ecd70c4671f404484d439409aa6a028) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:31:03.647186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9fbcf-55cf-44b2-9da5-e29c0a8f3189 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:31:03.648608 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9fbcf-55cf-44b2-9da5-e29c0a8f3189 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:31:03.653965 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 594/1185] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:31:03 2022] GET /identity/v3/role_assignments?user.id=2ecd70c4671f404484d439409aa6a028&scope.project.id=e189765e22d84319a14867037dfaab08&role.id=1e2bb0d759694428ada2b52285de933b => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:31:05.740041 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c43dd3-e74c-4e64-8d8e-3f108bbeb25b None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:05.740601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c43dd3-e74c-4e64-8d8e-3f108bbeb25b None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:05.740601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c43dd3-e74c-4e64-8d8e-3f108bbeb25b None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:05.742038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 592/1186] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:31:05.747739 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97fb42-21c5-45af-8cc7-3c2d285a5bcd None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:05.748135 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97fb42-21c5-45af-8cc7-3c2d285a5bcd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:05.748310 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97fb42-21c5-45af-8cc7-3c2d285a5bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:05.765747 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-5b97fb42-21c5-45af-8cc7-3c2d285a5bcd None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:31:05.767608 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5b97fb42-21c5-45af-8cc7-3c2d285a5bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:31:05.831698 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:31:05.837423 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 595/1187] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:31:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:31:05.860607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c43dd3-e74c-4e64-8d8e-3f108bbeb25b None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:31:05.961201 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:31:05.965552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c43dd3-e74c-4e64-8d8e-3f108bbeb25b None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:31:05.999575 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365114b-3bca-4007-8a6f-be1944a75149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:31:06.000289 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365114b-3bca-4007-8a6f-be1944a75149 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:06.000570 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365114b-3bca-4007-8a6f-be1944a75149 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:06.000844 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365114b-3bca-4007-8a6f-be1944a75149 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:06.010701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365114b-3bca-4007-8a6f-be1944a75149 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:31:06.024718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-a365114b-3bca-4007-8a6f-be1944a75149 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:31:06.024718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:31:06.024718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:31:06.024718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:31:06.024718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:31:06.024718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:31:06.024718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:31:06.024718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:31:06.024718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:31:06.024718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:31:06.024718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:31:06.024718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:31:06.024718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:31:06.024718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:31:06.024718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:31:06.024718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:31:06.025839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:31:06.025839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:31:06.025839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:31:06.025839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:31:06.025839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:31:06.025839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:31:06.025839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:31:06.025839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:31:06.025839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:31:06.025839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:31:06.025839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:31:06.025839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:31:06.025839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:31:06.025839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:31:06.025839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:31:06.025839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:31:06.026867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:31:06.026867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:31:06.026867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:31:06.026867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:31:06.026867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:31:06.026867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:31:06.026867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:31:06.026867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:31:06.026867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:31:06.026867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:31:06.026867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:31:06.026867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:31:06.028163 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 593/1188] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:31:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:31:06.033741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97fb42-21c5-45af-8cc7-3c2d285a5bcd None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:31:06.129936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97fb42-21c5-45af-8cc7-3c2d285a5bcd None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:31:06.162691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9276c-e908-44cc-a8bd-7d07e615e5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:31:06.163333 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9276c-e908-44cc-a8bd-7d07e615e5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:06.163621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9276c-e908-44cc-a8bd-7d07e615e5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:06.163897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9276c-e908-44cc-a8bd-7d07e615e5d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:06.164623 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9276c-e908-44cc-a8bd-7d07e615e5d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:31:06.164928 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9276c-e908-44cc-a8bd-7d07e615e5d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:31:06.166304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9276c-e908-44cc-a8bd-7d07e615e5d4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:31:06.175110 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 596/1189] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:31:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:31:06.180626 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365114b-3bca-4007-8a6f-be1944a75149 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:31:06.279237 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365114b-3bca-4007-8a6f-be1944a75149 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:31:06.312506 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77ae61-4c15-41a2-a7c3-cc80e8cc3e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:31:06.313360 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77ae61-4c15-41a2-a7c3-cc80e8cc3e77 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:06.313672 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77ae61-4c15-41a2-a7c3-cc80e8cc3e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:06.313950 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77ae61-4c15-41a2-a7c3-cc80e8cc3e77 None admin] PATH_INFO: `/v3/users/2ecd70c4671f404484d439409aa6a028` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:06.315124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77ae61-4c15-41a2-a7c3-cc80e8cc3e77 None admin] RBAC: Authorizing `identity:get_user(user_id=2ecd70c4671f404484d439409aa6a028)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:31:06.316548 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77ae61-4c15-41a2-a7c3-cc80e8cc3e77 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:31:06.318207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 594/1190] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:31:06 2022] GET /identity/v3/users/2ecd70c4671f404484d439409aa6a028 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:31:06.323868 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9276c-e908-44cc-a8bd-7d07e615e5d4 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:31:06.381332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:31:06.422224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9276c-e908-44cc-a8bd-7d07e615e5d4 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:31:06.454170 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f954cb-9570-41bf-8441-6291f5f2ba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:31:06.455008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f954cb-9570-41bf-8441-6291f5f2ba2d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:06.455290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f954cb-9570-41bf-8441-6291f5f2ba2d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:06.455566 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f954cb-9570-41bf-8441-6291f5f2ba2d None admin] PATH_INFO: `/v3/projects/e189765e22d84319a14867037dfaab08` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:06.456718 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f954cb-9570-41bf-8441-6291f5f2ba2d None admin] RBAC: Authorizing `identity:get_project(project_id=e189765e22d84319a14867037dfaab08)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:31:06.458181 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f954cb-9570-41bf-8441-6291f5f2ba2d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:31:06.459838 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 597/1191] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:31:06 2022] GET /identity/v3/projects/e189765e22d84319a14867037dfaab08 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:31:06.466484 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77ae61-4c15-41a2-a7c3-cc80e8cc3e77 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:31:06.494010 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:31:06.563649 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77ae61-4c15-41a2-a7c3-cc80e8cc3e77 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:31:06.596190 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97a1a7-d312-4b58-8232-670083d0b68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:31:06.597050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97a1a7-d312-4b58-8232-670083d0b68b None admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:06.597328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97a1a7-d312-4b58-8232-670083d0b68b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:06.597622 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97a1a7-d312-4b58-8232-670083d0b68b None admin] PATH_INFO: `/v3/projects/e189765e22d84319a14867037dfaab08/users/2ecd70c4671f404484d439409aa6a028/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:06.599540 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97a1a7-d312-4b58-8232-670083d0b68b None admin] RBAC: Authorizing `identity:create_grant(project_id=e189765e22d84319a14867037dfaab08, user_id=2ecd70c4671f404484d439409aa6a028, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:31:06.600962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97a1a7-d312-4b58-8232-670083d0b68b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:31:06.613537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 595/1192] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:31:06 2022] PUT /identity/v3/projects/e189765e22d84319a14867037dfaab08/users/2ecd70c4671f404484d439409aa6a028/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:31:08.700663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43f38b-8c95-40e4-9f34-7abcb8cc2292 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:08.701225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43f38b-8c95-40e4-9f34-7abcb8cc2292 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:08.701225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43f38b-8c95-40e4-9f34-7abcb8cc2292 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:08.702613 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 598/1193] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:31:08.707614 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43741f-1cda-466d-b4d6-2801ad1b854f None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:08.708017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43741f-1cda-466d-b4d6-2801ad1b854f None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:08.708173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43741f-1cda-466d-b4d6-2801ad1b854f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:08.724652 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-7e43741f-1cda-466d-b4d6-2801ad1b854f None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:31:08.725879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7e43741f-1cda-466d-b4d6-2801ad1b854f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:31:08.791617 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 596/1194] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:31:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 14 19:31:08.815789 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43f38b-8c95-40e4-9f34-7abcb8cc2292 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:31:08.919007 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43f38b-8c95-40e4-9f34-7abcb8cc2292 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:31:08.945054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:31:08.953178 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544daa4-ff39-4166-935a-5b4494bc1022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:31:08.953936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544daa4-ff39-4166-935a-5b4494bc1022 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:08.954221 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544daa4-ff39-4166-935a-5b4494bc1022 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:08.954524 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544daa4-ff39-4166-935a-5b4494bc1022 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:08.964292 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544daa4-ff39-4166-935a-5b4494bc1022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:31:08.972097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-7544daa4-ff39-4166-935a-5b4494bc1022 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:31:08.972097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:31:08.972097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:31:08.972097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:31:08.972097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:31:08.972097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:31:08.972097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:31:08.972097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:31:08.972097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:31:08.972097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:31:08.972097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:31:08.972097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:31:08.972097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:31:08.972097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:31:08.972097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:31:08.972097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:31:08.973193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:31:08.973193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:31:08.973193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:31:08.973193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:31:08.973193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:31:08.973193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:31:08.973193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:31:08.973193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:31:08.973193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:31:08.973193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:31:08.973193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:31:08.973193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:31:08.973193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:31:08.973193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:31:08.973193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:31:08.973193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:31:08.974468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:31:08.974468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:31:08.974468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:31:08.974468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:31:08.974468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:31:08.974468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:31:08.974468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:31:08.974468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:31:08.974468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:31:08.974468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:31:08.974468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:31:08.974468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:31:08.974468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 599/1195] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:31:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:31:08.979299 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43741f-1cda-466d-b4d6-2801ad1b854f None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:31:08.998179 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:31:09.077014 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43741f-1cda-466d-b4d6-2801ad1b854f None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:31:09.110639 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54595e3a-f4cf-4607-a7fd-1bb3b85fe8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:31:09.111289 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54595e3a-f4cf-4607-a7fd-1bb3b85fe8ba None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:09.111567 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54595e3a-f4cf-4607-a7fd-1bb3b85fe8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:09.111841 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54595e3a-f4cf-4607-a7fd-1bb3b85fe8ba None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:09.112571 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54595e3a-f4cf-4607-a7fd-1bb3b85fe8ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:31:09.112875 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54595e3a-f4cf-4607-a7fd-1bb3b85fe8ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:31:09.114250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54595e3a-f4cf-4607-a7fd-1bb3b85fe8ba None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:31:09.122458 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 597/1196] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:31:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:31:09.128111 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544daa4-ff39-4166-935a-5b4494bc1022 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:31:09.237762 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544daa4-ff39-4166-935a-5b4494bc1022 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:31:09.269740 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c020b74-8e9c-44b3-9007-865b21157bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:31:09.270599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c020b74-8e9c-44b3-9007-865b21157bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:09.270883 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c020b74-8e9c-44b3-9007-865b21157bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:09.271156 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c020b74-8e9c-44b3-9007-865b21157bd7 None admin] PATH_INFO: `/v3/users/2ecd70c4671f404484d439409aa6a028` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:09.272329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c020b74-8e9c-44b3-9007-865b21157bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=2ecd70c4671f404484d439409aa6a028)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:31:09.273788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c020b74-8e9c-44b3-9007-865b21157bd7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:31:09.275394 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 600/1197] 10.222.0.44 () {56 vars in 1177 bytes} [Tue Jun 14 19:31:09 2022] GET /identity/v3/users/2ecd70c4671f404484d439409aa6a028 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:31:09.282182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54595e3a-f4cf-4607-a7fd-1bb3b85fe8ba None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:31:09.362161 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:31:09.380564 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54595e3a-f4cf-4607-a7fd-1bb3b85fe8ba None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:31:09.413409 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ad788-165e-4207-a899-ce1227619bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:31:09.414038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ad788-165e-4207-a899-ce1227619bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:09.414318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ad788-165e-4207-a899-ce1227619bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:09.414593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ad788-165e-4207-a899-ce1227619bb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:09.480562 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ad788-165e-4207-a899-ce1227619bb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:31:09.488604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ad788-165e-4207-a899-ce1227619bb8 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:31:09.570141 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:31:09.589809 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 598/1198] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:31:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 19:31:09.595627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c020b74-8e9c-44b3-9007-865b21157bd7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:31:09.650202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:31:09.693741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c020b74-8e9c-44b3-9007-865b21157bd7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:31:09.725411 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db53bb1-c899-4eee-9166-07329b89d033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:31:09.726255 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db53bb1-c899-4eee-9166-07329b89d033 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:09.726534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db53bb1-c899-4eee-9166-07329b89d033 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:09.726806 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db53bb1-c899-4eee-9166-07329b89d033 None admin] PATH_INFO: `/v3/projects/e189765e22d84319a14867037dfaab08` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:09.727956 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db53bb1-c899-4eee-9166-07329b89d033 None admin] RBAC: Authorizing `identity:get_project(project_id=e189765e22d84319a14867037dfaab08)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:31:09.729410 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db53bb1-c899-4eee-9166-07329b89d033 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:31:09.731773 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 601/1199] 10.222.0.44 () {56 vars in 1186 bytes} [Tue Jun 14 19:31:09 2022] GET /identity/v3/projects/e189765e22d84319a14867037dfaab08 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:31:09.737694 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ad788-165e-4207-a899-ce1227619bb8 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:31:09.838870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ad788-165e-4207-a899-ce1227619bb8 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:31:09.872259 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329d432-8ff3-4376-8159-390903911dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:31:09.872896 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329d432-8ff3-4376-8159-390903911dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:31:09.873177 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329d432-8ff3-4376-8159-390903911dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:31:09.873484 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329d432-8ff3-4376-8159-390903911dc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:31:09.874302 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329d432-8ff3-4376-8159-390903911dc2 None admin] RBAC: Adding query filter params (role.id=1e2bb0d759694428ada2b52285de933b, scope.project.id=e189765e22d84319a14867037dfaab08, user.id=2ecd70c4671f404484d439409aa6a028) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:31:09.874608 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329d432-8ff3-4376-8159-390903911dc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:31:09.876009 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329d432-8ff3-4376-8159-390903911dc2 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:31:09.881786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 599/1200] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:31:09 2022] GET /identity/v3/role_assignments?user.id=2ecd70c4671f404484d439409aa6a028&scope.project.id=e189765e22d84319a14867037dfaab08&role.id=1e2bb0d759694428ada2b52285de933b => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:31:19.721419 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=38 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:31:19.879177 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=78 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:06.449858 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477d5c9-b2fb-4eda-bc7d-2e350c226f8a None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:06.450444 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477d5c9-b2fb-4eda-bc7d-2e350c226f8a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:06.450615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f477d5c9-b2fb-4eda-bc7d-2e350c226f8a None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:06.452590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 602/1201] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:32:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:32:06.458527 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ca740-60cf-429d-a2dd-ba0af4f90501 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:06.459144 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ca740-60cf-429d-a2dd-ba0af4f90501 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:06.459239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ca740-60cf-429d-a2dd-ba0af4f90501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:06.479165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-e51ca740-60cf-429d-a2dd-ba0af4f90501 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:32:06.480837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e51ca740-60cf-429d-a2dd-ba0af4f90501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:32:06.572690 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 600/1202] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:32:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:32:06.599993 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477d5c9-b2fb-4eda-bc7d-2e350c226f8a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:06.751119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f477d5c9-b2fb-4eda-bc7d-2e350c226f8a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:06.791557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7e397-860b-48f7-8962-4900dd353cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:06.792367 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7e397-860b-48f7-8962-4900dd353cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:06.792648 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7e397-860b-48f7-8962-4900dd353cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:06.792927 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7e397-860b-48f7-8962-4900dd353cf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:06.810409 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7e397-860b-48f7-8962-4900dd353cf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:06.811960 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a7e397-860b-48f7-8962-4900dd353cf6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:06.839064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-a5a7e397-860b-48f7-8962-4900dd353cf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:06.839064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:06.839064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:06.839064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:06.839064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:06.839064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:06.839064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:06.839064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:06.839064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:06.839064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:06.839064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:06.839064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:06.839064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:32:06.839064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:32:06.839064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:32:06.840339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:32:06.840339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:06.840339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:06.840339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:06.840339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:06.840339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:06.840339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:06.840339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:06.840339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:06.840339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:06.840339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:06.840339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:06.840339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:06.840339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:06.840339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:06.840339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:06.840339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:06.841746 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:32:06.841746 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:32:06.841746 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:06.841746 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:32:06.841746 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 603/1203] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:32:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:06.848183 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ca740-60cf-429d-a2dd-ba0af4f90501 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:06.984719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ca740-60cf-429d-a2dd-ba0af4f90501 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:07.022698 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:07.032970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66929341-6121-4b45-bb17-854345c20217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:07.033646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66929341-6121-4b45-bb17-854345c20217 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:07.033932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66929341-6121-4b45-bb17-854345c20217 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:07.034215 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66929341-6121-4b45-bb17-854345c20217 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:07.034928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66929341-6121-4b45-bb17-854345c20217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:07.035490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66929341-6121-4b45-bb17-854345c20217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:07.036855 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66929341-6121-4b45-bb17-854345c20217 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:07.050277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 601/1204] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:07.058835 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7e397-860b-48f7-8962-4900dd353cf6 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:07.126105 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:07.186828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7e397-860b-48f7-8962-4900dd353cf6 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:07.230382 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa0a02-a788-4335-a9fb-91ad91aca0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:07.231056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa0a02-a788-4335-a9fb-91ad91aca0ba None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:07.231361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa0a02-a788-4335-a9fb-91ad91aca0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:07.231622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa0a02-a788-4335-a9fb-91ad91aca0ba None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:07.232323 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa0a02-a788-4335-a9fb-91ad91aca0ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:07.233792 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa0a02-a788-4335-a9fb-91ad91aca0ba None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:07.256573 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 604/1205] 10.222.0.44 () {60 vars in 1132 bytes} [Tue Jun 14 19:32:07 2022] POST /identity/v3/users => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:32:09.700898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18faa51-6984-478b-a6a7-1ec04b056af5 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:09.701490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18faa51-6984-478b-a6a7-1ec04b056af5 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:09.701490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18faa51-6984-478b-a6a7-1ec04b056af5 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:09.702994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 602/1206] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:32:09.708296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251bf88-9b1b-4f6a-a617-755ca42d0f0a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:09.708724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251bf88-9b1b-4f6a-a617-755ca42d0f0a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:09.708873 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251bf88-9b1b-4f6a-a617-755ca42d0f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:09.725913 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a251bf88-9b1b-4f6a-a617-755ca42d0f0a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:32:09.727960 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a251bf88-9b1b-4f6a-a617-755ca42d0f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:32:09.810479 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 605/1207] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:32:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:32:09.834795 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18faa51-6984-478b-a6a7-1ec04b056af5 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:09.953948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18faa51-6984-478b-a6a7-1ec04b056af5 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:09.993538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef500e-0331-47ff-bec6-4a030259f7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:09.994710 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef500e-0331-47ff-bec6-4a030259f7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:09.995022 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef500e-0331-47ff-bec6-4a030259f7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:09.995303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef500e-0331-47ff-bec6-4a030259f7f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:10.007499 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef500e-0331-47ff-bec6-4a030259f7f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:32:10.015945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-cdef500e-0331-47ff-bec6-4a030259f7f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:32:10.015945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:10.015945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:10.015945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:10.015945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:10.015945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:10.015945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:10.015945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:10.015945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:10.015945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:10.015945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:10.015945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:10.015945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:32:10.015945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:32:10.015945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:32:10.015945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:32:10.016924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:32:10.016924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:32:10.016924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:32:10.016924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:32:10.016924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:10.016924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:10.016924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:10.016924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:10.016924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:10.016924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:10.016924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:10.016924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:10.016924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:10.016924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:10.016924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:10.016924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:10.022994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:10.022994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:10.022994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:10.022994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:10.022994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:32:10.022994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:32:10.022994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:32:10.022994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:32:10.022994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:32:10.022994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:32:10.022994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:32:10.022994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:10.022994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 603/1208] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:32:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:32:10.025405 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251bf88-9b1b-4f6a-a617-755ca42d0f0a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:10.069797 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:10.146246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a251bf88-9b1b-4f6a-a617-755ca42d0f0a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:10.186462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f925a-8721-4437-9e05-7174042cdca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:10.187484 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f925a-8721-4437-9e05-7174042cdca4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:10.188001 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f925a-8721-4437-9e05-7174042cdca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:10.188496 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f925a-8721-4437-9e05-7174042cdca4 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:10.189506 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f925a-8721-4437-9e05-7174042cdca4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:10.190071 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f925a-8721-4437-9e05-7174042cdca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:10.191474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f925a-8721-4437-9e05-7174042cdca4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:10.200887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 606/1209] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jun 14 19:32:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:10.206908 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef500e-0331-47ff-bec6-4a030259f7f6 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:10.264307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:10.321666 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef500e-0331-47ff-bec6-4a030259f7f6 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:10.359466 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fd5e0-c528-4912-bce6-756cfb4e483e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:10.360264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fd5e0-c528-4912-bce6-756cfb4e483e None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:10.360546 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fd5e0-c528-4912-bce6-756cfb4e483e None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:10.360817 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fd5e0-c528-4912-bce6-756cfb4e483e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:10.371262 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fd5e0-c528-4912-bce6-756cfb4e483e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:10.372779 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fd5e0-c528-4912-bce6-756cfb4e483e None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:10.397686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-753fd5e0-c528-4912-bce6-756cfb4e483e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:10.397686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:10.397686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:10.397686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:10.397686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:10.397686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:10.397686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:10.397686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:10.397686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:10.397686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:10.397686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:10.397686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:10.397686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:32:10.397686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:32:10.397686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:32:10.399271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:32:10.399271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:10.399271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:10.399271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:10.399271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:10.399271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:10.399271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:10.399271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:10.399271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:10.399271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:10.399271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:10.399271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:10.399271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:10.399271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:10.399271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:10.399271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:10.399271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:10.400244 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:32:10.400244 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:32:10.400244 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:10.400244 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:10.400244 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 604/1210] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:32:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:10.409515 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f925a-8721-4437-9e05-7174042cdca4 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:10.542640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:10.545886 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f925a-8721-4437-9e05-7174042cdca4 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:10.585145 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a407ef-7c75-4cc2-a9cc-d71c8c0eadc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:10.585865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a407ef-7c75-4cc2-a9cc-d71c8c0eadc1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:10.586355 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a407ef-7c75-4cc2-a9cc-d71c8c0eadc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:10.587077 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a407ef-7c75-4cc2-a9cc-d71c8c0eadc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:10.587802 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a407ef-7c75-4cc2-a9cc-d71c8c0eadc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:10.588112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a407ef-7c75-4cc2-a9cc-d71c8c0eadc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:10.590009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a407ef-7c75-4cc2-a9cc-d71c8c0eadc1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:10.604625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 607/1211] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:10.611236 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fd5e0-c528-4912-bce6-756cfb4e483e None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:10.732151 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fd5e0-c528-4912-bce6-756cfb4e483e None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:10.733827 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:10.772424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f127989-c5b3-40d5-9031-8f16d6e6c50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:10.773226 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f127989-c5b3-40d5-9031-8f16d6e6c50e None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:10.773557 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f127989-c5b3-40d5-9031-8f16d6e6c50e None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:10.773889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f127989-c5b3-40d5-9031-8f16d6e6c50e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:10.781950 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f127989-c5b3-40d5-9031-8f16d6e6c50e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:10.783037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f127989-c5b3-40d5-9031-8f16d6e6c50e None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:10.800718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-2f127989-c5b3-40d5-9031-8f16d6e6c50e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 14 19:32:10.800718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:10.800718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:10.800718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:10.800718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:10.800718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:10.800718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:10.800718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:10.800718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:10.800718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:10.800718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:10.800718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:10.800718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:32:10.800718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:32:10.800718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:32:10.800718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:32:10.802043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:10.802043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:10.802043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:32:10.802043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:32:10.802043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:32:10.802043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:32:10.802043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:10.802043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:10.802043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:10.802043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:10.802043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:10.802043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:10.802043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:10.802043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:10.802043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:10.802043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:10.802043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:10.802043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:10.803003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:10.803003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:10.803003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:32:10.803003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:32:10.803003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:32:10.803003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:32:10.803003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:32:10.803003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:32:10.803003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 14 19:32:10.803003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:10.806952 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 605/1212] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:32:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:10.808472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a407ef-7c75-4cc2-a9cc-d71c8c0eadc1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:10.927315 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a407ef-7c75-4cc2-a9cc-d71c8c0eadc1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:10.966728 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5824d9-5b8e-44cf-991a-be1d56025795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:10.967418 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5824d9-5b8e-44cf-991a-be1d56025795 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:10.967696 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5824d9-5b8e-44cf-991a-be1d56025795 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:10.967971 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5824d9-5b8e-44cf-991a-be1d56025795 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:10.968817 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5824d9-5b8e-44cf-991a-be1d56025795 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:10.969118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5824d9-5b8e-44cf-991a-be1d56025795 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:10.970590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5824d9-5b8e-44cf-991a-be1d56025795 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:10.994465 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 608/1213] 10.222.0.44 () {56 vars in 1143 bytes} [Tue Jun 14 19:32:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:11.000553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f127989-c5b3-40d5-9031-8f16d6e6c50e None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:11.138657 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f127989-c5b3-40d5-9031-8f16d6e6c50e None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:11.184258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44208d3c-298a-4625-918e-37c9a8fbad11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:11.185262 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44208d3c-298a-4625-918e-37c9a8fbad11 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:11.185566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44208d3c-298a-4625-918e-37c9a8fbad11 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:11.185843 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44208d3c-298a-4625-918e-37c9a8fbad11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:11.222067 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:11.269248 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44208d3c-298a-4625-918e-37c9a8fbad11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:11.270832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44208d3c-298a-4625-918e-37c9a8fbad11 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:11.386730 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 606/1214] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:32:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 19:32:11.393250 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5824d9-5b8e-44cf-991a-be1d56025795 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:11.413551 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:11.514475 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5824d9-5b8e-44cf-991a-be1d56025795 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:11.551451 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f0439-9e32-49df-b51a-b49731d0be3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:11.552249 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f0439-9e32-49df-b51a-b49731d0be3b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:11.552534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f0439-9e32-49df-b51a-b49731d0be3b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:11.552816 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f0439-9e32-49df-b51a-b49731d0be3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:11.568597 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f0439-9e32-49df-b51a-b49731d0be3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:11.570354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f0439-9e32-49df-b51a-b49731d0be3b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:11.592010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-f43f0439-9e32-49df-b51a-b49731d0be3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:11.592010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:11.592010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:11.592010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:11.592010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:11.592010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:11.592010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:11.592010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:11.592010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:11.592010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:11.592010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:11.592010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:11.592010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:32:11.592010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:32:11.592010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:32:11.593606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:32:11.593606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:11.593606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:11.593606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:11.593606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:11.593606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:11.593606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:11.593606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:11.593606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:11.593606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:11.593606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:11.593606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:11.593606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:11.593606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:11.593606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:11.593606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:11.593606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:11.594490 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:32:11.594490 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:32:11.594490 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:11.594490 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:32:11.594490 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 609/1215] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:32:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:11.599611 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44208d3c-298a-4625-918e-37c9a8fbad11 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:11.669299 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:11.725981 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44208d3c-298a-4625-918e-37c9a8fbad11 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:11.766978 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112e4cc-dabf-4d95-afbc-ed06e23727ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:11.767657 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112e4cc-dabf-4d95-afbc-ed06e23727ca None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:11.767942 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112e4cc-dabf-4d95-afbc-ed06e23727ca None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:11.781401 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112e4cc-dabf-4d95-afbc-ed06e23727ca None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:11.781401 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112e4cc-dabf-4d95-afbc-ed06e23727ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:11.781401 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112e4cc-dabf-4d95-afbc-ed06e23727ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:11.781401 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112e4cc-dabf-4d95-afbc-ed06e23727ca None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:11.782802 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 607/1216] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:11.788763 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f0439-9e32-49df-b51a-b49731d0be3b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:11.875299 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:11.907895 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f0439-9e32-49df-b51a-b49731d0be3b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:11.949431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcdaa3-123b-4cfb-81eb-37604eb7486e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:11.950164 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcdaa3-123b-4cfb-81eb-37604eb7486e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:11.950452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcdaa3-123b-4cfb-81eb-37604eb7486e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:11.950742 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcdaa3-123b-4cfb-81eb-37604eb7486e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:11.957770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dcdaa3-123b-4cfb-81eb-37604eb7486e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:11.959222 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dcdaa3-123b-4cfb-81eb-37604eb7486e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:11.974456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-c6dcdaa3-123b-4cfb-81eb-37604eb7486e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:32:11.974456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:11.974456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:11.974456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:11.974456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:11.974456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:11.974456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:11.974456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:11.974456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:11.974456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:11.974456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:11.974456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:11.974456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:32:11.974456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:32:11.974456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:32:11.975601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:32:11.975601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:11.975601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:11.975601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:11.975601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:11.975601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:11.975601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:11.975601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:11.975601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:11.975601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:11.975601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:11.975601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:11.975601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:11.975601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:11.975601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:11.975601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:11.975601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:11.977543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:32:11.977543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:32:11.977543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:32:11.977543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:32:11.977543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:32:11.977543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:32:11.977543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:32:11.977543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:32:11.980987 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 610/1217] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:32:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:32:11.982070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112e4cc-dabf-4d95-afbc-ed06e23727ca None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:12.105207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112e4cc-dabf-4d95-afbc-ed06e23727ca None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:12.128768 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:12.140932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528039c-2f05-4b1f-ab73-ad6e2c0e2a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:12.141704 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528039c-2f05-4b1f-ab73-ad6e2c0e2a73 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:12.142059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528039c-2f05-4b1f-ab73-ad6e2c0e2a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:12.142406 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528039c-2f05-4b1f-ab73-ad6e2c0e2a73 None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:12.143265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528039c-2f05-4b1f-ab73-ad6e2c0e2a73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:12.143648 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528039c-2f05-4b1f-ab73-ad6e2c0e2a73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:12.145147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528039c-2f05-4b1f-ab73-ad6e2c0e2a73 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:12.159152 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 608/1218] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:32:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:12.166670 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcdaa3-123b-4cfb-81eb-37604eb7486e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:12.275452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcdaa3-123b-4cfb-81eb-37604eb7486e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:12.305826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:12.314393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3a846-6a95-48c9-a78a-7b8e98ae16ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:12.315054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3a846-6a95-48c9-a78a-7b8e98ae16ff None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:12.315344 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3a846-6a95-48c9-a78a-7b8e98ae16ff None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:12.315655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3a846-6a95-48c9-a78a-7b8e98ae16ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:12.316486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3a846-6a95-48c9-a78a-7b8e98ae16ff None admin] RBAC: Adding query filter params (role.id=539442ef092c4fcf9e1d0be045928c5a, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=e98915513674460485413c2dbee87fb3) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:12.316799 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3a846-6a95-48c9-a78a-7b8e98ae16ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:12.318259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3a846-6a95-48c9-a78a-7b8e98ae16ff None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:12.324248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 611/1219] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:32:12 2022] GET /identity/v3/role_assignments?user.id=e98915513674460485413c2dbee87fb3&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=539442ef092c4fcf9e1d0be045928c5a => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:32:14.591349 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815ba1a-4a60-4078-917f-552f1119a78b None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:14.591943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815ba1a-4a60-4078-917f-552f1119a78b None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:14.591943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815ba1a-4a60-4078-917f-552f1119a78b None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:14.593275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 609/1220] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:32:14.599240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cfbc2-1f19-4791-993e-5735209c1afd None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:14.599734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cfbc2-1f19-4791-993e-5735209c1afd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:14.599830 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cfbc2-1f19-4791-993e-5735209c1afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:14.618267 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b44cfbc2-1f19-4791-993e-5735209c1afd None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:32:14.619466 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b44cfbc2-1f19-4791-993e-5735209c1afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:32:14.688742 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 612/1221] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:32:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:32:14.712900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815ba1a-4a60-4078-917f-552f1119a78b None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:14.826668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815ba1a-4a60-4078-917f-552f1119a78b None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:14.869854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f222c-57ad-425a-b8ad-e78c658d541e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:14.870639 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f222c-57ad-425a-b8ad-e78c658d541e None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:14.870988 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f222c-57ad-425a-b8ad-e78c658d541e None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:14.871267 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f222c-57ad-425a-b8ad-e78c658d541e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:14.883185 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f222c-57ad-425a-b8ad-e78c658d541e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:32:14.891077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-8f7f222c-57ad-425a-b8ad-e78c658d541e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:32:14.891077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:14.891077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:14.891077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:14.891077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:14.891077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:14.891077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:14.891077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:14.891077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:14.891077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:14.891077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:14.891077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:14.891077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:32:14.891077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:32:14.891077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:32:14.891077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:32:14.892224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:32:14.892224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:32:14.892224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:32:14.892224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:32:14.892224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:14.892224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:14.892224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:14.892224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:14.892224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:14.892224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:14.892224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:14.892224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:14.892224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:14.892224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:14.892224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:14.892224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:14.893239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:14.893239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:14.893239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:14.893239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:14.893239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:32:14.893239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:32:14.893239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:32:14.893239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:32:14.893239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:32:14.893239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:32:14.893239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:32:14.893239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:14.897508 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 610/1222] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:32:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:14.898743 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cfbc2-1f19-4791-993e-5735209c1afd None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:15.012160 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cfbc2-1f19-4791-993e-5735209c1afd None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:15.039353 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:15.051260 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724be46-2ca8-46f9-9727-29aac8ac88d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:15.051932 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724be46-2ca8-46f9-9727-29aac8ac88d0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:15.052220 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724be46-2ca8-46f9-9727-29aac8ac88d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:15.052502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724be46-2ca8-46f9-9727-29aac8ac88d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:15.053252 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724be46-2ca8-46f9-9727-29aac8ac88d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:15.053603 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724be46-2ca8-46f9-9727-29aac8ac88d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:15.055576 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724be46-2ca8-46f9-9727-29aac8ac88d0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:15.063961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 613/1223] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jun 14 19:32:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:15.069512 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f222c-57ad-425a-b8ad-e78c658d541e None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:15.115648 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:15.180508 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f222c-57ad-425a-b8ad-e78c658d541e None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:15.221312 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab51b0f-57f0-4783-bc74-237c777e5f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:15.222150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab51b0f-57f0-4783-bc74-237c777e5f4d None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:15.222438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab51b0f-57f0-4783-bc74-237c777e5f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:15.222716 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab51b0f-57f0-4783-bc74-237c777e5f4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:15.237928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab51b0f-57f0-4783-bc74-237c777e5f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:15.239759 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab51b0f-57f0-4783-bc74-237c777e5f4d None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:15.260620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-dab51b0f-57f0-4783-bc74-237c777e5f4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:15.260620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:15.260620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:15.260620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:15.260620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:15.260620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:15.260620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:15.260620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:15.260620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:15.260620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:15.260620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:15.260620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:15.260620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:32:15.260620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:32:15.260620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:32:15.261819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:32:15.261819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:15.261819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:15.261819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:15.261819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:15.261819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:15.261819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:15.261819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:15.261819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:15.261819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:15.261819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:15.261819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:15.261819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:15.261819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:15.261819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:15.261819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:15.261819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:15.262721 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:32:15.262721 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:32:15.262721 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:15.262721 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:15.262721 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 611/1224] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:32:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:15.270216 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724be46-2ca8-46f9-9727-29aac8ac88d0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:15.379806 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724be46-2ca8-46f9-9727-29aac8ac88d0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:15.420067 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7e147-1f86-49ce-8477-39111e77a3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:15.421005 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7e147-1f86-49ce-8477-39111e77a3ab None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:15.421584 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7e147-1f86-49ce-8477-39111e77a3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:15.421874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7e147-1f86-49ce-8477-39111e77a3ab None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:15.423040 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7e147-1f86-49ce-8477-39111e77a3ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:15.423499 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7e147-1f86-49ce-8477-39111e77a3ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:15.425306 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7e147-1f86-49ce-8477-39111e77a3ab None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:15.447113 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 614/1225] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:32:15.448277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab51b0f-57f0-4783-bc74-237c777e5f4d None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:15.555791 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:15.565364 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab51b0f-57f0-4783-bc74-237c777e5f4d None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:15.610871 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411c498-dd03-44fc-9e76-cb37ef8cef8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:15.611611 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411c498-dd03-44fc-9e76-cb37ef8cef8a None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:15.611926 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411c498-dd03-44fc-9e76-cb37ef8cef8a None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:15.612233 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411c498-dd03-44fc-9e76-cb37ef8cef8a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:15.622054 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411c498-dd03-44fc-9e76-cb37ef8cef8a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:15.623620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411c498-dd03-44fc-9e76-cb37ef8cef8a None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:15.639507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-c411c498-dd03-44fc-9e76-cb37ef8cef8a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 14 19:32:15.639507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:15.639507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:15.639507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:15.639507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:15.639507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:15.639507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:15.639507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:15.639507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:15.639507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:15.639507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:15.639507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:15.639507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:32:15.639507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:32:15.639507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:32:15.639507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:32:15.640765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:15.640765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:15.640765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:32:15.640765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:32:15.640765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:32:15.640765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:32:15.640765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:15.640765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:15.640765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:15.640765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:15.640765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:15.640765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:15.640765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:15.640765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:15.640765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:15.640765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:15.640765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:15.640765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:15.641786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:15.641786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:15.641786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:32:15.641786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:32:15.641786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:32:15.641786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:32:15.641786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:32:15.641786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:32:15.641786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 14 19:32:15.641786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:15.641786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 612/1226] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:32:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:15.646984 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7e147-1f86-49ce-8477-39111e77a3ab None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:15.700188 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:15.759511 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7e147-1f86-49ce-8477-39111e77a3ab None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:15.799772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f5c07-ef9e-45b1-b16f-64a4e0cb5c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:15.800448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f5c07-ef9e-45b1-b16f-64a4e0cb5c0f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:15.800726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f5c07-ef9e-45b1-b16f-64a4e0cb5c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:15.801007 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f5c07-ef9e-45b1-b16f-64a4e0cb5c0f None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:15.801879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f5c07-ef9e-45b1-b16f-64a4e0cb5c0f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:15.802186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f5c07-ef9e-45b1-b16f-64a4e0cb5c0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:15.803636 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f5c07-ef9e-45b1-b16f-64a4e0cb5c0f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:15.822329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 615/1227] 10.222.0.44 () {56 vars in 1143 bytes} [Tue Jun 14 19:32:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:15.829002 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411c498-dd03-44fc-9e76-cb37ef8cef8a None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:15.959130 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411c498-dd03-44fc-9e76-cb37ef8cef8a None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:15.997219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda102a-cbd2-4ed6-a993-429870ba2510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:15.998048 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda102a-cbd2-4ed6-a993-429870ba2510 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:15.998343 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda102a-cbd2-4ed6-a993-429870ba2510 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:15.998621 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda102a-cbd2-4ed6-a993-429870ba2510 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:16.009927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda102a-cbd2-4ed6-a993-429870ba2510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:16.011407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda102a-cbd2-4ed6-a993-429870ba2510 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:16.032910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-6fda102a-cbd2-4ed6-a993-429870ba2510 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:16.032910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:16.032910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:16.032910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:16.032910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:16.032910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:16.032910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:16.032910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:16.032910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:16.032910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:16.032910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:16.032910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:16.032910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:32:16.032910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:32:16.032910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:32:16.034018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:32:16.034018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:16.034018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:16.034018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:16.034018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:16.034018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:16.034018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:16.034018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:16.034018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:16.034018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:16.034018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:16.034018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:16.034018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:16.034018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:16.034018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:16.034018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:16.034018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:16.035403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:32:16.035403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:32:16.035403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:16.035403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:16.035403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 613/1228] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:32:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:32:16.041591 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f5c07-ef9e-45b1-b16f-64a4e0cb5c0f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:16.150942 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f5c07-ef9e-45b1-b16f-64a4e0cb5c0f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:16.153634 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:16.191499 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c09c01-51b5-437c-b7a2-3fcd050c7aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:16.192243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c09c01-51b5-437c-b7a2-3fcd050c7aba None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:16.192535 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c09c01-51b5-437c-b7a2-3fcd050c7aba None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:16.192814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c09c01-51b5-437c-b7a2-3fcd050c7aba None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:16.193671 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c09c01-51b5-437c-b7a2-3fcd050c7aba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:16.194034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c09c01-51b5-437c-b7a2-3fcd050c7aba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:16.196221 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c09c01-51b5-437c-b7a2-3fcd050c7aba None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:16.210092 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 616/1229] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:32:16.216908 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda102a-cbd2-4ed6-a993-429870ba2510 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:16.227931 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:16.332235 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda102a-cbd2-4ed6-a993-429870ba2510 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:16.374814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290b332-70d5-414b-ac00-1a39d347624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:16.375690 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290b332-70d5-414b-ac00-1a39d347624e None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:16.376044 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290b332-70d5-414b-ac00-1a39d347624e None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:16.376334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290b332-70d5-414b-ac00-1a39d347624e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:16.384420 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290b332-70d5-414b-ac00-1a39d347624e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:16.386064 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290b332-70d5-414b-ac00-1a39d347624e None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:16.401115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-4290b332-70d5-414b-ac00-1a39d347624e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:32:16.401115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:16.401115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:16.401115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:16.401115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:16.401115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:16.401115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:16.401115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:16.401115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:16.401115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:16.401115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:16.401115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:16.401115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:32:16.401115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:32:16.401115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:32:16.402303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:32:16.402303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:16.402303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:16.402303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:16.402303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:16.402303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:16.402303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:16.402303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:16.402303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:16.402303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:16.402303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:16.402303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:16.402303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:16.402303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:16.402303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:16.402303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:16.402303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:16.403524 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:32:16.403524 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:32:16.403524 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:32:16.403524 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:32:16.403524 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:32:16.403524 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:32:16.403524 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:32:16.403524 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:16.403524 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 614/1230] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:32:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:16.408424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c09c01-51b5-437c-b7a2-3fcd050c7aba None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:16.516673 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c09c01-51b5-437c-b7a2-3fcd050c7aba None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:16.553082 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aba7908-5d88-435a-9f9c-eeccb89d0e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:16.553766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba7908-5d88-435a-9f9c-eeccb89d0e1e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:16.554083 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba7908-5d88-435a-9f9c-eeccb89d0e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:16.554389 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba7908-5d88-435a-9f9c-eeccb89d0e1e None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:16.555435 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba7908-5d88-435a-9f9c-eeccb89d0e1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:16.555790 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba7908-5d88-435a-9f9c-eeccb89d0e1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:16.557645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aba7908-5d88-435a-9f9c-eeccb89d0e1e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:16.573536 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 617/1231] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:32:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:16.579658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290b332-70d5-414b-ac00-1a39d347624e None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:16.654398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:16.689981 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290b332-70d5-414b-ac00-1a39d347624e None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:16.735648 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892f71f-a014-4610-a582-350d2d60b6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:16.736686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892f71f-a014-4610-a582-350d2d60b6a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:16.737100 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892f71f-a014-4610-a582-350d2d60b6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:16.737418 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892f71f-a014-4610-a582-350d2d60b6a1 None admin] PATH_INFO: `/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/e98915513674460485413c2dbee87fb3/roles/539442ef092c4fcf9e1d0be045928c5a` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:16.754631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892f71f-a014-4610-a582-350d2d60b6a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d3e177b11504cb3b19d25ed5850ef12, user_id=e98915513674460485413c2dbee87fb3, role_id=539442ef092c4fcf9e1d0be045928c5a)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:16.756230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892f71f-a014-4610-a582-350d2d60b6a1 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:16.772335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 615/1232] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:32:16 2022] PUT /identity/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/e98915513674460485413c2dbee87fb3/roles/539442ef092c4fcf9e1d0be045928c5a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:32:19.146579 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d35ad-5864-4c8c-ae0b-bf8650599e0c None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:19.147089 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d35ad-5864-4c8c-ae0b-bf8650599e0c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:19.147089 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d35ad-5864-4c8c-ae0b-bf8650599e0c None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:19.149690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 618/1233] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:32:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:32:19.156034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbf261-5f0b-463d-aa9d-19290a963704 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:19.156559 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbf261-5f0b-463d-aa9d-19290a963704 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:19.156559 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dbf261-5f0b-463d-aa9d-19290a963704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:19.174754 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-29dbf261-5f0b-463d-aa9d-19290a963704 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:32:19.175941 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-29dbf261-5f0b-463d-aa9d-19290a963704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:32:19.260236 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 616/1234] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:32:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:32:19.293289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d35ad-5864-4c8c-ae0b-bf8650599e0c None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:19.327039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:19.416663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d35ad-5864-4c8c-ae0b-bf8650599e0c None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:19.459018 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd205acd-3aa9-454c-bb35-38700883cf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:19.460101 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd205acd-3aa9-454c-bb35-38700883cf32 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:19.460415 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd205acd-3aa9-454c-bb35-38700883cf32 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:19.461842 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd205acd-3aa9-454c-bb35-38700883cf32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:19.472657 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd205acd-3aa9-454c-bb35-38700883cf32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:32:19.481448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-dd205acd-3aa9-454c-bb35-38700883cf32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:32:19.481448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:19.481448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:19.481448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:19.481448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:19.481448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:19.481448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:19.481448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:19.481448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:19.481448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:19.481448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:19.481448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:19.481448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:32:19.481448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:32:19.481448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:32:19.481448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:32:19.482640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:32:19.482640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:32:19.482640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:32:19.482640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:32:19.482640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:19.482640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:19.482640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:19.482640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:19.482640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:19.482640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:19.482640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:19.482640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:19.482640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:19.482640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:19.482640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:19.482640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:19.483503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:19.483503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:19.483503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:19.483503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:19.483503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:32:19.483503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:32:19.483503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:32:19.483503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:32:19.483503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:32:19.483503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:32:19.483503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 14 19:32:19.483503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:32:19.483503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 619/1235] 10.222.0.44 () {56 vars in 1102 bytes} [Tue Jun 14 19:32:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:19.488849 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbf261-5f0b-463d-aa9d-19290a963704 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:19.540281 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:19.609629 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dbf261-5f0b-463d-aa9d-19290a963704 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:19.651227 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3489bb2-d3c8-4d5f-a569-2f6267fae717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:19.652069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3489bb2-d3c8-4d5f-a569-2f6267fae717 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:19.652363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3489bb2-d3c8-4d5f-a569-2f6267fae717 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:19.652757 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3489bb2-d3c8-4d5f-a569-2f6267fae717 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:19.653895 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3489bb2-d3c8-4d5f-a569-2f6267fae717 None admin] RBAC: Adding query filter params (name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:19.654210 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3489bb2-d3c8-4d5f-a569-2f6267fae717 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:19.655750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3489bb2-d3c8-4d5f-a569-2f6267fae717 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:19.665956 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 617/1236] 10.222.0.44 () {56 vars in 1103 bytes} [Tue Jun 14 19:32:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:19.671918 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd205acd-3aa9-454c-bb35-38700883cf32 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:19.780375 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:19.796967 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd205acd-3aa9-454c-bb35-38700883cf32 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:19.834735 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61844a-a782-4096-aabb-69f604573f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:19.835604 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61844a-a782-4096-aabb-69f604573f62 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:19.835895 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61844a-a782-4096-aabb-69f604573f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:19.836182 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61844a-a782-4096-aabb-69f604573f62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:19.849263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61844a-a782-4096-aabb-69f604573f62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:19.852228 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd61844a-a782-4096-aabb-69f604573f62 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:19.874094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-cd61844a-a782-4096-aabb-69f604573f62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:19.874094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:19.874094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:19.874094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:19.874094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:19.874094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:19.874094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:19.874094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:19.874094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:19.874094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:19.874094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:19.874094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:19.874094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:32:19.874094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:32:19.874094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:32:19.875542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:32:19.875542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:19.875542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:19.875542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:19.875542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:19.875542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:19.875542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:19.875542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:19.875542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:19.875542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:19.875542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:19.875542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:19.875542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:19.875542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:19.875542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:19.875542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:19.875542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:19.877206 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:32:19.877206 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:32:19.877206 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:19.877206 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:32:19.877206 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 620/1237] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:32:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:19.882645 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3489bb2-d3c8-4d5f-a569-2f6267fae717 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:19.993924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3489bb2-d3c8-4d5f-a569-2f6267fae717 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:20.003449 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:20.029890 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9722f0e-259c-4550-a562-d21c5b8668fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:20.030590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9722f0e-259c-4550-a562-d21c5b8668fc None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:20.030874 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9722f0e-259c-4550-a562-d21c5b8668fc None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:20.031149 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9722f0e-259c-4550-a562-d21c5b8668fc None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:20.031860 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9722f0e-259c-4550-a562-d21c5b8668fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:20.032165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9722f0e-259c-4550-a562-d21c5b8668fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:20.033542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9722f0e-259c-4550-a562-d21c5b8668fc None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:20.047167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 618/1238] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:20.052694 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61844a-a782-4096-aabb-69f604573f62 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:20.167312 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61844a-a782-4096-aabb-69f604573f62 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:20.206419 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41fbf6-1fdb-4f27-8587-023e7144475f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:20.207379 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41fbf6-1fdb-4f27-8587-023e7144475f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:20.207794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41fbf6-1fdb-4f27-8587-023e7144475f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:20.208109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41fbf6-1fdb-4f27-8587-023e7144475f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:20.211289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:20.216728 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41fbf6-1fdb-4f27-8587-023e7144475f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:20.218529 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41fbf6-1fdb-4f27-8587-023e7144475f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:20.236559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-7a41fbf6-1fdb-4f27-8587-023e7144475f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 14 19:32:20.236559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:20.236559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:20.236559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:20.236559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:20.236559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:20.236559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:20.236559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:20.236559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:20.236559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:20.236559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:20.236559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:20.236559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:32:20.236559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:32:20.236559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:32:20.236559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:32:20.244195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:20.244195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:20.244195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:32:20.244195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:32:20.244195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:32:20.244195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:32:20.244195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:20.244195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:20.244195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:20.244195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:20.244195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:20.244195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:20.244195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:20.244195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:20.244195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:20.244195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:20.244195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:20.244195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:20.245552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:20.245552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:20.245552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:32:20.245552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:32:20.245552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:32:20.245552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:32:20.245552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:32:20.245552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:32:20.245552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 14 19:32:20.245552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:32:20.245552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 621/1239] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:32:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:20.246637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9722f0e-259c-4550-a562-d21c5b8668fc None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:20.364089 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9722f0e-259c-4550-a562-d21c5b8668fc None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:20.403439 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0426b9-cb48-4df8-ad66-ac613f84a70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:20.404328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0426b9-cb48-4df8-ad66-ac613f84a70d None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:20.404446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0426b9-cb48-4df8-ad66-ac613f84a70d None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:20.404810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0426b9-cb48-4df8-ad66-ac613f84a70d None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:20.405611 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0426b9-cb48-4df8-ad66-ac613f84a70d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:20.405928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0426b9-cb48-4df8-ad66-ac613f84a70d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:20.407447 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0426b9-cb48-4df8-ad66-ac613f84a70d None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:20.433194 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 619/1240] 10.222.0.44 () {56 vars in 1143 bytes} [Tue Jun 14 19:32:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:20.434455 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41fbf6-1fdb-4f27-8587-023e7144475f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:20.546692 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41fbf6-1fdb-4f27-8587-023e7144475f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:20.590527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccc297-838e-43db-b183-bf66d5450216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:20.591476 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccc297-838e-43db-b183-bf66d5450216 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:20.591769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccc297-838e-43db-b183-bf66d5450216 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:20.592096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ccc297-838e-43db-b183-bf66d5450216 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:20.678095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:20.686951 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccc297-838e-43db-b183-bf66d5450216 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:20.688558 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ccc297-838e-43db-b183-bf66d5450216 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:20.811749 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 622/1241] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:32:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 19:32:20.818085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0426b9-cb48-4df8-ad66-ac613f84a70d None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:20.851785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:20.937754 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0426b9-cb48-4df8-ad66-ac613f84a70d None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:20.981513 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9c007-9323-4a33-ab8d-43a3cfc491f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:20.982308 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9c007-9323-4a33-ab8d-43a3cfc491f7 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:20.982592 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9c007-9323-4a33-ab8d-43a3cfc491f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:20.982869 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9c007-9323-4a33-ab8d-43a3cfc491f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:20.996910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9c007-9323-4a33-ab8d-43a3cfc491f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:20.998724 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9c007-9323-4a33-ab8d-43a3cfc491f7 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:21.020646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-53e9c007-9323-4a33-ab8d-43a3cfc491f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:21.020646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:21.020646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:21.020646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:21.020646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:21.020646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:21.020646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:21.020646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:21.020646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:21.020646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:21.020646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:21.020646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:21.020646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:32:21.020646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:32:21.020646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:32:21.021899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:32:21.021899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:21.021899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:21.021899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:21.021899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:21.021899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:21.021899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:21.021899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:21.021899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:21.021899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:21.021899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:21.021899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:21.021899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:21.021899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:21.021899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:21.021899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:21.021899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:21.023511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:32:21.023511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:32:21.023511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:21.023511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:21.023511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 620/1242] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:32:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:32:21.028600 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccc297-838e-43db-b183-bf66d5450216 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:21.133426 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:21.140714 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ccc297-838e-43db-b183-bf66d5450216 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:21.191474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756fd61-1961-4bac-a7b8-ec25eb14ddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:21.192507 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756fd61-1961-4bac-a7b8-ec25eb14ddcc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:21.192771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756fd61-1961-4bac-a7b8-ec25eb14ddcc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:21.193071 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1756fd61-1961-4bac-a7b8-ec25eb14ddcc None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:21.194125 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756fd61-1961-4bac-a7b8-ec25eb14ddcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:21.194566 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756fd61-1961-4bac-a7b8-ec25eb14ddcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:21.197723 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1756fd61-1961-4bac-a7b8-ec25eb14ddcc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:21.211772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 623/1243] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:21.218824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9c007-9323-4a33-ab8d-43a3cfc491f7 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:21.321854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:21.345971 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9c007-9323-4a33-ab8d-43a3cfc491f7 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:21.384861 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ccb0c-a5e3-4b82-8831-4313c184e14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:21.385622 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ccb0c-a5e3-4b82-8831-4313c184e14a None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:21.385927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ccb0c-a5e3-4b82-8831-4313c184e14a None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:21.386287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ccb0c-a5e3-4b82-8831-4313c184e14a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:21.393575 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ccb0c-a5e3-4b82-8831-4313c184e14a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:21.395010 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ccb0c-a5e3-4b82-8831-4313c184e14a None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:21.409160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-7a7ccb0c-a5e3-4b82-8831-4313c184e14a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:32:21.409160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:21.409160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:21.409160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:21.409160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:21.409160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:21.409160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:21.409160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:21.409160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:21.409160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:21.409160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:21.409160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:21.409160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:32:21.409160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:32:21.409160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:32:21.410573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:32:21.410573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:21.410573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:21.410573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:21.410573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:21.410573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:21.410573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:21.410573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:21.410573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:21.410573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:21.410573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:21.410573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:21.410573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:21.410573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:21.410573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:21.410573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:21.410573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:21.417124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:32:21.417124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:32:21.417124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:32:21.417124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:32:21.417124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:32:21.417124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:32:21.417124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:32:21.417124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:21.417124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 621/1244] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:32:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 14 19:32:21.417906 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756fd61-1961-4bac-a7b8-ec25eb14ddcc None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:21.524803 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1756fd61-1961-4bac-a7b8-ec25eb14ddcc None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:21.560892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c47e4-c598-41f2-ac24-dd8dc076bed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:21.561574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c47e4-c598-41f2-ac24-dd8dc076bed8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:21.561949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c47e4-c598-41f2-ac24-dd8dc076bed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:21.562210 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c47e4-c598-41f2-ac24-dd8dc076bed8 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:21.563024 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c47e4-c598-41f2-ac24-dd8dc076bed8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:21.563344 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c47e4-c598-41f2-ac24-dd8dc076bed8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:21.564813 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c47e4-c598-41f2-ac24-dd8dc076bed8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:21.577627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 624/1245] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:32:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:32:21.583873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ccb0c-a5e3-4b82-8831-4313c184e14a None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:21.706204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ccb0c-a5e3-4b82-8831-4313c184e14a None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:21.747928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4db71d-c79d-4f8b-9416-dc57cc6c8edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:21.748755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4db71d-c79d-4f8b-9416-dc57cc6c8edb None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:21.749074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4db71d-c79d-4f8b-9416-dc57cc6c8edb None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:21.749300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4db71d-c79d-4f8b-9416-dc57cc6c8edb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:21.750204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4db71d-c79d-4f8b-9416-dc57cc6c8edb None admin] RBAC: Adding query filter params (role.id=539442ef092c4fcf9e1d0be045928c5a, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=e98915513674460485413c2dbee87fb3) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:21.750478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4db71d-c79d-4f8b-9416-dc57cc6c8edb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:21.751902 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4db71d-c79d-4f8b-9416-dc57cc6c8edb None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:21.759249 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 622/1246] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:32:21 2022] GET /identity/v3/role_assignments?user.id=e98915513674460485413c2dbee87fb3&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=539442ef092c4fcf9e1d0be045928c5a => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:24.145567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46dba2-1896-4cfc-8ce2-291de6e0a216 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:24.146135 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46dba2-1896-4cfc-8ce2-291de6e0a216 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:24.146135 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46dba2-1896-4cfc-8ce2-291de6e0a216 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:24.147746 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 625/1247] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:32:24.156871 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b399bf3-bcd9-46c7-b957-541fb1eaedfb None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:24.157332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b399bf3-bcd9-46c7-b957-541fb1eaedfb None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:24.157466 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b399bf3-bcd9-46c7-b957-541fb1eaedfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:24.163236 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:24.176026 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-3b399bf3-bcd9-46c7-b957-541fb1eaedfb None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:32:24.177218 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-3b399bf3-bcd9-46c7-b957-541fb1eaedfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:32:24.251876 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 623/1248] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:32:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:32:24.278472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46dba2-1896-4cfc-8ce2-291de6e0a216 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:24.298303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:24.400531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46dba2-1896-4cfc-8ce2-291de6e0a216 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:24.437022 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16941ac2-0fe3-4cb9-8a68-071160281c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:24.437889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16941ac2-0fe3-4cb9-8a68-071160281c93 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:24.438218 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16941ac2-0fe3-4cb9-8a68-071160281c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:24.438609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16941ac2-0fe3-4cb9-8a68-071160281c93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:24.449655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16941ac2-0fe3-4cb9-8a68-071160281c93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:32:24.457642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-16941ac2-0fe3-4cb9-8a68-071160281c93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:32:24.457642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:24.457642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:24.457642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:24.457642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:24.457642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:24.457642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:24.457642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:24.457642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:24.457642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:24.457642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:24.457642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:24.457642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:32:24.457642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:32:24.457642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:32:24.457642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:32:24.458931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:32:24.458931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:32:24.458931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:32:24.458931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:32:24.458931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:24.458931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:24.458931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:24.458931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:24.458931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:24.458931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:24.458931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:24.458931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:24.458931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:24.458931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:24.458931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:24.458931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:24.460008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:24.460008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:24.460008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:24.460008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:24.460008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:32:24.460008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:32:24.460008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:32:24.460008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:32:24.460008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:32:24.460008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:32:24.460008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:32:24.460008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:32:24.460008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 626/1249] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:32:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:24.465440 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b399bf3-bcd9-46c7-b957-541fb1eaedfb None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:24.577454 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b399bf3-bcd9-46c7-b957-541fb1eaedfb None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:24.615063 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:24.625695 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506db2da-3cd0-42d3-a652-cdb55c4b0ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:24.626516 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506db2da-3cd0-42d3-a652-cdb55c4b0ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:24.626779 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506db2da-3cd0-42d3-a652-cdb55c4b0ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:24.627119 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506db2da-3cd0-42d3-a652-cdb55c4b0ed3 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:24.627963 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506db2da-3cd0-42d3-a652-cdb55c4b0ed3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:24.628298 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506db2da-3cd0-42d3-a652-cdb55c4b0ed3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:24.629821 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506db2da-3cd0-42d3-a652-cdb55c4b0ed3 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:24.640188 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 624/1250] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:32:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:24.646184 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16941ac2-0fe3-4cb9-8a68-071160281c93 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:24.735254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:24.767358 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16941ac2-0fe3-4cb9-8a68-071160281c93 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:24.807650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04630266-e727-41d9-8fa3-3626f2bbd4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:24.808460 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04630266-e727-41d9-8fa3-3626f2bbd4fa None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:24.808778 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04630266-e727-41d9-8fa3-3626f2bbd4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:24.809105 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04630266-e727-41d9-8fa3-3626f2bbd4fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:24.827764 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04630266-e727-41d9-8fa3-3626f2bbd4fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:24.829505 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04630266-e727-41d9-8fa3-3626f2bbd4fa None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:24.849186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-04630266-e727-41d9-8fa3-3626f2bbd4fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:24.849186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:24.849186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:24.849186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:24.849186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:24.849186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:24.849186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:24.849186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:24.849186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:24.849186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:24.849186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:24.849186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:24.849186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:32:24.849186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:32:24.849186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:32:24.850413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:32:24.850413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:24.850413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:24.850413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:24.850413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:24.850413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:24.850413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:24.850413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:24.850413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:24.850413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:24.850413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:24.850413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:24.850413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:24.850413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:24.850413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:24.850413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:24.850413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:24.856179 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:32:24.856179 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:32:24.856179 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:24.856179 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:32:24.856179 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 627/1251] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:32:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:24.856508 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506db2da-3cd0-42d3-a652-cdb55c4b0ed3 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:24.966230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506db2da-3cd0-42d3-a652-cdb55c4b0ed3 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:25.018937 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0930fa-0fc1-49a2-8473-67fc60dfd282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:25.019979 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0930fa-0fc1-49a2-8473-67fc60dfd282 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:25.020443 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0930fa-0fc1-49a2-8473-67fc60dfd282 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:25.020925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0930fa-0fc1-49a2-8473-67fc60dfd282 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:25.022252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0930fa-0fc1-49a2-8473-67fc60dfd282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:25.022781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0930fa-0fc1-49a2-8473-67fc60dfd282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:25.025241 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0930fa-0fc1-49a2-8473-67fc60dfd282 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:25.046670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 625/1252] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:32:25.047838 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04630266-e727-41d9-8fa3-3626f2bbd4fa None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:25.166772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04630266-e727-41d9-8fa3-3626f2bbd4fa None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:25.196975 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:25.206259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a92d5-45d4-493b-b892-596b6642dd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:25.207157 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a92d5-45d4-493b-b892-596b6642dd4d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:25.207445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a92d5-45d4-493b-b892-596b6642dd4d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:25.207752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a92d5-45d4-493b-b892-596b6642dd4d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:25.216184 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a92d5-45d4-493b-b892-596b6642dd4d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:25.217812 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a92d5-45d4-493b-b892-596b6642dd4d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:25.233615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-2f1a92d5-45d4-493b-b892-596b6642dd4d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 14 19:32:25.233615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:25.233615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:25.233615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:25.233615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:25.233615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:25.233615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:25.233615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:25.233615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:25.233615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:25.233615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:25.233615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:25.233615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:32:25.233615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:32:25.233615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:32:25.233615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:32:25.234905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:25.234905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:25.234905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:32:25.234905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:32:25.234905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:32:25.234905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:32:25.234905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:25.234905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:25.234905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:25.234905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:25.234905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:25.234905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:25.234905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:25.234905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:25.234905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:25.234905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:25.234905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:25.234905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:25.236064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:25.236064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:25.236064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:32:25.236064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:32:25.236064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:32:25.236064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:32:25.236064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:32:25.236064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:32:25.236064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 14 19:32:25.236064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:32:25.236064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 628/1253] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:32:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:25.240883 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0930fa-0fc1-49a2-8473-67fc60dfd282 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:25.309597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:25.362792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0930fa-0fc1-49a2-8473-67fc60dfd282 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:25.402815 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f5e32-0fd2-4e3c-86a2-87b5344452fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:25.403488 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f5e32-0fd2-4e3c-86a2-87b5344452fd None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:25.403773 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f5e32-0fd2-4e3c-86a2-87b5344452fd None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:25.404053 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f5e32-0fd2-4e3c-86a2-87b5344452fd None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:25.404900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f5e32-0fd2-4e3c-86a2-87b5344452fd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:25.405211 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f5e32-0fd2-4e3c-86a2-87b5344452fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:25.406678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f5e32-0fd2-4e3c-86a2-87b5344452fd None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:25.434909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 626/1254] 10.222.0.44 () {56 vars in 1143 bytes} [Tue Jun 14 19:32:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:32:25.436566 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a92d5-45d4-493b-b892-596b6642dd4d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:25.550863 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a92d5-45d4-493b-b892-596b6642dd4d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:25.595868 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972c34a-476a-470f-96ff-af1085336096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:25.596452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972c34a-476a-470f-96ff-af1085336096 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:25.596736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972c34a-476a-470f-96ff-af1085336096 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:25.597017 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972c34a-476a-470f-96ff-af1085336096 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:25.661567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:25.678215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972c34a-476a-470f-96ff-af1085336096 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:25.680414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972c34a-476a-470f-96ff-af1085336096 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:25.786973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 629/1255] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:32:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 19:32:25.793387 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f5e32-0fd2-4e3c-86a2-87b5344452fd None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:25.911635 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f5e32-0fd2-4e3c-86a2-87b5344452fd None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:25.928284 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:25.952059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c9430-e8fa-4e8f-b70e-4a8582aa70ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:25.952878 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c9430-e8fa-4e8f-b70e-4a8582aa70ee None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:25.953160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c9430-e8fa-4e8f-b70e-4a8582aa70ee None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:25.953470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c9430-e8fa-4e8f-b70e-4a8582aa70ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:25.964948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c9430-e8fa-4e8f-b70e-4a8582aa70ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:25.966472 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c9430-e8fa-4e8f-b70e-4a8582aa70ee None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:25.987800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-6b1c9430-e8fa-4e8f-b70e-4a8582aa70ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:25.987800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:25.987800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:25.987800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:25.987800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:25.987800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:25.987800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:25.987800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:25.987800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:25.987800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:25.987800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:25.987800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:25.987800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:32:25.987800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:32:25.987800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:32:25.989000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:32:25.989000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:25.989000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:25.989000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:25.989000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:25.989000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:25.989000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:25.989000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:25.989000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:25.989000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:25.989000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:25.989000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:25.989000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:25.989000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:25.989000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:25.989000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:25.989000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:25.990126 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:32:25.990126 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:32:25.990126 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:25.990126 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:25.990126 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 627/1256] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:25.997468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972c34a-476a-470f-96ff-af1085336096 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:26.089880 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:26.103449 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972c34a-476a-470f-96ff-af1085336096 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:26.139124 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2859825-c214-4561-a75f-36e67348b93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:26.139797 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2859825-c214-4561-a75f-36e67348b93f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:26.140084 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2859825-c214-4561-a75f-36e67348b93f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:26.140367 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2859825-c214-4561-a75f-36e67348b93f None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:26.141095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2859825-c214-4561-a75f-36e67348b93f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:26.141428 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2859825-c214-4561-a75f-36e67348b93f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:26.142823 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2859825-c214-4561-a75f-36e67348b93f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:26.155701 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 630/1257] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:26.161822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c9430-e8fa-4e8f-b70e-4a8582aa70ee None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:26.269017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c9430-e8fa-4e8f-b70e-4a8582aa70ee None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:26.306039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280fe07-ed25-4394-bcf8-3892d841faa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:26.306845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280fe07-ed25-4394-bcf8-3892d841faa6 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:26.307132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280fe07-ed25-4394-bcf8-3892d841faa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:26.307414 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280fe07-ed25-4394-bcf8-3892d841faa6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:26.314858 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280fe07-ed25-4394-bcf8-3892d841faa6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:26.316303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280fe07-ed25-4394-bcf8-3892d841faa6 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:26.330475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-9280fe07-ed25-4394-bcf8-3892d841faa6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:32:26.330475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:26.330475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:26.330475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:26.330475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:26.330475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:26.330475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:26.330475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:26.330475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:26.330475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:26.330475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:26.330475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:26.330475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:32:26.330475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:32:26.330475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:32:26.331538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:32:26.331538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:26.331538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:26.331538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:26.331538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:26.331538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:26.331538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:26.331538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:26.331538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:26.331538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:26.331538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:26.331538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:26.331538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:26.331538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:26.331538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:26.331538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:26.331538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:26.332540 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:32:26.332540 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:32:26.332540 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:32:26.332540 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:32:26.332540 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:32:26.332540 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:32:26.332540 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:32:26.332540 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:26.332540 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 628/1258] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:32:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:26.338744 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2859825-c214-4561-a75f-36e67348b93f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:26.441941 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2859825-c214-4561-a75f-36e67348b93f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:26.475307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739f408-e223-4922-844b-0557692172b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:26.475969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739f408-e223-4922-844b-0557692172b0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:26.476253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739f408-e223-4922-844b-0557692172b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:26.476508 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739f408-e223-4922-844b-0557692172b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:26.477285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739f408-e223-4922-844b-0557692172b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:26.477622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739f408-e223-4922-844b-0557692172b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:26.479053 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739f408-e223-4922-844b-0557692172b0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:26.491041 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 631/1259] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:32:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:26.498295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280fe07-ed25-4394-bcf8-3892d841faa6 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:26.525328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:26.608787 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280fe07-ed25-4394-bcf8-3892d841faa6 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:26.645196 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd32e80-16e8-461e-a79f-c497ca915646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:26.646715 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd32e80-16e8-461e-a79f-c497ca915646 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:26.646715 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd32e80-16e8-461e-a79f-c497ca915646 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:26.646715 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd32e80-16e8-461e-a79f-c497ca915646 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:26.647249 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd32e80-16e8-461e-a79f-c497ca915646 None admin] RBAC: Adding query filter params (role.id=1e2bb0d759694428ada2b52285de933b, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=e98915513674460485413c2dbee87fb3) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:26.647593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd32e80-16e8-461e-a79f-c497ca915646 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:26.649096 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd32e80-16e8-461e-a79f-c497ca915646 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:26.654547 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 629/1260] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:32:26 2022] GET /identity/v3/role_assignments?user.id=e98915513674460485413c2dbee87fb3&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=1e2bb0d759694428ada2b52285de933b => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:28.754923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b6b86-c3ce-498b-bcd0-9859471091d6 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:28.755467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b6b86-c3ce-498b-bcd0-9859471091d6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:28.755467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b6b86-c3ce-498b-bcd0-9859471091d6 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:28.757488 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 632/1261] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:32:28.764017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308118f-9f18-4b00-bf05-037e823177d2 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:28.764504 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308118f-9f18-4b00-bf05-037e823177d2 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:28.764667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308118f-9f18-4b00-bf05-037e823177d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:28.786503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-1308118f-9f18-4b00-bf05-037e823177d2 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:32:28.787727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-1308118f-9f18-4b00-bf05-037e823177d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:32:28.865849 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 630/1262] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:32:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:32:28.889142 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b6b86-c3ce-498b-bcd0-9859471091d6 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:28.899772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:28.987476 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b6b86-c3ce-498b-bcd0-9859471091d6 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:29.022114 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69eabb-7246-4443-9fd5-49c19bb9d063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:29.023385 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69eabb-7246-4443-9fd5-49c19bb9d063 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:29.023904 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69eabb-7246-4443-9fd5-49c19bb9d063 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:29.024414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e69eabb-7246-4443-9fd5-49c19bb9d063 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:29.041408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e69eabb-7246-4443-9fd5-49c19bb9d063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:32:29.049025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-1e69eabb-7246-4443-9fd5-49c19bb9d063 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:32:29.049025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:29.049025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:29.049025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:29.049025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:29.049025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:29.049025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:29.049025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:29.049025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:29.049025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:29.049025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:29.049025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:29.049025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:32:29.049025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:32:29.049025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:32:29.049025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:32:29.050155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:32:29.050155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:32:29.050155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:32:29.050155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:32:29.050155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:29.050155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:29.050155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:29.050155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:29.050155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:29.050155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:29.050155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:29.050155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:29.050155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:29.050155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:29.050155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:29.050155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:29.051238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:29.051238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:29.051238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:29.051238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:29.051238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:32:29.051238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:32:29.051238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:32:29.051238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:32:29.051238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:32:29.051238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:32:29.051238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:32:29.051238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:32:29.051238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 633/1263] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:32:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:29.056951 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308118f-9f18-4b00-bf05-037e823177d2 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:29.076534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:29.155974 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308118f-9f18-4b00-bf05-037e823177d2 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:29.189096 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdc7f0-8c41-44fe-b433-0ba076bef825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:29.189806 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdc7f0-8c41-44fe-b433-0ba076bef825 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:29.190091 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdc7f0-8c41-44fe-b433-0ba076bef825 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:29.190413 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdc7f0-8c41-44fe-b433-0ba076bef825 None admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:29.191157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdc7f0-8c41-44fe-b433-0ba076bef825 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:29.191462 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdc7f0-8c41-44fe-b433-0ba076bef825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:29.192819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdc7f0-8c41-44fe-b433-0ba076bef825 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:29.201366 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 631/1264] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:32:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:29.207042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69eabb-7246-4443-9fd5-49c19bb9d063 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:29.272349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:29.306173 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e69eabb-7246-4443-9fd5-49c19bb9d063 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:29.338784 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3eeea6-e764-4abc-a871-e06ba8e1b770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:29.339564 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eeea6-e764-4abc-a871-e06ba8e1b770 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:29.339850 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eeea6-e764-4abc-a871-e06ba8e1b770 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:29.340129 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eeea6-e764-4abc-a871-e06ba8e1b770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:29.350604 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3eeea6-e764-4abc-a871-e06ba8e1b770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:29.352043 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3eeea6-e764-4abc-a871-e06ba8e1b770 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:29.369609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-4f3eeea6-e764-4abc-a871-e06ba8e1b770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:29.369609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:29.369609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:29.369609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:29.369609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:29.369609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:29.369609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:29.369609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:29.369609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:29.369609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:29.369609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:29.369609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:29.369609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:32:29.369609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:32:29.369609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:32:29.370689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:32:29.370689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:29.370689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:29.370689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:29.370689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:29.370689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:29.370689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:29.370689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:29.370689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:29.370689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:29.370689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:29.370689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:29.370689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:29.370689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:29.370689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:29.370689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:29.370689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:29.371646 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:32:29.371646 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:32:29.371646 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:29.371646 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:32:29.371646 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 634/1265] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:32:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:29.376490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdc7f0-8c41-44fe-b433-0ba076bef825 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:29.456695 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:29.475388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdc7f0-8c41-44fe-b433-0ba076bef825 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:29.509225 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013502c-a803-43a9-aae0-e15241efd816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:29.509904 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013502c-a803-43a9-aae0-e15241efd816 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:29.510191 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013502c-a803-43a9-aae0-e15241efd816 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:29.510472 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013502c-a803-43a9-aae0-e15241efd816 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:29.511187 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013502c-a803-43a9-aae0-e15241efd816 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:29.511498 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013502c-a803-43a9-aae0-e15241efd816 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:29.512853 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013502c-a803-43a9-aae0-e15241efd816 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:29.524437 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 632/1266] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:29.530116 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3eeea6-e764-4abc-a871-e06ba8e1b770 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:29.642680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3eeea6-e764-4abc-a871-e06ba8e1b770 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:29.664056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:29.678290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41fa8d-8abd-4654-869f-039e28824ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:29.679791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41fa8d-8abd-4654-869f-039e28824ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:29.680071 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41fa8d-8abd-4654-869f-039e28824ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:29.680355 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41fa8d-8abd-4654-869f-039e28824ff1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:29.687824 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41fa8d-8abd-4654-869f-039e28824ff1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:29.689285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb41fa8d-8abd-4654-869f-039e28824ff1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:29.703788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-bb41fa8d-8abd-4654-869f-039e28824ff1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 14 19:32:29.703788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:29.703788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:29.703788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:29.703788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:29.703788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:29.703788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:29.703788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:29.703788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:29.703788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:29.703788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:29.703788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:29.703788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:32:29.703788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:32:29.703788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:32:29.703788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:32:29.704966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:29.704966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:29.704966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:32:29.704966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:32:29.704966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:32:29.704966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:32:29.704966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:29.704966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:29.704966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:29.704966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:29.704966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:29.704966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:29.704966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:29.704966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:29.704966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:29.704966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:29.704966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:29.704966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:29.706153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:29.706153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:29.706153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:32:29.706153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:32:29.706153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:32:29.706153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:32:29.706153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:32:29.706153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:32:29.706153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 14 19:32:29.706153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:32:29.706153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 635/1267] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:32:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:29.710838 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013502c-a803-43a9-aae0-e15241efd816 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:29.808881 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013502c-a803-43a9-aae0-e15241efd816 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:29.841851 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc84c2-f251-4c50-8cbc-1e9d97b7181e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:29.842515 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc84c2-f251-4c50-8cbc-1e9d97b7181e None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:29.842800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc84c2-f251-4c50-8cbc-1e9d97b7181e None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:29.843080 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc84c2-f251-4c50-8cbc-1e9d97b7181e None admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:29.843915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc84c2-f251-4c50-8cbc-1e9d97b7181e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:29.844225 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc84c2-f251-4c50-8cbc-1e9d97b7181e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:29.845676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc84c2-f251-4c50-8cbc-1e9d97b7181e None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:29.854684 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:29.863062 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 633/1268] 10.222.0.44 () {56 vars in 1143 bytes} [Tue Jun 14 19:32:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:29.870000 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41fa8d-8abd-4654-869f-039e28824ff1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:29.968678 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41fa8d-8abd-4654-869f-039e28824ff1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:30.001108 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877ed81-283a-4ddd-a99b-457b7f5e4439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:30.001912 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877ed81-283a-4ddd-a99b-457b7f5e4439 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:30.002200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877ed81-283a-4ddd-a99b-457b7f5e4439 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:30.002480 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877ed81-283a-4ddd-a99b-457b7f5e4439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:30.013249 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877ed81-283a-4ddd-a99b-457b7f5e4439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:30.014727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877ed81-283a-4ddd-a99b-457b7f5e4439 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:30.031854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-f877ed81-283a-4ddd-a99b-457b7f5e4439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:30.031854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:30.031854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:30.031854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:30.031854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:30.031854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:30.031854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:30.031854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:30.031854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:30.031854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:30.031854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:30.031854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:30.031854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:32:30.031854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:32:30.031854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:32:30.032865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:32:30.032865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:30.032865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:30.032865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:30.032865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:30.032865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:30.032865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:30.032865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:30.032865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:30.032865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:30.032865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:30.032865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:30.032865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:30.032865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:30.032865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:30.032865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:30.032865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:30.034388 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:32:30.034388 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:32:30.034388 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:30.034388 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:32:30.034388 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 636/1269] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:32:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:30.038836 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc84c2-f251-4c50-8cbc-1e9d97b7181e None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:30.134662 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc84c2-f251-4c50-8cbc-1e9d97b7181e None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:30.166850 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21660e6e-48b4-4cf6-8f12-2efc27125eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:30.167488 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21660e6e-48b4-4cf6-8f12-2efc27125eda None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:30.167768 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21660e6e-48b4-4cf6-8f12-2efc27125eda None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:30.168041 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21660e6e-48b4-4cf6-8f12-2efc27125eda None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:30.168748 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21660e6e-48b4-4cf6-8f12-2efc27125eda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:30.169051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21660e6e-48b4-4cf6-8f12-2efc27125eda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:30.170434 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21660e6e-48b4-4cf6-8f12-2efc27125eda None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:30.181799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 634/1270] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:30.187304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877ed81-283a-4ddd-a99b-457b7f5e4439 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:30.218234 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:30.284681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877ed81-283a-4ddd-a99b-457b7f5e4439 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:30.316909 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0484d-a6e3-4888-bcda-97c6f7478d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:30.317704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0484d-a6e3-4888-bcda-97c6f7478d18 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:30.317992 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0484d-a6e3-4888-bcda-97c6f7478d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:30.318270 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0484d-a6e3-4888-bcda-97c6f7478d18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:30.324890 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a0484d-a6e3-4888-bcda-97c6f7478d18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:30.326359 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a0484d-a6e3-4888-bcda-97c6f7478d18 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:30.340652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-a6a0484d-a6e3-4888-bcda-97c6f7478d18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:32:30.340652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:30.340652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:30.340652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:30.340652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:30.340652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:30.340652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:30.340652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:30.340652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:30.340652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:30.340652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:30.340652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:30.340652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:32:30.340652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:32:30.340652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:32:30.341690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:32:30.341690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:30.341690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:30.341690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:30.341690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:30.341690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:30.341690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:30.341690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:30.341690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:30.341690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:30.341690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:30.341690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:30.341690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:30.341690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:30.341690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:30.341690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:30.341690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:30.342791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:32:30.342791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:32:30.342791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:32:30.342791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:32:30.342791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:32:30.342791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:32:30.342791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:32:30.342791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:32:30.342791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 637/1271] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:32:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:30.347481 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21660e6e-48b4-4cf6-8f12-2efc27125eda None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:30.406625 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:30.448963 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21660e6e-48b4-4cf6-8f12-2efc27125eda None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:30.481182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0460d2-d3e1-4777-a5a5-99a3635e2e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:30.481852 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0460d2-d3e1-4777-a5a5-99a3635e2e5b None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:30.482137 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0460d2-d3e1-4777-a5a5-99a3635e2e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:30.482417 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0460d2-d3e1-4777-a5a5-99a3635e2e5b None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:30.483194 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0460d2-d3e1-4777-a5a5-99a3635e2e5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:30.483504 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0460d2-d3e1-4777-a5a5-99a3635e2e5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:30.484913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0460d2-d3e1-4777-a5a5-99a3635e2e5b None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:30.496737 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 635/1272] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:32:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:30.502508 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0484d-a6e3-4888-bcda-97c6f7478d18 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:30.599031 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:30.608859 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0484d-a6e3-4888-bcda-97c6f7478d18 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:30.641928 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603f7e1-7444-4a06-9aa7-edf7dd792ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:30.642803 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603f7e1-7444-4a06-9aa7-edf7dd792ea5 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:30.643091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603f7e1-7444-4a06-9aa7-edf7dd792ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:30.643365 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603f7e1-7444-4a06-9aa7-edf7dd792ea5 None admin] PATH_INFO: `/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/e98915513674460485413c2dbee87fb3/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:30.645327 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603f7e1-7444-4a06-9aa7-edf7dd792ea5 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d3e177b11504cb3b19d25ed5850ef12, user_id=e98915513674460485413c2dbee87fb3, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:30.647073 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603f7e1-7444-4a06-9aa7-edf7dd792ea5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:30.660339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 638/1273] 10.222.0.44 () {58 vars in 1439 bytes} [Tue Jun 14 19:32:30 2022] PUT /identity/v3/projects/6d3e177b11504cb3b19d25ed5850ef12/users/e98915513674460485413c2dbee87fb3/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:32:32.729078 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7eee17-9287-4501-8780-dc1da5fcf2fc None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:32.729628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7eee17-9287-4501-8780-dc1da5fcf2fc None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:32.729757 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7eee17-9287-4501-8780-dc1da5fcf2fc None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:32.731049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 636/1274] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:32:32.735996 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad28f7-5760-4475-8cf3-b5d7e432d598 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:32.736379 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad28f7-5760-4475-8cf3-b5d7e432d598 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:32.736548 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad28f7-5760-4475-8cf3-b5d7e432d598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:32.753349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-39ad28f7-5760-4475-8cf3-b5d7e432d598 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:32:32.754545 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-39ad28f7-5760-4475-8cf3-b5d7e432d598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:32:32.823323 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 639/1275] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:32:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:32:32.851493 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7eee17-9287-4501-8780-dc1da5fcf2fc None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:32.952094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7eee17-9287-4501-8780-dc1da5fcf2fc None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:32.968520 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:32.985522 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb6303-71f1-45ac-a4d6-73889b4caf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:32.986242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb6303-71f1-45ac-a4d6-73889b4caf73 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:32.986525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb6303-71f1-45ac-a4d6-73889b4caf73 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:32.986801 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb6303-71f1-45ac-a4d6-73889b4caf73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:32.997263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb6303-71f1-45ac-a4d6-73889b4caf73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 14 19:32:33.004810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-5acb6303-71f1-45ac-a4d6-73889b4caf73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:32:33.004810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:33.004810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:33.004810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:33.004810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:33.004810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:33.004810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:33.004810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:33.004810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:33.004810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:33.004810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:33.004810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:33.004810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 14 19:32:33.004810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 14 19:32:33.004810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 14 19:32:33.004810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 14 19:32:33.006001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 14 19:32:33.006001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 14 19:32:33.006001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 14 19:32:33.006001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 14 19:32:33.006001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:33.006001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:33.006001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:33.006001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:33.006001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:33.006001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:33.006001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:33.006001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:33.006001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:33.006001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:33.006001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:33.006001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:33.007043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:33.007043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:33.007043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:33.007043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:33.007043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 14 19:32:33.007043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 14 19:32:33.007043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 14 19:32:33.007043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 14 19:32:33.007043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 14 19:32:33.007043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 14 19:32:33.007043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 14 19:32:33.007043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:33.007043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 637/1276] 10.222.0.44 () {56 vars in 1096 bytes} [Tue Jun 14 19:32:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:33.012217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad28f7-5760-4475-8cf3-b5d7e432d598 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:33.090936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:33.109708 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad28f7-5760-4475-8cf3-b5d7e432d598 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:33.141894 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba48012-0ab1-48c8-bdb0-c104a4a4a9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:33.142550 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba48012-0ab1-48c8-bdb0-c104a4a4a9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:33.142835 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba48012-0ab1-48c8-bdb0-c104a4a4a9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:33.143112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba48012-0ab1-48c8-bdb0-c104a4a4a9c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:33.143849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba48012-0ab1-48c8-bdb0-c104a4a4a9c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:33.144155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba48012-0ab1-48c8-bdb0-c104a4a4a9c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:33.145542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba48012-0ab1-48c8-bdb0-c104a4a4a9c5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:33.153890 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 640/1277] 10.222.0.44 () {56 vars in 1099 bytes} [Tue Jun 14 19:32:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:33.159803 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb6303-71f1-45ac-a4d6-73889b4caf73 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:33.256650 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb6303-71f1-45ac-a4d6-73889b4caf73 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:33.289731 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728c93d-0e75-4dd8-8eb7-48bc072085eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:33.290502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728c93d-0e75-4dd8-8eb7-48bc072085eb None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:33.290784 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728c93d-0e75-4dd8-8eb7-48bc072085eb None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:33.291063 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728c93d-0e75-4dd8-8eb7-48bc072085eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:33.301209 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728c93d-0e75-4dd8-8eb7-48bc072085eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:33.302663 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728c93d-0e75-4dd8-8eb7-48bc072085eb None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:33.319587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-c728c93d-0e75-4dd8-8eb7-48bc072085eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:33.319587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:33.319587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:33.319587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:33.319587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:33.319587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:33.319587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:33.319587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:33.319587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:33.319587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:33.319587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:33.319587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:33.319587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:32:33.319587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:32:33.319587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:32:33.320631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:32:33.320631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:33.320631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:33.320631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:33.320631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:33.320631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:33.320631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:33.320631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:33.320631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:33.320631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:33.320631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:33.320631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:33.320631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:33.320631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:33.320631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:33.320631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:33.320631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:33.321598 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:32:33.321598 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:32:33.321598 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:33.321598 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:33.321598 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 638/1278] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:32:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:33.326712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba48012-0ab1-48c8-bdb0-c104a4a4a9c5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:33.424343 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba48012-0ab1-48c8-bdb0-c104a4a4a9c5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:33.456406 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191ddb3-71fe-42a3-97f2-8ce920456b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:33.457044 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191ddb3-71fe-42a3-97f2-8ce920456b4d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:33.457324 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191ddb3-71fe-42a3-97f2-8ce920456b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:33.457632 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191ddb3-71fe-42a3-97f2-8ce920456b4d None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:33.458339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191ddb3-71fe-42a3-97f2-8ce920456b4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:33.458642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191ddb3-71fe-42a3-97f2-8ce920456b4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:33.460734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5191ddb3-71fe-42a3-97f2-8ce920456b4d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:33.472021 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 641/1279] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:33.478288 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728c93d-0e75-4dd8-8eb7-48bc072085eb None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:33.508880 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:33.579528 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728c93d-0e75-4dd8-8eb7-48bc072085eb None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:33.617647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d42d89-e3d2-4dd7-9b24-d36bb02c37d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:33.618648 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d42d89-e3d2-4dd7-9b24-d36bb02c37d8 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:33.619011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d42d89-e3d2-4dd7-9b24-d36bb02c37d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:33.619387 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d42d89-e3d2-4dd7-9b24-d36bb02c37d8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:33.629153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d42d89-e3d2-4dd7-9b24-d36bb02c37d8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:33.630945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d42d89-e3d2-4dd7-9b24-d36bb02c37d8 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:33.646781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-d5d42d89-e3d2-4dd7-9b24-d36bb02c37d8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 14 19:32:33.646781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:33.646781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:33.646781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:33.646781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:33.646781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:33.646781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:33.646781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:33.646781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:33.646781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:33.646781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:33.646781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:33.646781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 14 19:32:33.646781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 14 19:32:33.646781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 14 19:32:33.646781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 14 19:32:33.648975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:33.648975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:33.648975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 14 19:32:33.648975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:32:33.648975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 14 19:32:33.648975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 14 19:32:33.648975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:33.648975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:33.648975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:33.648975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:33.648975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:33.648975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:33.648975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:33.648975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:33.648975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:33.648975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:33.648975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:33.648975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:33.650059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:33.650059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:33.650059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 14 19:32:33.650059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 14 19:32:33.650059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 14 19:32:33.650059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 14 19:32:33.650059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 14 19:32:33.650059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 14 19:32:33.650059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 14 19:32:33.650059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:33.650059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 639/1280] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:32:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:33.654469 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191ddb3-71fe-42a3-97f2-8ce920456b4d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:33.658264 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:33.752305 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191ddb3-71fe-42a3-97f2-8ce920456b4d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:33.785659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28555ffc-7840-406e-9172-c700bb2cd0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:33.786257 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28555ffc-7840-406e-9172-c700bb2cd0bc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:33.786543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28555ffc-7840-406e-9172-c700bb2cd0bc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:33.786818 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28555ffc-7840-406e-9172-c700bb2cd0bc None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:33.787768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28555ffc-7840-406e-9172-c700bb2cd0bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:33.787993 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28555ffc-7840-406e-9172-c700bb2cd0bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:33.789584 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28555ffc-7840-406e-9172-c700bb2cd0bc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:33.806324 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 642/1281] 10.222.0.44 () {56 vars in 1143 bytes} [Tue Jun 14 19:32:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:33.812167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d42d89-e3d2-4dd7-9b24-d36bb02c37d8 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:33.901344 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:33.911439 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d42d89-e3d2-4dd7-9b24-d36bb02c37d8 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:33.944471 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cb072-3134-431b-9d35-3ca5e2e2369d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:33.945276 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cb072-3134-431b-9d35-3ca5e2e2369d None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:33.945589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cb072-3134-431b-9d35-3ca5e2e2369d None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:33.945869 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27cb072-3134-431b-9d35-3ca5e2e2369d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:34.011489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27cb072-3134-431b-9d35-3ca5e2e2369d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:34.012952 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27cb072-3134-431b-9d35-3ca5e2e2369d None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:34.096733 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:34.106827 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 640/1282] 10.222.0.44 () {58 vars in 1282 bytes} [Tue Jun 14 19:32:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 14 19:32:34.112726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28555ffc-7840-406e-9172-c700bb2cd0bc None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:34.174664 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:34.211438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28555ffc-7840-406e-9172-c700bb2cd0bc None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:34.244514 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0aa20d-5f21-4249-87d5-9effb9af2fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:34.245291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0aa20d-5f21-4249-87d5-9effb9af2fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:34.245623 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0aa20d-5f21-4249-87d5-9effb9af2fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:34.245899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0aa20d-5f21-4249-87d5-9effb9af2fd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:34.255492 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0aa20d-5f21-4249-87d5-9effb9af2fd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:34.257431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0aa20d-5f21-4249-87d5-9effb9af2fd9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:34.274433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-7e0aa20d-5f21-4249-87d5-9effb9af2fd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:34.274433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:34.274433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:34.274433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:34.274433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:34.274433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:34.274433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:34.274433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:34.274433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:34.274433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:34.274433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:34.274433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:34.274433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 14 19:32:34.274433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 14 19:32:34.274433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 14 19:32:34.275527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 14 19:32:34.275527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:34.275527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:34.275527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:34.275527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:34.275527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:34.275527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:34.275527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:34.275527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:34.275527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:34.275527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:34.275527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:34.275527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:34.275527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:34.275527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:34.275527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:34.275527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:34.276471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 14 19:32:34.276471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 14 19:32:34.276471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 14 19:32:34.276471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:32:34.276471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 643/1283] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:32:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:34.281257 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cb072-3134-431b-9d35-3ca5e2e2369d None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:34.376431 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27cb072-3134-431b-9d35-3ca5e2e2369d None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:34.408147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c1b9a-1b29-43e8-8053-f1df8d9d9e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:34.408784 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c1b9a-1b29-43e8-8053-f1df8d9d9e36 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:34.409316 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c1b9a-1b29-43e8-8053-f1df8d9d9e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:34.409619 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c1b9a-1b29-43e8-8053-f1df8d9d9e36 None admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:34.410324 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c1b9a-1b29-43e8-8053-f1df8d9d9e36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:34.410627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c1b9a-1b29-43e8-8053-f1df8d9d9e36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:34.411967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c1b9a-1b29-43e8-8053-f1df8d9d9e36 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:34.423230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 641/1284] 10.222.0.44 () {56 vars in 1109 bytes} [Tue Jun 14 19:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:34.429368 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0aa20d-5f21-4249-87d5-9effb9af2fd9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:34.524887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0aa20d-5f21-4249-87d5-9effb9af2fd9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:34.539675 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:34.559536 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc22370-8dc4-4490-ac7d-3611b959898f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:34.560502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc22370-8dc4-4490-ac7d-3611b959898f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:34.560910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc22370-8dc4-4490-ac7d-3611b959898f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:34.561303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc22370-8dc4-4490-ac7d-3611b959898f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:34.569930 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc22370-8dc4-4490-ac7d-3611b959898f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:34.571840 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc22370-8dc4-4490-ac7d-3611b959898f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:34.589923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-ecc22370-8dc4-4490-ac7d-3611b959898f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:32:34.589923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:34.589923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:34.589923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:34.589923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:34.589923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:34.589923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:34.589923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:34.589923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:34.589923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:34.589923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:34.589923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:34.589923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 14 19:32:34.589923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 14 19:32:34.589923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 14 19:32:34.591047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 14 19:32:34.591047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:34.591047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:34.591047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:34.591047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:34.591047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:34.591047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:34.591047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:34.591047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:34.591047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:34.591047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:34.591047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:34.591047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:34.591047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:34.591047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:34.591047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:34.591047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:34.592243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 14 19:32:34.592243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 14 19:32:34.592243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 14 19:32:34.592243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 14 19:32:34.592243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 14 19:32:34.592243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 14 19:32:34.592243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 14 19:32:34.592243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jun 14 19:32:34.592243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 644/1285] 10.222.0.44 () {56 vars in 1111 bytes} [Tue Jun 14 19:32:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:34.598065 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c1b9a-1b29-43e8-8053-f1df8d9d9e36 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:34.646740 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:34.696301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c1b9a-1b29-43e8-8053-f1df8d9d9e36 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:34.727709 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb410aaf-db24-452a-a3fd-49c5449a6e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:34.728344 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb410aaf-db24-452a-a3fd-49c5449a6e43 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:34.728622 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb410aaf-db24-452a-a3fd-49c5449a6e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:34.728895 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb410aaf-db24-452a-a3fd-49c5449a6e43 None admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:34.729697 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb410aaf-db24-452a-a3fd-49c5449a6e43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:34.730003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb410aaf-db24-452a-a3fd-49c5449a6e43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:34.731412 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb410aaf-db24-452a-a3fd-49c5449a6e43 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:34.743621 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 642/1286] 10.222.0.44 () {56 vars in 1148 bytes} [Tue Jun 14 19:32:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:34.749565 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc22370-8dc4-4490-ac7d-3611b959898f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:34.856413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc22370-8dc4-4490-ac7d-3611b959898f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:34.888949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d340cc0-d83f-48a7-a1ea-664691d2fdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:34.889619 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d340cc0-d83f-48a7-a1ea-664691d2fdd6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:34.889902 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d340cc0-d83f-48a7-a1ea-664691d2fdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:34.890176 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d340cc0-d83f-48a7-a1ea-664691d2fdd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:34.890990 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d340cc0-d83f-48a7-a1ea-664691d2fdd6 None admin] RBAC: Adding query filter params (role.id=1e2bb0d759694428ada2b52285de933b, scope.project.id=6d3e177b11504cb3b19d25ed5850ef12, user.id=e98915513674460485413c2dbee87fb3) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:34.891297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d340cc0-d83f-48a7-a1ea-664691d2fdd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:34.892714 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d340cc0-d83f-48a7-a1ea-664691d2fdd6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:34.898866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 645/1287] 10.222.0.44 () {56 vars in 1374 bytes} [Tue Jun 14 19:32:34 2022] GET /identity/v3/role_assignments?user.id=e98915513674460485413c2dbee87fb3&scope.project.id=6d3e177b11504cb3b19d25ed5850ef12&role.id=1e2bb0d759694428ada2b52285de933b => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:37.001492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140879f-e810-4e79-a706-4b96f025b7dd None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:37.002018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140879f-e810-4e79-a706-4b96f025b7dd None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:37.002127 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140879f-e810-4e79-a706-4b96f025b7dd None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:37.003432 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 643/1288] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:32:37.008989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecd3ba-7c44-4265-a98d-165858bd1752 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:37.009402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecd3ba-7c44-4265-a98d-165858bd1752 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:37.009573 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecd3ba-7c44-4265-a98d-165858bd1752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:37.025716 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b5ecd3ba-7c44-4265-a98d-165858bd1752 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:32:37.026877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b5ecd3ba-7c44-4265-a98d-165858bd1752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:32:37.055818 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:37.092942 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 646/1289] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:32:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:32:37.116252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140879f-e810-4e79-a706-4b96f025b7dd None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:37.215045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140879f-e810-4e79-a706-4b96f025b7dd None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:37.225949 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:37.250201 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50aabf-5419-4224-9819-9d1bb04d6a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:37.250987 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50aabf-5419-4224-9819-9d1bb04d6a21 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:37.251273 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50aabf-5419-4224-9819-9d1bb04d6a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:37.251552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50aabf-5419-4224-9819-9d1bb04d6a21 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:37.252201 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50aabf-5419-4224-9819-9d1bb04d6a21 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:37.253607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb50aabf-5419-4224-9819-9d1bb04d6a21 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:37.265468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-cb50aabf-5419-4224-9819-9d1bb04d6a21 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 19:32:37.265468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:37.265468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:32:37.265468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:32:37.265468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:32:37.265468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:32:37.265468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:32:37.265468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:32:37.265468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 19:32:37.265468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:37.265468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:32:37.265468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:37.265468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:37.265468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:37.265468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:37.265468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:37.265468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:37.266654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:37.266654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:37.266654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:37.266654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:37.266654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:37.266654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:37.266654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:32:37.266654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:32:37.266654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:32:37.266654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:32:37.266654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:37.266654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:37.266654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:37.266654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:37.266654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:37.266654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:37.267906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:37.267906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:37.267906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:37.267906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:37.267906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:37.267906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:37.267906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:37.267906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:37.267906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:37.267906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:37.267906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:32:37.267906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:32:37.267906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 19:32:37.267906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:37.267906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 644/1290] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jun 14 19:32:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:37.272516 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecd3ba-7c44-4265-a98d-165858bd1752 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:37.369653 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecd3ba-7c44-4265-a98d-165858bd1752 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:37.406140 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638b1e4-8a8e-40ab-a37c-a75f226675ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:37.406800 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638b1e4-8a8e-40ab-a37c-a75f226675ed None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:37.407082 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638b1e4-8a8e-40ab-a37c-a75f226675ed None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:37.407353 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638b1e4-8a8e-40ab-a37c-a75f226675ed None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:37.408056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638b1e4-8a8e-40ab-a37c-a75f226675ed None admin] RBAC: Adding query filter params (name=placement) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:37.408359 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638b1e4-8a8e-40ab-a37c-a75f226675ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:37.410006 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638b1e4-8a8e-40ab-a37c-a75f226675ed None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:37.415853 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 647/1291] 10.222.0.44 () {56 vars in 1116 bytes} [Tue Jun 14 19:32:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:37.421661 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50aabf-5419-4224-9819-9d1bb04d6a21 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:37.518715 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50aabf-5419-4224-9819-9d1bb04d6a21 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:37.551948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1d28f-6565-4efc-8694-ce6afc0caa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:37.552595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1d28f-6565-4efc-8694-ce6afc0caa31 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:37.552883 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1d28f-6565-4efc-8694-ce6afc0caa31 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:37.553193 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1d28f-6565-4efc-8694-ce6afc0caa31 None admin] PATH_INFO: `/v3/services` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:37.554018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1d28f-6565-4efc-8694-ce6afc0caa31 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:37.554326 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1d28f-6565-4efc-8694-ce6afc0caa31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:37.555681 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1d28f-6565-4efc-8694-ce6afc0caa31 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:37.560095 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 645/1292] 10.222.0.44 () {56 vars in 1116 bytes} [Tue Jun 14 19:32:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:39.695159 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4810b-13ed-4486-8481-568ee1444b5e None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:39.695696 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4810b-13ed-4486-8481-568ee1444b5e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:39.695696 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4810b-13ed-4486-8481-568ee1444b5e None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:39.697076 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 648/1293] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:32:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:32:39.702089 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e50bd-8419-4d5e-be23-4fea5c3fa868 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:39.702509 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e50bd-8419-4d5e-be23-4fea5c3fa868 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:39.702657 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e50bd-8419-4d5e-be23-4fea5c3fa868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:39.720485 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-672e50bd-8419-4d5e-be23-4fea5c3fa868 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:32:39.721690 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-672e50bd-8419-4d5e-be23-4fea5c3fa868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:32:39.750014 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:39.787893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 646/1294] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:32:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:32:39.811016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4810b-13ed-4486-8481-568ee1444b5e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:39.841496 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:39.912016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4810b-13ed-4486-8481-568ee1444b5e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:39.945778 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488984f-c850-47d8-af2a-aac65d1e7c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:39.946371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488984f-c850-47d8-af2a-aac65d1e7c44 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:39.946654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488984f-c850-47d8-af2a-aac65d1e7c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:39.946927 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488984f-c850-47d8-af2a-aac65d1e7c44 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:39.947673 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488984f-c850-47d8-af2a-aac65d1e7c44 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:39.949028 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6488984f-c850-47d8-af2a-aac65d1e7c44 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:39.962178 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 649/1295] 10.222.0.44 () {60 vars in 1141 bytes} [Tue Jun 14 19:32:39 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:32:42.075999 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9074cc7-b99e-4924-b75d-0e81653fded4 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:42.076500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9074cc7-b99e-4924-b75d-0e81653fded4 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:42.076500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9074cc7-b99e-4924-b75d-0e81653fded4 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:42.077896 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 647/1296] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:32:42.083106 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e38909-9a3d-4233-8924-aad12eb5ff5a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:42.083530 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e38909-9a3d-4233-8924-aad12eb5ff5a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:42.083666 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e38909-9a3d-4233-8924-aad12eb5ff5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:42.101337 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f9e38909-9a3d-4233-8924-aad12eb5ff5a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:32:42.102549 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f9e38909-9a3d-4233-8924-aad12eb5ff5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:32:42.172925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 650/1297] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:32:42 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:32:42.195699 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9074cc7-b99e-4924-b75d-0e81653fded4 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:42.295660 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9074cc7-b99e-4924-b75d-0e81653fded4 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:42.327802 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45765b1c-62cb-47c8-aabc-7ca7f63597d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:42.328525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45765b1c-62cb-47c8-aabc-7ca7f63597d4 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:42.328808 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45765b1c-62cb-47c8-aabc-7ca7f63597d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:42.329088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45765b1c-62cb-47c8-aabc-7ca7f63597d4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:42.329768 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45765b1c-62cb-47c8-aabc-7ca7f63597d4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:42.331123 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45765b1c-62cb-47c8-aabc-7ca7f63597d4 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:42.343352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-45765b1c-62cb-47c8-aabc-7ca7f63597d4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 19:32:42.343352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:42.343352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:32:42.343352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:32:42.343352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:32:42.343352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:32:42.343352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:32:42.343352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:32:42.343352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 19:32:42.343352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:42.343352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:32:42.343352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:42.343352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:42.343352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:42.343352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:42.343352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:42.343352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:42.344551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:42.344551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:42.344551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:42.344551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:42.344551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:42.344551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:42.344551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:32:42.344551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:32:42.344551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:32:42.344551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:32:42.344551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:42.344551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:42.344551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:42.344551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:42.344551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:42.344551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:42.345442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:42.345442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:42.345442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:42.345442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:42.345442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:42.345442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:42.345442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:42.345442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:42.345442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:42.345442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:42.345442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:32:42.345442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:32:42.345442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 19:32:42.345442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:42.345442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 648/1298] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jun 14 19:32:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:42.350309 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e38909-9a3d-4233-8924-aad12eb5ff5a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:42.369218 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:42.448989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e38909-9a3d-4233-8924-aad12eb5ff5a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:42.481271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4515e9-d523-4eb6-b98e-4b52d8caca1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:42.481955 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4515e9-d523-4eb6-b98e-4b52d8caca1b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:42.482237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4515e9-d523-4eb6-b98e-4b52d8caca1b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:42.482512 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4515e9-d523-4eb6-b98e-4b52d8caca1b None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:42.483211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4515e9-d523-4eb6-b98e-4b52d8caca1b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:42.483516 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4515e9-d523-4eb6-b98e-4b52d8caca1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:42.484871 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4515e9-d523-4eb6-b98e-4b52d8caca1b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:42.489878 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 651/1299] 10.222.0.44 () {56 vars in 1116 bytes} [Tue Jun 14 19:32:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:42.496726 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45765b1c-62cb-47c8-aabc-7ca7f63597d4 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:42.527590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:42.595292 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45765b1c-62cb-47c8-aabc-7ca7f63597d4 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:42.627965 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c544bd-5b99-4376-8771-6d694309492f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:42.628600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c544bd-5b99-4376-8771-6d694309492f None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:42.628883 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c544bd-5b99-4376-8771-6d694309492f None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:42.629162 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c544bd-5b99-4376-8771-6d694309492f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:42.629973 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c544bd-5b99-4376-8771-6d694309492f None admin] RBAC: Adding query filter params (interface=public, service_id=763da2d7972b4f5a8c5ce53ba98a710a, region_id=RegionOne) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:42.630285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c544bd-5b99-4376-8771-6d694309492f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:42.631670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c544bd-5b99-4376-8771-6d694309492f None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:42.636587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 649/1300] 10.222.0.44 () {56 vars in 1251 bytes} [Tue Jun 14 19:32:42 2022] GET /identity/v3/endpoints?service_id=763da2d7972b4f5a8c5ce53ba98a710a&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:42.642502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4515e9-d523-4eb6-b98e-4b52d8caca1b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:42.720261 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:42.738388 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4515e9-d523-4eb6-b98e-4b52d8caca1b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:42.771332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eea23b-7a99-403b-9bb5-d248f2c153f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:42.772499 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eea23b-7a99-403b-9bb5-d248f2c153f9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:42.772780 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eea23b-7a99-403b-9bb5-d248f2c153f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:42.773055 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eea23b-7a99-403b-9bb5-d248f2c153f9 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:42.773757 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eea23b-7a99-403b-9bb5-d248f2c153f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:42.775122 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eea23b-7a99-403b-9bb5-d248f2c153f9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:42.781781 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 652/1301] 10.222.0.44 () {56 vars in 1087 bytes} [Tue Jun 14 19:32:42 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:32:44.869554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d42e64-210a-4244-bc3c-0a934f9caa14 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:44.870069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d42e64-210a-4244-bc3c-0a934f9caa14 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:44.870189 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d42e64-210a-4244-bc3c-0a934f9caa14 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:44.871458 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 650/1302] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:32:44.876617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab8b4b-8d1f-46e1-ae6e-38b5bb332253 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:44.876986 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab8b4b-8d1f-46e1-ae6e-38b5bb332253 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:44.877185 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab8b4b-8d1f-46e1-ae6e-38b5bb332253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:44.894100 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-4cab8b4b-8d1f-46e1-ae6e-38b5bb332253 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:32:44.895285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4cab8b4b-8d1f-46e1-ae6e-38b5bb332253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:32:44.961187 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 653/1303] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:32:44 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 14 19:32:44.984128 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d42e64-210a-4244-bc3c-0a934f9caa14 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:45.079554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:45.086290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d42e64-210a-4244-bc3c-0a934f9caa14 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:45.118432 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95719d-3276-4dca-aca5-0c4302b2f557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:45.119209 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95719d-3276-4dca-aca5-0c4302b2f557 None admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:45.119495 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95719d-3276-4dca-aca5-0c4302b2f557 None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:45.119770 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95719d-3276-4dca-aca5-0c4302b2f557 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:45.120414 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95719d-3276-4dca-aca5-0c4302b2f557 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:45.121801 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95719d-3276-4dca-aca5-0c4302b2f557 None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:45.134079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application [None req-3a95719d-3276-4dca-aca5-0c4302b2f557 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 19:32:45.134079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:45.134079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 14 19:32:45.134079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 14 19:32:45.134079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 14 19:32:45.134079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 14 19:32:45.134079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 14 19:32:45.134079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:32:45.134079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 19:32:45.134079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:45.134079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 14 19:32:45.134079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:45.134079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 14 19:32:45.134079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 14 19:32:45.134079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 14 19:32:45.134079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 14 19:32:45.134079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 14 19:32:45.135219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 14 19:32:45.135219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 14 19:32:45.135219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 14 19:32:45.135219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 14 19:32:45.135219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 14 19:32:45.135219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 14 19:32:45.135219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 14 19:32:45.135219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 14 19:32:45.135219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 14 19:32:45.135219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 14 19:32:45.135219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 14 19:32:45.135219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 14 19:32:45.135219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 14 19:32:45.135219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 14 19:32:45.135219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 14 19:32:45.135219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.get_or_create( Jun 14 19:32:45.136396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 14 19:32:45.136396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application with Lock( Jun 14 19:32:45.136396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 14 19:32:45.136396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self._enter() Jun 14 19:32:45.136396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 14 19:32:45.136396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 14 19:32:45.136396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 14 19:32:45.136396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application return self.creator() Jun 14 19:32:45.136396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 14 19:32:45.136396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application created_value = creator( Jun 14 19:32:45.136396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 14 19:32:45.136396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 14 19:32:45.136396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 14 19:32:45.136396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: ERROR keystone.server.flask.application Jun 14 19:32:45.136396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 651/1304] 10.222.0.44 () {56 vars in 1117 bytes} [Tue Jun 14 19:32:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 14 19:32:45.141404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab8b4b-8d1f-46e1-ae6e-38b5bb332253 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:45.216261 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:45.238974 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab8b4b-8d1f-46e1-ae6e-38b5bb332253 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:45.272539 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b02103-8558-47d2-91e1-1ab383eb413d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:45.273198 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b02103-8558-47d2-91e1-1ab383eb413d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:45.273514 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b02103-8558-47d2-91e1-1ab383eb413d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:45.273797 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b02103-8558-47d2-91e1-1ab383eb413d None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:45.274497 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b02103-8558-47d2-91e1-1ab383eb413d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:32:45.274808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b02103-8558-47d2-91e1-1ab383eb413d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:45.276177 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b02103-8558-47d2-91e1-1ab383eb413d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:45.281209 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 654/1305] 10.222.0.44 () {56 vars in 1116 bytes} [Tue Jun 14 19:32:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:32:45.287233 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95719d-3276-4dca-aca5-0c4302b2f557 None admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:32:45.383970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95719d-3276-4dca-aca5-0c4302b2f557 None admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:32:45.416179 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4fcebe-4afc-4f4c-933f-e397349eb67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:32:45.416806 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fcebe-4afc-4f4c-933f-e397349eb67e None admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:32:45.417089 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fcebe-4afc-4f4c-933f-e397349eb67e None admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:32:45.417364 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fcebe-4afc-4f4c-933f-e397349eb67e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:32:45.418114 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fcebe-4afc-4f4c-933f-e397349eb67e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:32:45.419465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4fcebe-4afc-4f4c-933f-e397349eb67e None admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:32:45.438354 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 652/1306] 10.222.0.44 () {60 vars in 1144 bytes} [Tue Jun 14 19:32:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:32:55.278303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=30 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:32:55.433400 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:33:48.694983 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903946d-cf80-4e00-a110-938026c54dec None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:33:48.695492 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903946d-cf80-4e00-a110-938026c54dec None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:33:48.695587 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903946d-cf80-4e00-a110-938026c54dec None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:33:48.696922 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 655/1307] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:33:48.705470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34d3d8-9dfe-4d5d-9e72-06cc68b805c1 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:33:48.706729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34d3d8-9dfe-4d5d-9e72-06cc68b805c1 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:33:48.707618 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b34d3d8-9dfe-4d5d-9e72-06cc68b805c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:33:48.836172 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-0b34d3d8-9dfe-4d5d-9e72-06cc68b805c1 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:33:48.837517 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-0b34d3d8-9dfe-4d5d-9e72-06cc68b805c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:33:48.973573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 653/1308] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:33:49.011632 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd8f17-5eba-4390-85cd-a092c136a488 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:33:49.012199 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd8f17-5eba-4390-85cd-a092c136a488 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:33:49.012480 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd8f17-5eba-4390-85cd-a092c136a488 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:33:49.014023 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 656/1309] 10.222.0.44 () {54 vars in 964 bytes} [Tue Jun 14 19:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:33:49.021240 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32c9cc-d3b9-424e-85b4-a8fdc8319603 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:33:49.021572 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32c9cc-d3b9-424e-85b4-a8fdc8319603 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:33:49.021876 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32c9cc-d3b9-424e-85b4-a8fdc8319603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:33:49.103832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-1c32c9cc-d3b9-424e-85b4-a8fdc8319603 None None] MFA Rules not processed for user `791ed0f433834b4599d6bc825440279d`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:33:49.104937 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-1c32c9cc-d3b9-424e-85b4-a8fdc8319603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:33:49.127038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:33:49.186025 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 654/1310] 10.222.0.44 () {58 vars in 1061 bytes} [Tue Jun 14 19:33:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:33:49.195724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd8f17-5eba-4390-85cd-a092c136a488 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:33:49.197481 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b2fd8f17-5eba-4390-85cd-a092c136a488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:33:49.310140 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd8f17-5eba-4390-85cd-a092c136a488 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:33:49.388949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512ae6a-8e40-4775-b39c-5d4233c74d41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:33:49.389551 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512ae6a-8e40-4775-b39c-5d4233c74d41 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:33:49.389838 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512ae6a-8e40-4775-b39c-5d4233c74d41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:33:49.390114 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512ae6a-8e40-4775-b39c-5d4233c74d41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:33:49.392344 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a512ae6a-8e40-4775-b39c-5d4233c74d41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:33:49.450863 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:33:49.509155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512ae6a-8e40-4775-b39c-5d4233c74d41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:33:49.510638 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512ae6a-8e40-4775-b39c-5d4233c74d41 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:33:49.530605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 657/1311] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:33:51.948436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b754e8-9249-49fb-9f4b-0c40492be522 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:33:51.949009 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b754e8-9249-49fb-9f4b-0c40492be522 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:33:51.949104 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b754e8-9249-49fb-9f4b-0c40492be522 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:33:51.950656 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 655/1312] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:33:51.955720 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dfd14-9cc1-433c-8307-97b8404a5313 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:33:51.956109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dfd14-9cc1-433c-8307-97b8404a5313 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:33:51.956271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dfd14-9cc1-433c-8307-97b8404a5313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:33:52.025123 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9e2dfd14-9cc1-433c-8307-97b8404a5313 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:33:52.026340 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9e2dfd14-9cc1-433c-8307-97b8404a5313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:33:52.125043 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 658/1313] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:33:52.163642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b754e8-9249-49fb-9f4b-0c40492be522 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:33:52.165176 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-f4b754e8-9249-49fb-9f4b-0c40492be522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:33:52.275982 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b754e8-9249-49fb-9f4b-0c40492be522 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:33:52.353796 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:33:52.356858 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2226aee-2147-4a96-b505-fe494b2ef08f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:33:52.357597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2226aee-2147-4a96-b505-fe494b2ef08f service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:33:52.358107 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2226aee-2147-4a96-b505-fe494b2ef08f service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:33:52.358613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2226aee-2147-4a96-b505-fe494b2ef08f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:33:52.361184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-f2226aee-2147-4a96-b505-fe494b2ef08f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:33:52.477241 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2226aee-2147-4a96-b505-fe494b2ef08f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:33:52.478695 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2226aee-2147-4a96-b505-fe494b2ef08f service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:33:52.498162 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 656/1314] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:33:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:33:54.992828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c763665-018c-4d4a-8399-6277e2c7b26f None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:33:54.993403 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c763665-018c-4d4a-8399-6277e2c7b26f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:33:54.993495 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c763665-018c-4d4a-8399-6277e2c7b26f None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:33:54.994950 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 659/1315] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:33:55.000117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fdfe4-2a48-4c8a-b83c-7325a2987bd3 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:33:55.000553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fdfe4-2a48-4c8a-b83c-7325a2987bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:33:55.001877 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fdfe4-2a48-4c8a-b83c-7325a2987bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:33:55.071905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-c28fdfe4-2a48-4c8a-b83c-7325a2987bd3 None None] MFA Rules not processed for user `8949be5666f94730b962f3ed654313b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:33:55.073105 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c28fdfe4-2a48-4c8a-b83c-7325a2987bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:33:55.124038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:33:55.170940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 657/1316] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:33:54 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:33:55.210570 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c763665-018c-4d4a-8399-6277e2c7b26f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:33:55.212096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5c763665-018c-4d4a-8399-6277e2c7b26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:33:55.222302 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:33:55.318153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c763665-018c-4d4a-8399-6277e2c7b26f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:33:55.389116 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc6e5d-57a9-4820-8f2b-d939bb3ef765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:33:55.389780 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc6e5d-57a9-4820-8f2b-d939bb3ef765 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:33:55.390064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc6e5d-57a9-4820-8f2b-d939bb3ef765 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:33:55.390336 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc6e5d-57a9-4820-8f2b-d939bb3ef765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:33:55.391998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-68bc6e5d-57a9-4820-8f2b-d939bb3ef765 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:33:55.452429 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:33:55.498779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc6e5d-57a9-4820-8f2b-d939bb3ef765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:33:55.500228 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc6e5d-57a9-4820-8f2b-d939bb3ef765 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:33:55.518770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 660/1317] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:33:55 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:33:58.233718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08178d-a1ec-49b4-a4f1-b4b88e414429 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:33:58.234301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08178d-a1ec-49b4-a4f1-b4b88e414429 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:33:58.234301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08178d-a1ec-49b4-a4f1-b4b88e414429 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:33:58.235991 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 658/1318] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:33:58.241091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5999c3-a1f4-425a-8fd2-91eaad90a57e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:33:58.241580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5999c3-a1f4-425a-8fd2-91eaad90a57e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:33:58.241682 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5999c3-a1f4-425a-8fd2-91eaad90a57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:33:58.305208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-5f5999c3-a1f4-425a-8fd2-91eaad90a57e None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:33:58.306427 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5f5999c3-a1f4-425a-8fd2-91eaad90a57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:33:58.403507 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 661/1319] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:33:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:33:58.459101 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3676c1-671b-41a7-b698-6cc41908bd9f None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:33:58.459392 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3676c1-671b-41a7-b698-6cc41908bd9f None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:33:58.459676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3676c1-671b-41a7-b698-6cc41908bd9f None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:33:58.461064 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 659/1320] 10.222.0.44 () {54 vars in 964 bytes} [Tue Jun 14 19:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:33:58.467133 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5ff76-8c9b-495f-9352-bdc4836e1cd2 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:33:58.467424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5ff76-8c9b-495f-9352-bdc4836e1cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:33:58.467704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5ff76-8c9b-495f-9352-bdc4836e1cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:33:58.489452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:33:58.543711 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-20a5ff76-8c9b-495f-9352-bdc4836e1cd2 None None] MFA Rules not processed for user `791ed0f433834b4599d6bc825440279d`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:33:58.544921 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-20a5ff76-8c9b-495f-9352-bdc4836e1cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:33:58.622014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 662/1321] 10.222.0.44 () {58 vars in 1061 bytes} [Tue Jun 14 19:33:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:33:58.631493 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3676c1-671b-41a7-b698-6cc41908bd9f None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:33:58.633007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-8e3676c1-671b-41a7-b698-6cc41908bd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:33:58.756457 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3676c1-671b-41a7-b698-6cc41908bd9f None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:33:58.828115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f6604-25a0-466c-8332-2a0d6ae5eb74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:33:58.829255 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f6604-25a0-466c-8332-2a0d6ae5eb74 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:33:58.829570 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f6604-25a0-466c-8332-2a0d6ae5eb74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:33:58.829845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f6604-25a0-466c-8332-2a0d6ae5eb74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:33:58.831476 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-5d1f6604-25a0-466c-8332-2a0d6ae5eb74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:33:58.838922 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:33:58.940384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f6604-25a0-466c-8332-2a0d6ae5eb74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:33:58.941835 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f6604-25a0-466c-8332-2a0d6ae5eb74 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:33:58.960087 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 660/1322] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:33:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:34:02.233536 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26daed9-e81d-48f5-bb52-1551c8762f7b None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:02.234064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26daed9-e81d-48f5-bb52-1551c8762f7b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:02.234172 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26daed9-e81d-48f5-bb52-1551c8762f7b None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:02.236219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 663/1323] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:34:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:02.241786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35b5a5-a198-4471-b2d4-bf28c852fc12 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:02.242221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35b5a5-a198-4471-b2d4-bf28c852fc12 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:02.242358 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35b5a5-a198-4471-b2d4-bf28c852fc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:02.315612 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-db35b5a5-a198-4471-b2d4-bf28c852fc12 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:02.316842 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-db35b5a5-a198-4471-b2d4-bf28c852fc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:02.380287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:02.423854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 661/1324] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:02.460553 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26daed9-e81d-48f5-bb52-1551c8762f7b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:34:02.462114 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d26daed9-e81d-48f5-bb52-1551c8762f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:02.567754 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26daed9-e81d-48f5-bb52-1551c8762f7b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:34:02.582475 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:02.646878 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87724f5-fbb7-4d1f-bcf4-4b0cd0c42c76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:34:02.647534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87724f5-fbb7-4d1f-bcf4-4b0cd0c42c76 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:02.647817 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87724f5-fbb7-4d1f-bcf4-4b0cd0c42c76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:02.648094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87724f5-fbb7-4d1f-bcf4-4b0cd0c42c76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:02.649771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d87724f5-fbb7-4d1f-bcf4-4b0cd0c42c76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:02.758681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87724f5-fbb7-4d1f-bcf4-4b0cd0c42c76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:34:02.760125 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87724f5-fbb7-4d1f-bcf4-4b0cd0c42c76 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:34:02.779139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 664/1325] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:34:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:34:05.036945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f512e6-8368-4bbc-80cd-8b5998fba465 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:05.037502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f512e6-8368-4bbc-80cd-8b5998fba465 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:05.037626 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f512e6-8368-4bbc-80cd-8b5998fba465 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:05.038900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 662/1326] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:05.044136 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1498af0-17ef-4da1-86ff-5cce8942ba7a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:05.044547 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1498af0-17ef-4da1-86ff-5cce8942ba7a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:05.044686 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1498af0-17ef-4da1-86ff-5cce8942ba7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:05.092226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:05.112861 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f1498af0-17ef-4da1-86ff-5cce8942ba7a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:05.114105 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f1498af0-17ef-4da1-86ff-5cce8942ba7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:05.212334 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 665/1327] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:34:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:05.248967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f512e6-8368-4bbc-80cd-8b5998fba465 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:34:05.250740 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-73f512e6-8368-4bbc-80cd-8b5998fba465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:05.354923 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f512e6-8368-4bbc-80cd-8b5998fba465 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:34:05.443578 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcf1a8d-b08e-493f-ab5a-c75d192df637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:34:05.444223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf1a8d-b08e-493f-ab5a-c75d192df637 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:05.444500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf1a8d-b08e-493f-ab5a-c75d192df637 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:05.444788 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcf1a8d-b08e-493f-ab5a-c75d192df637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:05.446412 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-8bcf1a8d-b08e-493f-ab5a-c75d192df637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:05.464328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:05.557197 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf1a8d-b08e-493f-ab5a-c75d192df637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:34:05.558667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcf1a8d-b08e-493f-ab5a-c75d192df637 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:34:05.577264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 663/1328] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:34:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:34:07.794778 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708aeab-b78e-4709-8126-9de44f741c1f None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:07.795260 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708aeab-b78e-4709-8126-9de44f741c1f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:07.795372 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708aeab-b78e-4709-8126-9de44f741c1f None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:07.796738 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 666/1329] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:07.802040 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5692e5-57f1-4ce6-a93c-bbd455ffeb9e None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:07.802472 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5692e5-57f1-4ce6-a93c-bbd455ffeb9e None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:07.802604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5692e5-57f1-4ce6-a93c-bbd455ffeb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:07.871177 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-df5692e5-57f1-4ce6-a93c-bbd455ffeb9e None None] MFA Rules not processed for user `8949be5666f94730b962f3ed654313b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:07.872381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-df5692e5-57f1-4ce6-a93c-bbd455ffeb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:07.952084 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:07.990502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 664/1330] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:34:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:08.028079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708aeab-b78e-4709-8126-9de44f741c1f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:34:08.029581 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8708aeab-b78e-4709-8126-9de44f741c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:08.136677 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708aeab-b78e-4709-8126-9de44f741c1f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:34:08.156728 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:08.210486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22c1e6-caa1-4012-8487-13944c070383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:34:08.211053 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22c1e6-caa1-4012-8487-13944c070383 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:08.211334 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22c1e6-caa1-4012-8487-13944c070383 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:08.211605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22c1e6-caa1-4012-8487-13944c070383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:08.213205 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-db22c1e6-caa1-4012-8487-13944c070383 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:08.323691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22c1e6-caa1-4012-8487-13944c070383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:34:08.325172 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22c1e6-caa1-4012-8487-13944c070383 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:34:08.344788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 667/1331] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:34:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:34:10.731123 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01632ef-8eb9-480a-8808-cd2f571cf0eb None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:10.731606 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01632ef-8eb9-480a-8808-cd2f571cf0eb None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:10.731774 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01632ef-8eb9-480a-8808-cd2f571cf0eb None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:10.733212 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 665/1332] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:10.739019 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40037a17-fce4-49dd-ba6c-9192dd07fef6 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:10.739501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40037a17-fce4-49dd-ba6c-9192dd07fef6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:10.739608 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40037a17-fce4-49dd-ba6c-9192dd07fef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:10.801171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:10.803792 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-40037a17-fce4-49dd-ba6c-9192dd07fef6 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:10.805661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-40037a17-fce4-49dd-ba6c-9192dd07fef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:10.906787 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 668/1333] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:10.942540 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01632ef-8eb9-480a-8808-cd2f571cf0eb None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:34:10.944054 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-a01632ef-8eb9-480a-8808-cd2f571cf0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:11.048954 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01632ef-8eb9-480a-8808-cd2f571cf0eb None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:34:11.122556 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67a0be-2316-49a2-b8fd-7d3c2314b9bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:34:11.123220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67a0be-2316-49a2-b8fd-7d3c2314b9bc service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:11.123504 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67a0be-2316-49a2-b8fd-7d3c2314b9bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:11.123784 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67a0be-2316-49a2-b8fd-7d3c2314b9bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:11.126129 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-bb67a0be-2316-49a2-b8fd-7d3c2314b9bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:11.153478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:11.236067 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67a0be-2316-49a2-b8fd-7d3c2314b9bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:34:11.237517 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb67a0be-2316-49a2-b8fd-7d3c2314b9bc service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:34:11.255908 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 666/1334] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:34:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:34:13.415179 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdacba9-41cc-435f-adfa-eadb922f86f7 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:13.415728 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdacba9-41cc-435f-adfa-eadb922f86f7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:13.415728 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdacba9-41cc-435f-adfa-eadb922f86f7 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:13.417140 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 669/1335] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:13.423121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c62f9f-10fe-4554-b421-8ea1ebaeabd9 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:13.423554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c62f9f-10fe-4554-b421-8ea1ebaeabd9 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:13.423683 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c62f9f-10fe-4554-b421-8ea1ebaeabd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:13.493177 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-82c62f9f-10fe-4554-b421-8ea1ebaeabd9 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:13.494404 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-82c62f9f-10fe-4554-b421-8ea1ebaeabd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:13.569752 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:13.592175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 667/1336] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:13.633059 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdacba9-41cc-435f-adfa-eadb922f86f7 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:34:13.634673 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-dbdacba9-41cc-435f-adfa-eadb922f86f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:13.736159 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdacba9-41cc-435f-adfa-eadb922f86f7 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:34:13.764854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:13.809818 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a7bcf-47ad-43f4-bf34-5d9463c34092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:34:13.810462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a7bcf-47ad-43f4-bf34-5d9463c34092 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:13.810743 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a7bcf-47ad-43f4-bf34-5d9463c34092 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:13.811015 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a7bcf-47ad-43f4-bf34-5d9463c34092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:13.813297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c92a7bcf-47ad-43f4-bf34-5d9463c34092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:13.920835 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a7bcf-47ad-43f4-bf34-5d9463c34092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:34:13.922864 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a7bcf-47ad-43f4-bf34-5d9463c34092 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:34:13.940889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 670/1337] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:34:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:34:16.465971 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c3ba1-2a0e-485b-9cb1-159fa9344bce None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:16.466513 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c3ba1-2a0e-485b-9cb1-159fa9344bce None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:16.466513 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c3ba1-2a0e-485b-9cb1-159fa9344bce None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:16.468044 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 668/1338] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:16.473091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac536e-5c12-45a3-b820-e887cfce7e91 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:16.473782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac536e-5c12-45a3-b820-e887cfce7e91 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:16.474068 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac536e-5c12-45a3-b820-e887cfce7e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:16.537885 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e5ac536e-5c12-45a3-b820-e887cfce7e91 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:16.539076 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e5ac536e-5c12-45a3-b820-e887cfce7e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:16.547746 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:16.642372 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 671/1339] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:34:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:16.678768 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c3ba1-2a0e-485b-9cb1-159fa9344bce None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:34:16.680298 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-2e3c3ba1-2a0e-485b-9cb1-159fa9344bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:16.783519 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c3ba1-2a0e-485b-9cb1-159fa9344bce None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:34:16.857096 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1598d3a7-be1f-4aee-ba82-4ba5ce3b6f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:34:16.857772 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598d3a7-be1f-4aee-ba82-4ba5ce3b6f85 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:16.858061 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598d3a7-be1f-4aee-ba82-4ba5ce3b6f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:16.858992 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1598d3a7-be1f-4aee-ba82-4ba5ce3b6f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:16.860516 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-1598d3a7-be1f-4aee-ba82-4ba5ce3b6f85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:16.895975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:16.969707 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598d3a7-be1f-4aee-ba82-4ba5ce3b6f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:34:16.971132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1598d3a7-be1f-4aee-ba82-4ba5ce3b6f85 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:34:16.988842 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 669/1340] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:34:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:34:20.997523 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798c617-24a9-4eb9-9a23-28ea08a2470a None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:20.998088 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798c617-24a9-4eb9-9a23-28ea08a2470a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:20.998088 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f798c617-24a9-4eb9-9a23-28ea08a2470a None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:20.999475 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 672/1341] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:21.005150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af99b26-bf59-4b6c-b576-ff4229204c27 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:21.005150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af99b26-bf59-4b6c-b576-ff4229204c27 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:21.005891 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af99b26-bf59-4b6c-b576-ff4229204c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:21.080756 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-2af99b26-bf59-4b6c-b576-ff4229204c27 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:21.081913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-2af99b26-bf59-4b6c-b576-ff4229204c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:21.174144 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:21.187952 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 670/1342] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:21.227960 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798c617-24a9-4eb9-9a23-28ea08a2470a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:34:21.230083 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f798c617-24a9-4eb9-9a23-28ea08a2470a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:21.325601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f798c617-24a9-4eb9-9a23-28ea08a2470a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:34:21.329868 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd71ba2-9055-4771-a62a-f46be10618de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:34:21.330516 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd71ba2-9055-4771-a62a-f46be10618de service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:21.330796 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd71ba2-9055-4771-a62a-f46be10618de service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:21.331076 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd71ba2-9055-4771-a62a-f46be10618de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:21.340115 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd71ba2-9055-4771-a62a-f46be10618de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:34:21.341658 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd71ba2-9055-4771-a62a-f46be10618de service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:34:21.351588 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 673/1343] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:34:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:34:24.094196 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc62a29-621b-45fd-801b-b7ef9e189aca None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:24.094747 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc62a29-621b-45fd-801b-b7ef9e189aca None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:24.094747 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc62a29-621b-45fd-801b-b7ef9e189aca None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:24.096070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 671/1344] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:24.101880 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b57e8-fae4-492e-8f68-4a6e43515b22 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:24.102425 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b57e8-fae4-492e-8f68-4a6e43515b22 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:24.102559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b57e8-fae4-492e-8f68-4a6e43515b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:24.133130 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-281b57e8-fae4-492e-8f68-4a6e43515b22 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:24.134458 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-281b57e8-fae4-492e-8f68-4a6e43515b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:24.165143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:24.219147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 674/1345] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:34:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:24.257153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc62a29-621b-45fd-801b-b7ef9e189aca None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:34:24.268839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc62a29-621b-45fd-801b-b7ef9e189aca None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:34:24.272419 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0e8a1-ca7b-41d1-8a0f-56563c35ae44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:34:24.273077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0e8a1-ca7b-41d1-8a0f-56563c35ae44 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:24.273357 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0e8a1-ca7b-41d1-8a0f-56563c35ae44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:24.273693 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0e8a1-ca7b-41d1-8a0f-56563c35ae44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:24.284514 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0e8a1-ca7b-41d1-8a0f-56563c35ae44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:34:24.285991 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0e8a1-ca7b-41d1-8a0f-56563c35ae44 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:34:24.295543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 672/1346] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:34:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:34:28.488811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbac35c-b292-43c6-bc2e-7ed1a1e1f0b2 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:28.489483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbac35c-b292-43c6-bc2e-7ed1a1e1f0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:28.489483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbac35c-b292-43c6-bc2e-7ed1a1e1f0b2 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:28.490772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 675/1347] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:28.496157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b0144-dbfc-41d6-a212-89140a98e0e2 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:28.496596 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b0144-dbfc-41d6-a212-89140a98e0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:28.496836 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b0144-dbfc-41d6-a212-89140a98e0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:28.516245 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-c86b0144-dbfc-41d6-a212-89140a98e0e2 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:28.517483 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c86b0144-dbfc-41d6-a212-89140a98e0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:28.525291 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 673/1348] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:28.563362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbac35c-b292-43c6-bc2e-7ed1a1e1f0b2 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:34:28.574228 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbac35c-b292-43c6-bc2e-7ed1a1e1f0b2 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:34:28.579216 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab585fea-9a93-49b7-accf-958022e48f8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:34:28.579857 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab585fea-9a93-49b7-accf-958022e48f8d service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:28.580134 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab585fea-9a93-49b7-accf-958022e48f8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:28.580419 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab585fea-9a93-49b7-accf-958022e48f8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:28.589637 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab585fea-9a93-49b7-accf-958022e48f8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:34:28.591067 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab585fea-9a93-49b7-accf-958022e48f8d service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:34:28.601627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 676/1349] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:34:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:34:33.722108 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b693e-efff-44ef-874f-85473ee3577e None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:33.723069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b693e-efff-44ef-874f-85473ee3577e None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:33.723562 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457b693e-efff-44ef-874f-85473ee3577e None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:33.725434 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 674/1350] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jun 14 19:34:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:33.733317 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad8c9f-e362-418b-934d-d1fc41a2b423 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:33.733317 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad8c9f-e362-418b-934d-d1fc41a2b423 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:33.733317 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad8c9f-e362-418b-934d-d1fc41a2b423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:33.846498 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0dad8c9f-e362-418b-934d-d1fc41a2b423 None None] MFA Rules not processed for user `e98915513674460485413c2dbee87fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:33.848032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0dad8c9f-e362-418b-934d-d1fc41a2b423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:33.939084 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 677/1351] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jun 14 19:34:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:38.187568 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738f10a-6852-4027-a0c4-0a1a45496a22 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:38.188091 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738f10a-6852-4027-a0c4-0a1a45496a22 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:38.188091 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738f10a-6852-4027-a0c4-0a1a45496a22 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:38.189609 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 675/1352] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jun 14 19:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:38.194577 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6315fc9-a908-4e09-baca-33e69e9a6c9f None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:38.195387 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6315fc9-a908-4e09-baca-33e69e9a6c9f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:38.195736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6315fc9-a908-4e09-baca-33e69e9a6c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:38.215015 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f6315fc9-a908-4e09-baca-33e69e9a6c9f None None] MFA Rules not processed for user `e98915513674460485413c2dbee87fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:38.216327 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f6315fc9-a908-4e09-baca-33e69e9a6c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:38.226384 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 678/1353] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jun 14 19:34:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:38.509521 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=13 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:39.919064 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bd5ff-618e-4836-bc72-5dd9d4af4097 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:39.919710 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bd5ff-618e-4836-bc72-5dd9d4af4097 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:39.919710 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bd5ff-618e-4836-bc72-5dd9d4af4097 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:39.920959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 676/1354] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jun 14 19:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:39.926024 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36810da7-a26c-435d-a8ad-c503a839025c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:39.926472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36810da7-a26c-435d-a8ad-c503a839025c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:39.926577 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36810da7-a26c-435d-a8ad-c503a839025c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:39.944417 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-36810da7-a26c-435d-a8ad-c503a839025c None None] MFA Rules not processed for user `e98915513674460485413c2dbee87fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:39.945650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-36810da7-a26c-435d-a8ad-c503a839025c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:39.954977 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 679/1355] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jun 14 19:34:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:43.648471 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de911c8-7fac-4045-b015-216d63d9493c None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:43.649468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de911c8-7fac-4045-b015-216d63d9493c None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:43.649986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de911c8-7fac-4045-b015-216d63d9493c None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:43.651694 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 677/1356] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:34:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:43.657560 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb90171-5536-4a66-b5e2-dc841358a2fa None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:43.658017 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb90171-5536-4a66-b5e2-dc841358a2fa None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:43.658126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb90171-5536-4a66-b5e2-dc841358a2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:43.677142 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-4fb90171-5536-4a66-b5e2-dc841358a2fa None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:43.678451 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4fb90171-5536-4a66-b5e2-dc841358a2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:43.687361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 680/1357] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:43.741674 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d083a-8132-4f5e-8731-d641eef706c8 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:43.742199 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d083a-8132-4f5e-8731-d641eef706c8 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:43.742737 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d083a-8132-4f5e-8731-d641eef706c8 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:43.744545 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 678/1358] 10.222.0.44 () {54 vars in 961 bytes} [Tue Jun 14 19:34:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:43.754452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c06ba-bf99-43a7-976f-43ff7947d3ae None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:43.754826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c06ba-bf99-43a7-976f-43ff7947d3ae None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:43.755065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c06ba-bf99-43a7-976f-43ff7947d3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:43.801001 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:43.810502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-400c06ba-bf99-43a7-976f-43ff7947d3ae None None] MFA Rules not processed for user `37c521e20aea4cad9758568a4f082fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:43.812699 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-400c06ba-bf99-43a7-976f-43ff7947d3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:43.913610 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 681/1359] 10.222.0.44 () {58 vars in 1058 bytes} [Tue Jun 14 19:34:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:43.921910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d083a-8132-4f5e-8731-d641eef706c8 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:34:43.937544 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d083a-8132-4f5e-8731-d641eef706c8 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:34:43.944240 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c9f78-46e9-4f01-be7a-310ef396c05d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:34:43.945086 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c9f78-46e9-4f01-be7a-310ef396c05d service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:43.945449 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c9f78-46e9-4f01-be7a-310ef396c05d service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:43.945689 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c9f78-46e9-4f01-be7a-310ef396c05d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:43.957431 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c9f78-46e9-4f01-be7a-310ef396c05d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:34:43.959294 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c9f78-46e9-4f01-be7a-310ef396c05d service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:34:43.971603 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 679/1360] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:34:46.337003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4c7d1-5144-41f4-ab89-037fba297c21 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:46.337600 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4c7d1-5144-41f4-ab89-037fba297c21 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:46.337600 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4c7d1-5144-41f4-ab89-037fba297c21 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:46.339071 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 682/1361] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:46.344393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c79714-e590-4f93-8ae7-489d5fe57468 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:46.345220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c79714-e590-4f93-8ae7-489d5fe57468 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:46.345528 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c79714-e590-4f93-8ae7-489d5fe57468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:46.364582 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-32c79714-e590-4f93-8ae7-489d5fe57468 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:46.365863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-32c79714-e590-4f93-8ae7-489d5fe57468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:46.374774 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 680/1362] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:46.422414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4c7d1-5144-41f4-ab89-037fba297c21 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:34:46.441857 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4c7d1-5144-41f4-ab89-037fba297c21 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:34:46.448274 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05220b-8660-421c-a67d-12629fa685ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:34:46.449083 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05220b-8660-421c-a67d-12629fa685ac service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:46.449549 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05220b-8660-421c-a67d-12629fa685ac service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:46.449992 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05220b-8660-421c-a67d-12629fa685ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:46.463254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05220b-8660-421c-a67d-12629fa685ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:34:46.465102 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05220b-8660-421c-a67d-12629fa685ac service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:34:46.476024 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 683/1363] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:34:49.001855 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be158828-e4b7-4507-9f76-9d0ee4094d0c None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:49.002367 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be158828-e4b7-4507-9f76-9d0ee4094d0c None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:49.002463 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be158828-e4b7-4507-9f76-9d0ee4094d0c None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:49.003890 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 681/1364] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:49.009114 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb342a-3a85-45f2-a311-17cbfa59b5c6 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:49.009634 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb342a-3a85-45f2-a311-17cbfa59b5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:49.009729 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb342a-3a85-45f2-a311-17cbfa59b5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:49.028453 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1feb342a-3a85-45f2-a311-17cbfa59b5c6 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:49.030453 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1feb342a-3a85-45f2-a311-17cbfa59b5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:49.038235 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 684/1365] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:49.085837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c6569-3392-4363-9f49-07c1fde8e69d None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:49.086178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c6569-3392-4363-9f49-07c1fde8e69d None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:49.086462 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c6569-3392-4363-9f49-07c1fde8e69d None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:49.088102 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 682/1366] 10.222.0.44 () {54 vars in 961 bytes} [Tue Jun 14 19:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:49.093647 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024259e3-ed58-49c2-b7a1-456264a80585 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:49.093935 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024259e3-ed58-49c2-b7a1-456264a80585 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:49.094246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024259e3-ed58-49c2-b7a1-456264a80585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:49.113776 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-024259e3-ed58-49c2-b7a1-456264a80585 None None] MFA Rules not processed for user `37c521e20aea4cad9758568a4f082fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:49.114972 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-024259e3-ed58-49c2-b7a1-456264a80585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:49.125112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 685/1367] 10.222.0.44 () {58 vars in 1058 bytes} [Tue Jun 14 19:34:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:49.132959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c6569-3392-4363-9f49-07c1fde8e69d None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:34:49.151277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c6569-3392-4363-9f49-07c1fde8e69d None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:34:49.158281 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d600d-f46f-4863-aa02-b392ea2a46c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:34:49.158922 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d600d-f46f-4863-aa02-b392ea2a46c3 service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:49.159204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d600d-f46f-4863-aa02-b392ea2a46c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:49.159479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d600d-f46f-4863-aa02-b392ea2a46c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:49.167695 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d600d-f46f-4863-aa02-b392ea2a46c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:34:49.169256 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d600d-f46f-4863-aa02-b392ea2a46c3 service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:34:49.179666 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 683/1368] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:34:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:34:51.407099 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ae202-0b1e-4c24-adec-d54179e00da5 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:51.407992 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ae202-0b1e-4c24-adec-d54179e00da5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:51.408535 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120ae202-0b1e-4c24-adec-d54179e00da5 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:51.409946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 686/1369] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:34:51.415316 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a24791-3e0d-4a6a-aec6-68616bf56a2f None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:51.415757 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a24791-3e0d-4a6a-aec6-68616bf56a2f None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:51.415879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a24791-3e0d-4a6a-aec6-68616bf56a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:51.433780 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-40a24791-3e0d-4a6a-aec6-68616bf56a2f None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:51.434975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-40a24791-3e0d-4a6a-aec6-68616bf56a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:51.443775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 684/1370] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:51.487935 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ae202-0b1e-4c24-adec-d54179e00da5 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:34:51.503081 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120ae202-0b1e-4c24-adec-d54179e00da5 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:34:51.508532 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54496d09-71f4-4f79-842d-2702015c7f10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:34:51.509178 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54496d09-71f4-4f79-842d-2702015c7f10 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:51.509498 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54496d09-71f4-4f79-842d-2702015c7f10 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:51.509786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54496d09-71f4-4f79-842d-2702015c7f10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:51.519217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54496d09-71f4-4f79-842d-2702015c7f10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:34:51.520819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54496d09-71f4-4f79-842d-2702015c7f10 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:34:51.531543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 687/1371] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:34:51.860288 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46faa1d-9770-4a20-b02e-019c3f34e76f None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:51.860762 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46faa1d-9770-4a20-b02e-019c3f34e76f None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:51.861156 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46faa1d-9770-4a20-b02e-019c3f34e76f None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:51.862865 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 685/1372] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:51.868063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50815392-12c4-4d4c-a78f-821876d62595 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:51.868357 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50815392-12c4-4d4c-a78f-821876d62595 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:51.868639 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50815392-12c4-4d4c-a78f-821876d62595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:51.887429 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-50815392-12c4-4d4c-a78f-821876d62595 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:51.888599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-50815392-12c4-4d4c-a78f-821876d62595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:51.896786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 688/1373] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:52.205022 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2bd8a-d904-4ec1-b162-4b429b96d8b6 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:52.205253 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2bd8a-d904-4ec1-b162-4b429b96d8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:52.205496 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b2bd8a-d904-4ec1-b162-4b429b96d8b6 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:52.206947 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 686/1374] 10.222.0.44 () {54 vars in 963 bytes} [Tue Jun 14 19:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:52.212455 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5182fa-9f6f-4c76-8edb-26ea20173b70 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:52.212751 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5182fa-9f6f-4c76-8edb-26ea20173b70 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:52.213038 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5182fa-9f6f-4c76-8edb-26ea20173b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:52.263650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ef5182fa-9f6f-4c76-8edb-26ea20173b70 None None] MFA Rules not processed for user `e5c2502cf1a14203bec13879a47f47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:52.265833 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ef5182fa-9f6f-4c76-8edb-26ea20173b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:52.331576 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 689/1375] 10.222.0.44 () {58 vars in 1060 bytes} [Tue Jun 14 19:34:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:52.339186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2bd8a-d904-4ec1-b162-4b429b96d8b6 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:34:52.350415 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b2bd8a-d904-4ec1-b162-4b429b96d8b6 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:34:52.353963 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d8757-e62f-4db9-afac-59e3976b36cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:34:52.354602 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d8757-e62f-4db9-afac-59e3976b36cf service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:52.354888 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d8757-e62f-4db9-afac-59e3976b36cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:52.355171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d8757-e62f-4db9-afac-59e3976b36cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:52.365202 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d8757-e62f-4db9-afac-59e3976b36cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:34:52.366679 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d8757-e62f-4db9-afac-59e3976b36cf service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:34:52.376941 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 687/1376] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:34:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:34:53.706911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c6369-a994-44b1-8464-ea95f6b38d85 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:53.707416 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c6369-a994-44b1-8464-ea95f6b38d85 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:53.707515 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c6369-a994-44b1-8464-ea95f6b38d85 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:53.708833 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 690/1377] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:53.714448 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad4998-5d62-4c95-a934-83c0348ba476 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:53.714891 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad4998-5d62-4c95-a934-83c0348ba476 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:53.715036 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad4998-5d62-4c95-a934-83c0348ba476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:53.733788 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-1aad4998-5d62-4c95-a934-83c0348ba476 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:53.734999 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-1aad4998-5d62-4c95-a934-83c0348ba476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:53.742978 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 688/1378] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:53.787135 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c6369-a994-44b1-8464-ea95f6b38d85 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:34:53.802066 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c6369-a994-44b1-8464-ea95f6b38d85 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:34:53.807548 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7788ba-6311-4b49-ab30-cebd6b44288d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:34:53.808184 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7788ba-6311-4b49-ab30-cebd6b44288d service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:53.808469 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7788ba-6311-4b49-ab30-cebd6b44288d service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:53.808747 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7788ba-6311-4b49-ab30-cebd6b44288d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:53.817563 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7788ba-6311-4b49-ab30-cebd6b44288d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:34:53.819326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7788ba-6311-4b49-ab30-cebd6b44288d service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:34:53.823522 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:34:53.831436 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 691/1379] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:34:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:34:56.028744 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248feb43-d1c2-48c1-9293-8ed2b2171a1a None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:56.029319 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248feb43-d1c2-48c1-9293-8ed2b2171a1a None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:56.029319 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248feb43-d1c2-48c1-9293-8ed2b2171a1a None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:56.031684 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 689/1380] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:56.037070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cce11-b081-4641-b4b9-3726239a3195 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:56.039499 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cce11-b081-4641-b4b9-3726239a3195 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:56.039499 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7cce11-b081-4641-b4b9-3726239a3195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:56.058893 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-bf7cce11-b081-4641-b4b9-3726239a3195 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:56.060085 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bf7cce11-b081-4641-b4b9-3726239a3195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:56.068162 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 692/1381] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:56.114095 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248feb43-d1c2-48c1-9293-8ed2b2171a1a None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:34:56.133024 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248feb43-d1c2-48c1-9293-8ed2b2171a1a None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:34:56.138477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea369488-b817-4cd1-839d-dd3a1e8a45a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:34:56.139158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea369488-b817-4cd1-839d-dd3a1e8a45a4 service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:56.139451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea369488-b817-4cd1-839d-dd3a1e8a45a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:56.139726 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea369488-b817-4cd1-839d-dd3a1e8a45a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:56.148824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea369488-b817-4cd1-839d-dd3a1e8a45a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:34:56.150443 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea369488-b817-4cd1-839d-dd3a1e8a45a4 service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:34:56.161264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 690/1382] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:34:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:34:58.504701 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92030c97-d2c8-4fac-9c9b-fe35efa8d8e6 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:58.505264 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92030c97-d2c8-4fac-9c9b-fe35efa8d8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:58.505264 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92030c97-d2c8-4fac-9c9b-fe35efa8d8e6 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:58.506725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 693/1383] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:34:58.511753 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437b1e5-b90b-4313-9579-4d6a77250270 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:58.512187 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437b1e5-b90b-4313-9579-4d6a77250270 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:58.512299 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437b1e5-b90b-4313-9579-4d6a77250270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:58.533146 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-c437b1e5-b90b-4313-9579-4d6a77250270 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:34:58.534542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c437b1e5-b90b-4313-9579-4d6a77250270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:34:58.543367 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 691/1384] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:34:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:34:58.587571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92030c97-d2c8-4fac-9c9b-fe35efa8d8e6 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:34:58.604637 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92030c97-d2c8-4fac-9c9b-fe35efa8d8e6 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:34:58.611102 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ad2b6-0488-4ad1-84f9-be467b2efa8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:34:58.611814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ad2b6-0488-4ad1-84f9-be467b2efa8b service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:34:58.612261 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ad2b6-0488-4ad1-84f9-be467b2efa8b service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:34:58.612725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ad2b6-0488-4ad1-84f9-be467b2efa8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:34:58.621969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ad2b6-0488-4ad1-84f9-be467b2efa8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:34:58.624834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ad2b6-0488-4ad1-84f9-be467b2efa8b service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:34:58.635787 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 694/1385] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:34:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:00.954246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a1011-b6c6-41f0-9312-8c6454c6bd28 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:00.954801 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a1011-b6c6-41f0-9312-8c6454c6bd28 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:00.954801 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a1011-b6c6-41f0-9312-8c6454c6bd28 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:00.956184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 692/1386] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:00.962172 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305db2b0-3716-459c-b96c-4fa0b8769b81 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:00.962698 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305db2b0-3716-459c-b96c-4fa0b8769b81 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:00.962867 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305db2b0-3716-459c-b96c-4fa0b8769b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:00.981577 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-305db2b0-3716-459c-b96c-4fa0b8769b81 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:00.983594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-305db2b0-3716-459c-b96c-4fa0b8769b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:00.991659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 695/1387] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:35:01.041649 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a1011-b6c6-41f0-9312-8c6454c6bd28 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:01.058581 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a1011-b6c6-41f0-9312-8c6454c6bd28 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:01.065725 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e5c2c2-9b0f-4370-85c1-e760e29c01d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:01.066397 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5c2c2-9b0f-4370-85c1-e760e29c01d4 service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:01.066681 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5c2c2-9b0f-4370-85c1-e760e29c01d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:01.066970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e5c2c2-9b0f-4370-85c1-e760e29c01d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:01.075742 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5c2c2-9b0f-4370-85c1-e760e29c01d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:01.077320 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e5c2c2-9b0f-4370-85c1-e760e29c01d4 service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:01.087786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 693/1388] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:03.354367 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541f798-a113-4747-a94b-8842e5059a64 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:03.354883 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541f798-a113-4747-a94b-8842e5059a64 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:03.354883 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541f798-a113-4747-a94b-8842e5059a64 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:03.356430 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 696/1389] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:35:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:03.362962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b9453-fbe4-48f4-8e9c-e7039fe048ed None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:03.363451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b9453-fbe4-48f4-8e9c-e7039fe048ed None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:03.363558 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b9453-fbe4-48f4-8e9c-e7039fe048ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:03.383412 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-c51b9453-fbe4-48f4-8e9c-e7039fe048ed None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:03.384614 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c51b9453-fbe4-48f4-8e9c-e7039fe048ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:03.395198 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 694/1390] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:35:03.442917 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541f798-a113-4747-a94b-8842e5059a64 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:03.459916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541f798-a113-4747-a94b-8842e5059a64 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:03.465601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cda93b-1739-4342-b238-a3d7daefdc18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:03.466243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cda93b-1739-4342-b238-a3d7daefdc18 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:03.466533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cda93b-1739-4342-b238-a3d7daefdc18 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:03.466821 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cda93b-1739-4342-b238-a3d7daefdc18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:03.475645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cda93b-1739-4342-b238-a3d7daefdc18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:03.477332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cda93b-1739-4342-b238-a3d7daefdc18 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:03.489605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 697/1391] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:05.807092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb56453-3dc6-4544-bbd2-758692b2a0c6 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:05.807628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb56453-3dc6-4544-bbd2-758692b2a0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:05.807628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb56453-3dc6-4544-bbd2-758692b2a0c6 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:05.809098 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 695/1392] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:05.815534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f39c2-5126-4962-bec3-f6dae67b3506 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:05.816026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f39c2-5126-4962-bec3-f6dae67b3506 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:05.816232 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f39c2-5126-4962-bec3-f6dae67b3506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:05.835416 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ad0f39c2-5126-4962-bec3-f6dae67b3506 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:05.836607 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ad0f39c2-5126-4962-bec3-f6dae67b3506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:05.845786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 698/1393] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:35:05.891348 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb56453-3dc6-4544-bbd2-758692b2a0c6 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:05.907818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb56453-3dc6-4544-bbd2-758692b2a0c6 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:05.913624 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b78b45-d135-4a4a-81f0-439bc14d1523 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:05.914268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b78b45-d135-4a4a-81f0-439bc14d1523 service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:05.914552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b78b45-d135-4a4a-81f0-439bc14d1523 service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:05.914830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b78b45-d135-4a4a-81f0-439bc14d1523 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:05.924309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b78b45-d135-4a4a-81f0-439bc14d1523 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:05.926683 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b78b45-d135-4a4a-81f0-439bc14d1523 service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:05.937296 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 696/1394] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:07.803625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adc10c-513d-43a4-87a1-708a4896f4b5 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:07.804180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adc10c-513d-43a4-87a1-708a4896f4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:07.804180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adc10c-513d-43a4-87a1-708a4896f4b5 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:07.805600 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 699/1395] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:07.812047 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862b27f-b892-4a8b-87e6-dec6d1222429 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:07.812695 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862b27f-b892-4a8b-87e6-dec6d1222429 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:07.812989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e862b27f-b892-4a8b-87e6-dec6d1222429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:07.831372 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-e862b27f-b892-4a8b-87e6-dec6d1222429 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:07.832643 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e862b27f-b892-4a8b-87e6-dec6d1222429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:07.840641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 697/1396] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:35:07.898630 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeff725-2c1e-4957-8fd2-68e433a1b099 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:07.898927 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeff725-2c1e-4957-8fd2-68e433a1b099 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:07.899261 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeff725-2c1e-4957-8fd2-68e433a1b099 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:07.900631 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 700/1397] 10.222.0.44 () {54 vars in 962 bytes} [Tue Jun 14 19:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:07.907430 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d10a9c-1de1-473e-a710-000374c9fb46 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:07.907817 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d10a9c-1de1-473e-a710-000374c9fb46 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:07.908101 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d10a9c-1de1-473e-a710-000374c9fb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:07.962232 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-b0d10a9c-1de1-473e-a710-000374c9fb46 None None] MFA Rules not processed for user `caa134b748854fb3b4de54b04390eec9`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:07.963429 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b0d10a9c-1de1-473e-a710-000374c9fb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:08.031244 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 698/1398] 10.222.0.44 () {58 vars in 1059 bytes} [Tue Jun 14 19:35:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:35:08.039130 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeff725-2c1e-4957-8fd2-68e433a1b099 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:08.052276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeff725-2c1e-4957-8fd2-68e433a1b099 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:08.056254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442edff-d866-42d9-85bf-446de02bf4e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa134b748854fb3b4de54b04390eec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:08.056840 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442edff-d866-42d9-85bf-446de02bf4e2 service glance] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:08.057120 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442edff-d866-42d9-85bf-446de02bf4e2 service glance] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:08.057426 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442edff-d866-42d9-85bf-446de02bf4e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:08.068302 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442edff-d866-42d9-85bf-446de02bf4e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:08.070242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442edff-d866-42d9-85bf-446de02bf4e2 service glance] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:08.082726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 701/1399] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:08.110035 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5ad2a-66d0-401e-96b3-9ab02f0962fa None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:08.110338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5ad2a-66d0-401e-96b3-9ab02f0962fa None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:08.110615 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5ad2a-66d0-401e-96b3-9ab02f0962fa None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:08.112071 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 699/1400] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:08.117865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fc29a-c7d1-4e74-a29f-9098c42dd015 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:08.118192 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fc29a-c7d1-4e74-a29f-9098c42dd015 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:08.118434 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885fc29a-c7d1-4e74-a29f-9098c42dd015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:08.137939 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-885fc29a-c7d1-4e74-a29f-9098c42dd015 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:08.139326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-885fc29a-c7d1-4e74-a29f-9098c42dd015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:08.147756 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 702/1401] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:35:08.195536 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5ad2a-66d0-401e-96b3-9ab02f0962fa None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:08.213606 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5ad2a-66d0-401e-96b3-9ab02f0962fa None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:08.221211 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074043c-2d70-4434-9f2c-f556c8affe8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:08.222116 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074043c-2d70-4434-9f2c-f556c8affe8c service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:08.222445 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074043c-2d70-4434-9f2c-f556c8affe8c service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:08.222785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074043c-2d70-4434-9f2c-f556c8affe8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:08.232695 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074043c-2d70-4434-9f2c-f556c8affe8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:08.234869 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074043c-2d70-4434-9f2c-f556c8affe8c service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:08.246015 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 700/1402] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:08.862554 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03573677-e5d5-4012-861f-13a2cba3c189 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:08.863284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03573677-e5d5-4012-861f-13a2cba3c189 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:08.863284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03573677-e5d5-4012-861f-13a2cba3c189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:08.921002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-03573677-e5d5-4012-861f-13a2cba3c189 None None] MFA Rules not processed for user `d16be8774cb842199cfb9e3b9965bd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:08.922668 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-03573677-e5d5-4012-861f-13a2cba3c189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:08.989469 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 703/1403] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jun 14 19:35:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:35:09.039830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b425d4-5708-4813-bbeb-23018ad0050d None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:09.040303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b425d4-5708-4813-bbeb-23018ad0050d None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:09.040492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b425d4-5708-4813-bbeb-23018ad0050d None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:09.041929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 701/1404] 10.222.0.44 () {54 vars in 942 bytes} [Tue Jun 14 19:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:09.049170 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc7f53-13ce-434b-907e-4525dbb98329 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:09.049589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc7f53-13ce-434b-907e-4525dbb98329 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:09.050064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc7f53-13ce-434b-907e-4525dbb98329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:09.107219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-05cc7f53-13ce-434b-907e-4525dbb98329 None None] MFA Rules not processed for user `7fff5414195f4873bcc8752c914b6b49`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:09.109446 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-05cc7f53-13ce-434b-907e-4525dbb98329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:09.144144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:35:09.183886 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 704/1405] 10.222.0.44 () {58 vars in 1039 bytes} [Tue Jun 14 19:35:09 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:35:09.193442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b425d4-5708-4813-bbeb-23018ad0050d None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:09.200750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:35:09.208314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b425d4-5708-4813-bbeb-23018ad0050d None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:09.213271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee27ff7f-7596-4766-86c4-c31bcfe8fc7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fff5414195f4873bcc8752c914b6b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:09.213966 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27ff7f-7596-4766-86c4-c31bcfe8fc7a service swift] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:09.214250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27ff7f-7596-4766-86c4-c31bcfe8fc7a service swift] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:09.214526 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27ff7f-7596-4766-86c4-c31bcfe8fc7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:09.223703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27ff7f-7596-4766-86c4-c31bcfe8fc7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:09.225254 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee27ff7f-7596-4766-86c4-c31bcfe8fc7a service swift] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:09.233504 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 702/1406] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jun 14 19:35:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 19:35:10.431284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a857a-6418-4e94-8cdf-a42d4554a91b None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:10.431846 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a857a-6418-4e94-8cdf-a42d4554a91b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:10.431946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a857a-6418-4e94-8cdf-a42d4554a91b None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:10.434003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 705/1407] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:35:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:10.441485 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08167373-4d4b-48af-a8ab-04a3950057e4 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:10.442015 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08167373-4d4b-48af-a8ab-04a3950057e4 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:10.442118 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08167373-4d4b-48af-a8ab-04a3950057e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:10.464814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-08167373-4d4b-48af-a8ab-04a3950057e4 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:10.468202 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-08167373-4d4b-48af-a8ab-04a3950057e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:10.489742 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 703/1408] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:35:10.526975 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a857a-6418-4e94-8cdf-a42d4554a91b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:10.542955 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a857a-6418-4e94-8cdf-a42d4554a91b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:10.549164 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9de06a-efb3-4be6-b061-25e2d9eee56d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:10.549841 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9de06a-efb3-4be6-b061-25e2d9eee56d service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:10.550131 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9de06a-efb3-4be6-b061-25e2d9eee56d service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:10.550412 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9de06a-efb3-4be6-b061-25e2d9eee56d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:10.559445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9de06a-efb3-4be6-b061-25e2d9eee56d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:10.561762 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9de06a-efb3-4be6-b061-25e2d9eee56d service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:10.572156 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 706/1409] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:20.457823 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=8 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:35:20.567844 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=21 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:35:31.627783 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b1b8c-3af2-473a-a307-d4f266df9847 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:31.628337 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b1b8c-3af2-473a-a307-d4f266df9847 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:31.628337 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34b1b8c-3af2-473a-a307-d4f266df9847 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:31.629748 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 704/1410] 10.222.0.44 () {54 vars in 918 bytes} [Tue Jun 14 19:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:31.635869 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43efe01-2645-4d45-b9a1-7df51d4d9b8b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:31.636409 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43efe01-2645-4d45-b9a1-7df51d4d9b8b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:31.636510 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43efe01-2645-4d45-b9a1-7df51d4d9b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:31.654487 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f43efe01-2645-4d45-b9a1-7df51d4d9b8b None None] MFA Rules not processed for user `e98915513674460485413c2dbee87fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:31.655721 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f43efe01-2645-4d45-b9a1-7df51d4d9b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:31.672372 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 707/1411] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Jun 14 19:35:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:35:31.689229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dc7ed-7d4c-41ab-a853-323de214a3ce None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:31.689556 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dc7ed-7d4c-41ab-a853-323de214a3ce None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:31.689838 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dc7ed-7d4c-41ab-a853-323de214a3ce None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:31.691194 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 705/1412] 10.222.0.44 () {54 vars in 918 bytes} [Tue Jun 14 19:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:31.695627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a8113-2576-4e12-b2ff-29813c3316ba None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:31.695916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a8113-2576-4e12-b2ff-29813c3316ba None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:31.696193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a8113-2576-4e12-b2ff-29813c3316ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:31.713553 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-431a8113-2576-4e12-b2ff-29813c3316ba None None] MFA Rules not processed for user `37c521e20aea4cad9758568a4f082fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:31.714722 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-431a8113-2576-4e12-b2ff-29813c3316ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:31.724222 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 708/1413] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Jun 14 19:35:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:35:34.316890 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e5c67-e9a8-4f73-b9dd-684db7099b99 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:34.317473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e5c67-e9a8-4f73-b9dd-684db7099b99 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:34.317473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e5c67-e9a8-4f73-b9dd-684db7099b99 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:34.318824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 19:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:34.323953 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a178a36-6375-4840-b067-6959e2c289c2 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:34.324408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a178a36-6375-4840-b067-6959e2c289c2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:34.324512 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a178a36-6375-4840-b067-6959e2c289c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:34.343795 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-3a178a36-6375-4840-b067-6959e2c289c2 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:34.345003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3a178a36-6375-4840-b067-6959e2c289c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:34.353142 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 19:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:35:34.396837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e5c67-e9a8-4f73-b9dd-684db7099b99 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:34.412980 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e5c67-e9a8-4f73-b9dd-684db7099b99 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:34.418501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b6deea-66e9-47f6-98e0-08ef31b82534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:34.419135 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6deea-66e9-47f6-98e0-08ef31b82534 service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:34.419419 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6deea-66e9-47f6-98e0-08ef31b82534 service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:34.419695 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b6deea-66e9-47f6-98e0-08ef31b82534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:34.428712 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6deea-66e9-47f6-98e0-08ef31b82534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:34.430319 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b6deea-66e9-47f6-98e0-08ef31b82534 service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:34.439816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 707/1416] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:35.387211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dfea3-15ee-4421-a3d1-7d2b271866aa None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:35.387783 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dfea3-15ee-4421-a3d1-7d2b271866aa None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:35.387783 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dfea3-15ee-4421-a3d1-7d2b271866aa None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:35.390033 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 19:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:35.394693 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463461a-e9ba-46bd-ae53-cc8a4a0d7983 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:35.395104 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463461a-e9ba-46bd-ae53-cc8a4a0d7983 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:35.395260 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463461a-e9ba-46bd-ae53-cc8a4a0d7983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:35.413685 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-f463461a-e9ba-46bd-ae53-cc8a4a0d7983 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:35.414866 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-f463461a-e9ba-46bd-ae53-cc8a4a0d7983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:35.422573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 19:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:35:35.572171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dfea3-15ee-4421-a3d1-7d2b271866aa None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:35.586591 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dfea3-15ee-4421-a3d1-7d2b271866aa None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:35.592967 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd62dce-02bc-47cd-a095-84e2d7a8e4e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:35.593635 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd62dce-02bc-47cd-a095-84e2d7a8e4e6 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:35.593920 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd62dce-02bc-47cd-a095-84e2d7a8e4e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:35.594199 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd62dce-02bc-47cd-a095-84e2d7a8e4e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:35.602309 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd62dce-02bc-47cd-a095-84e2d7a8e4e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:35.603887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd62dce-02bc-47cd-a095-84e2d7a8e4e6 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:35.613232 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 711/1419] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:36.543966 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3910fef-c3c4-4bb6-8ce4-6a25daeb2f34 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:36.544514 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3910fef-c3c4-4bb6-8ce4-6a25daeb2f34 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:36.544654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3910fef-c3c4-4bb6-8ce4-6a25daeb2f34 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:36.546840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 19:35:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:36.551667 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd302964-195d-41a3-b747-1e37de10c4a6 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:36.552112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd302964-195d-41a3-b747-1e37de10c4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:36.552219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd302964-195d-41a3-b747-1e37de10c4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:36.570296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-dd302964-195d-41a3-b747-1e37de10c4a6 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:36.571488 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-dd302964-195d-41a3-b747-1e37de10c4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:36.579216 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 19:35:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:35:36.736470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3910fef-c3c4-4bb6-8ce4-6a25daeb2f34 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:36.750862 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3910fef-c3c4-4bb6-8ce4-6a25daeb2f34 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:36.756297 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317fdbd-7bb5-48a5-955f-00ad8682c3f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:36.756941 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317fdbd-7bb5-48a5-955f-00ad8682c3f0 service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:36.757229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317fdbd-7bb5-48a5-955f-00ad8682c3f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:36.757549 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317fdbd-7bb5-48a5-955f-00ad8682c3f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:36.768230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317fdbd-7bb5-48a5-955f-00ad8682c3f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:36.769845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317fdbd-7bb5-48a5-955f-00ad8682c3f0 service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:36.779069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 710/1422] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:37.689963 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3aec5-c496-4f00-ac29-79a381a9ada3 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:37.690531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3aec5-c496-4f00-ac29-79a381a9ada3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:37.690531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3aec5-c496-4f00-ac29-79a381a9ada3 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:37.691862 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 19:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:37.696600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10beed06-6cbf-443d-9816-59f7381affdc None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:37.697001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10beed06-6cbf-443d-9816-59f7381affdc None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:37.697161 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10beed06-6cbf-443d-9816-59f7381affdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:37.715311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-10beed06-6cbf-443d-9816-59f7381affdc None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:37.716502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-10beed06-6cbf-443d-9816-59f7381affdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:37.724258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 19:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:35:37.875320 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3aec5-c496-4f00-ac29-79a381a9ada3 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:37.889432 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3aec5-c496-4f00-ac29-79a381a9ada3 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:37.894778 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef6f16-7dee-49ae-82b6-4914c104a9ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:37.895404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef6f16-7dee-49ae-82b6-4914c104a9ec service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:37.895689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef6f16-7dee-49ae-82b6-4914c104a9ec service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:37.895969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef6f16-7dee-49ae-82b6-4914c104a9ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:37.903943 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef6f16-7dee-49ae-82b6-4914c104a9ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:37.906079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef6f16-7dee-49ae-82b6-4914c104a9ec service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:37.915505 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 714/1425] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:38.821000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3fc82-ca64-4d82-8613-3317a65ab309 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:38.821546 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3fc82-ca64-4d82-8613-3317a65ab309 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:38.821641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3fc82-ca64-4d82-8613-3317a65ab309 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:38.822953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 19:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:38.828453 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336d1bd-c8b0-4249-9189-23f912bc1ebc None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:38.828917 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336d1bd-c8b0-4249-9189-23f912bc1ebc None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:38.829017 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336d1bd-c8b0-4249-9189-23f912bc1ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:38.846842 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-7336d1bd-c8b0-4249-9189-23f912bc1ebc None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:38.848024 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7336d1bd-c8b0-4249-9189-23f912bc1ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:38.855845 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 19:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:35:39.006925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3fc82-ca64-4d82-8613-3317a65ab309 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:39.021605 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3fc82-ca64-4d82-8613-3317a65ab309 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:39.026834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8115aab-448b-4cff-b555-b847d8c1fb29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:39.027459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8115aab-448b-4cff-b555-b847d8c1fb29 service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:39.027740 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8115aab-448b-4cff-b555-b847d8c1fb29 service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:39.028014 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8115aab-448b-4cff-b555-b847d8c1fb29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:39.036394 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8115aab-448b-4cff-b555-b847d8c1fb29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:39.038004 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8115aab-448b-4cff-b555-b847d8c1fb29 service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:39.047719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 713/1428] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:39.896864 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5c42c-39a5-4a7f-9378-f4a8eb925c7b None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:39.897415 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5c42c-39a5-4a7f-9378-f4a8eb925c7b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:39.897515 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b5c42c-39a5-4a7f-9378-f4a8eb925c7b None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:39.898803 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 19:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:39.903537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fac977-a5e8-49e4-ad0a-3d034beb03dc None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:39.903961 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fac977-a5e8-49e4-ad0a-3d034beb03dc None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:39.904074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fac977-a5e8-49e4-ad0a-3d034beb03dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:39.922316 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-d2fac977-a5e8-49e4-ad0a-3d034beb03dc None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:39.923511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-d2fac977-a5e8-49e4-ad0a-3d034beb03dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:39.931159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 19:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:35:40.083246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5c42c-39a5-4a7f-9378-f4a8eb925c7b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:40.097368 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b5c42c-39a5-4a7f-9378-f4a8eb925c7b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:40.102709 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124ae39-a991-4c83-a453-9c775df87e87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:40.103342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124ae39-a991-4c83-a453-9c775df87e87 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:40.103625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124ae39-a991-4c83-a453-9c775df87e87 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:40.103900 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124ae39-a991-4c83-a453-9c775df87e87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:40.112532 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124ae39-a991-4c83-a453-9c775df87e87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:40.114148 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124ae39-a991-4c83-a453-9c775df87e87 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:40.123383 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 717/1431] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:40.966534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7308d9-7cca-4976-a881-cdfc1ce7b6e8 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:40.967068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7308d9-7cca-4976-a881-cdfc1ce7b6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:40.967068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7308d9-7cca-4976-a881-cdfc1ce7b6e8 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:40.968985 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 19:35:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:40.973793 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3cab9-641b-4656-8c95-905d48539f22 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:40.974246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3cab9-641b-4656-8c95-905d48539f22 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:40.974346 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3cab9-641b-4656-8c95-905d48539f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:40.992408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-97c3cab9-641b-4656-8c95-905d48539f22 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:40.993585 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-97c3cab9-641b-4656-8c95-905d48539f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:41.001235 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 19:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:35:41.153110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7308d9-7cca-4976-a881-cdfc1ce7b6e8 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:41.168015 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7308d9-7cca-4976-a881-cdfc1ce7b6e8 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:41.174055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b34c3-ecf9-4040-94fc-9d72b5207eff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:41.174687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b34c3-ecf9-4040-94fc-9d72b5207eff service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:41.174973 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b34c3-ecf9-4040-94fc-9d72b5207eff service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:41.175252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b34c3-ecf9-4040-94fc-9d72b5207eff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:41.183258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b34c3-ecf9-4040-94fc-9d72b5207eff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:41.184834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b34c3-ecf9-4040-94fc-9d72b5207eff service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:41.194229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 716/1434] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:35:42.040579 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0169f12-e055-40c6-9666-47382ead2bbe None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:42.041158 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0169f12-e055-40c6-9666-47382ead2bbe None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:42.041628 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0169f12-e055-40c6-9666-47382ead2bbe None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:42.044149 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 19:35:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:42.049758 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa89ef-04ba-4aeb-bbc0-8c8b25bbd02f None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:42.050220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa89ef-04ba-4aeb-bbc0-8c8b25bbd02f None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:42.050318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa89ef-04ba-4aeb-bbc0-8c8b25bbd02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:42.069142 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-7faa89ef-04ba-4aeb-bbc0-8c8b25bbd02f None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:42.070283 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7faa89ef-04ba-4aeb-bbc0-8c8b25bbd02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:42.078330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 19:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:35:42.231089 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0169f12-e055-40c6-9666-47382ead2bbe None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:42.245889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0169f12-e055-40c6-9666-47382ead2bbe None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:42.251935 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674bcf7-5571-42f3-b26d-f9eda65ec39e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:42.252559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674bcf7-5571-42f3-b26d-f9eda65ec39e service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:42.252845 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674bcf7-5571-42f3-b26d-f9eda65ec39e service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:42.253122 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674bcf7-5571-42f3-b26d-f9eda65ec39e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:42.261107 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674bcf7-5571-42f3-b26d-f9eda65ec39e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:42.262723 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674bcf7-5571-42f3-b26d-f9eda65ec39e service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:42.271976 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 720/1437] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:43.118222 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188180c-5a57-43f3-b0a5-fa835fc78bc8 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:43.118758 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188180c-5a57-43f3-b0a5-fa835fc78bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:43.118758 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188180c-5a57-43f3-b0a5-fa835fc78bc8 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:43.120132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 19:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:43.126091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe53aa-2146-491a-afa0-76fd79bcc92b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:43.126480 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe53aa-2146-491a-afa0-76fd79bcc92b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:43.126657 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe53aa-2146-491a-afa0-76fd79bcc92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:43.144616 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-75fe53aa-2146-491a-afa0-76fd79bcc92b None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:43.145835 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-75fe53aa-2146-491a-afa0-76fd79bcc92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:43.153415 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 19:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:35:43.304303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188180c-5a57-43f3-b0a5-fa835fc78bc8 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:43.318520 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188180c-5a57-43f3-b0a5-fa835fc78bc8 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:43.323874 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509506e9-e580-423a-a41c-9f4188de2580 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:43.324505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509506e9-e580-423a-a41c-9f4188de2580 service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:43.324790 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509506e9-e580-423a-a41c-9f4188de2580 service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:43.325071 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509506e9-e580-423a-a41c-9f4188de2580 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:43.333159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509506e9-e580-423a-a41c-9f4188de2580 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:43.334776 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509506e9-e580-423a-a41c-9f4188de2580 service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:43.344633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 719/1440] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:45.371350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd158c88-0e69-428b-98db-79d331e275f0 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:45.371962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd158c88-0e69-428b-98db-79d331e275f0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:45.371962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd158c88-0e69-428b-98db-79d331e275f0 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:45.373274 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 19:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:45.379096 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93944326-c871-4e12-9f1e-135c130204b4 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:45.379515 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93944326-c871-4e12-9f1e-135c130204b4 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:45.379656 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93944326-c871-4e12-9f1e-135c130204b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:45.397666 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-93944326-c871-4e12-9f1e-135c130204b4 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:45.398869 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-93944326-c871-4e12-9f1e-135c130204b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:45.407482 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 19:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:35:45.445468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd158c88-0e69-428b-98db-79d331e275f0 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:45.456533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd158c88-0e69-428b-98db-79d331e275f0 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:45.460083 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7955a-5812-418b-a6c0-f54ae609d56a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:45.460714 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7955a-5812-418b-a6c0-f54ae609d56a service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:45.460999 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7955a-5812-418b-a6c0-f54ae609d56a service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:45.461285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7955a-5812-418b-a6c0-f54ae609d56a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:45.470690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7955a-5812-418b-a6c0-f54ae609d56a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:45.472113 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7955a-5812-418b-a6c0-f54ae609d56a service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:45.481361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 723/1443] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:47.777996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4085e-c0a7-4c89-ab89-c64b79b4f592 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:47.778549 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4085e-c0a7-4c89-ab89-c64b79b4f592 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:47.778549 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4085e-c0a7-4c89-ab89-c64b79b4f592 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:47.780623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 19:35:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:47.786562 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d6fee-213e-476f-b21c-a790b467bec5 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:47.787000 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d6fee-213e-476f-b21c-a790b467bec5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:47.787176 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d6fee-213e-476f-b21c-a790b467bec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:47.805704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-289d6fee-213e-476f-b21c-a790b467bec5 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:47.806899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-289d6fee-213e-476f-b21c-a790b467bec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:47.815732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 19:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:35:47.856240 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4085e-c0a7-4c89-ab89-c64b79b4f592 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:47.867678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4085e-c0a7-4c89-ab89-c64b79b4f592 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:47.871176 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60e55d-a4e7-4bb8-ab2a-ae0c752bafc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:47.871799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60e55d-a4e7-4bb8-ab2a-ae0c752bafc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:47.872078 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60e55d-a4e7-4bb8-ab2a-ae0c752bafc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:47.872350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60e55d-a4e7-4bb8-ab2a-ae0c752bafc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:47.881136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60e55d-a4e7-4bb8-ab2a-ae0c752bafc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:47.882538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60e55d-a4e7-4bb8-ab2a-ae0c752bafc1 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:47.892018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 722/1446] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:50.365810 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8882bd7-86aa-49d2-ba6f-566f81926066 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:50.366375 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8882bd7-86aa-49d2-ba6f-566f81926066 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:50.366375 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8882bd7-86aa-49d2-ba6f-566f81926066 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:50.367755 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 19:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 14 19:35:50.373170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ca4b9-245c-4556-b9db-2da73362c3b9 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:50.373704 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ca4b9-245c-4556-b9db-2da73362c3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:50.373807 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ca4b9-245c-4556-b9db-2da73362c3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:50.391589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-af5ca4b9-245c-4556-b9db-2da73362c3b9 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:50.392766 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-af5ca4b9-245c-4556-b9db-2da73362c3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:50.400926 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 19:35:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:35:50.439914 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8882bd7-86aa-49d2-ba6f-566f81926066 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:50.450501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8882bd7-86aa-49d2-ba6f-566f81926066 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:50.454615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcf4b8e-997c-41f6-93f7-12333dd0d991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:50.455239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf4b8e-997c-41f6-93f7-12333dd0d991 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:50.455522 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf4b8e-997c-41f6-93f7-12333dd0d991 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:50.455796 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf4b8e-997c-41f6-93f7-12333dd0d991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:50.464428 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf4b8e-997c-41f6-93f7-12333dd0d991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:50.465880 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcf4b8e-997c-41f6-93f7-12333dd0d991 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:50.475957 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 726/1449] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:52.722237 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a1f93-9930-43b4-a63d-0018f6901d29 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:52.722798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a1f93-9930-43b4-a63d-0018f6901d29 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:52.722798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a1f93-9930-43b4-a63d-0018f6901d29 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:52.724208 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 19:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:52.729665 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c117d5-cf7b-40b2-8950-35ea2fb381e0 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:52.730102 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c117d5-cf7b-40b2-8950-35ea2fb381e0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:52.730277 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c117d5-cf7b-40b2-8950-35ea2fb381e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:52.748664 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c5c117d5-cf7b-40b2-8950-35ea2fb381e0 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:52.750202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c5c117d5-cf7b-40b2-8950-35ea2fb381e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:52.758418 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 19:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:35:52.799364 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a1f93-9930-43b4-a63d-0018f6901d29 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:52.801164 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-a83a1f93-9930-43b4-a63d-0018f6901d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:52.815139 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a1f93-9930-43b4-a63d-0018f6901d29 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:52.818849 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24791cec-bc6d-4a3a-a83c-a20d63652c87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:52.819506 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24791cec-bc6d-4a3a-a83c-a20d63652c87 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:52.819794 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24791cec-bc6d-4a3a-a83c-a20d63652c87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:52.820077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24791cec-bc6d-4a3a-a83c-a20d63652c87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:52.830490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24791cec-bc6d-4a3a-a83c-a20d63652c87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:52.831921 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24791cec-bc6d-4a3a-a83c-a20d63652c87 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:52.841598 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 725/1452] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:55.114428 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d3e66-b59b-42da-8491-ff69c0e3de89 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:55.114970 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d3e66-b59b-42da-8491-ff69c0e3de89 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:55.114970 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d3e66-b59b-42da-8491-ff69c0e3de89 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:55.116286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 19:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:55.121531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a083f11-9191-441f-b6a7-c37567eb8089 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:55.121958 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a083f11-9191-441f-b6a7-c37567eb8089 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:55.122101 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a083f11-9191-441f-b6a7-c37567eb8089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:55.140135 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-8a083f11-9191-441f-b6a7-c37567eb8089 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:55.141313 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-8a083f11-9191-441f-b6a7-c37567eb8089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:55.148902 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 19:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:35:55.186830 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d3e66-b59b-42da-8491-ff69c0e3de89 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:55.197671 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d3e66-b59b-42da-8491-ff69c0e3de89 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:55.201171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458c4ba-a88c-4748-b22e-0e6d716e737c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:55.201864 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458c4ba-a88c-4748-b22e-0e6d716e737c service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:55.202230 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458c4ba-a88c-4748-b22e-0e6d716e737c service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:55.202426 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458c4ba-a88c-4748-b22e-0e6d716e737c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:55.211178 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458c4ba-a88c-4748-b22e-0e6d716e737c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:55.212610 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458c4ba-a88c-4748-b22e-0e6d716e737c service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:55.222786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 729/1455] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:57.462689 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48f904-233b-439e-a8bc-c60b21ee6ce1 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:57.463263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48f904-233b-439e-a8bc-c60b21ee6ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:57.463263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48f904-233b-439e-a8bc-c60b21ee6ce1 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:57.464616 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 19:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:57.469903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c84fc5-4289-4091-b58d-71f84097ab57 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:57.470354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c84fc5-4289-4091-b58d-71f84097ab57 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:57.470463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c84fc5-4289-4091-b58d-71f84097ab57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:57.488024 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a0c84fc5-4289-4091-b58d-71f84097ab57 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:57.489198 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a0c84fc5-4289-4091-b58d-71f84097ab57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:57.496725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 19:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:35:57.535082 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48f904-233b-439e-a8bc-c60b21ee6ce1 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:57.545584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48f904-233b-439e-a8bc-c60b21ee6ce1 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:57.549019 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3738cf14-ff49-4c5e-aa86-f27083e28004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:57.549678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738cf14-ff49-4c5e-aa86-f27083e28004 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:57.549962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738cf14-ff49-4c5e-aa86-f27083e28004 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:57.550235 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3738cf14-ff49-4c5e-aa86-f27083e28004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:57.558820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738cf14-ff49-4c5e-aa86-f27083e28004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:57.560229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3738cf14-ff49-4c5e-aa86-f27083e28004 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:57.569756 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 728/1458] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:35:59.741055 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1c1d4-229e-439b-b4fc-f0167a39ae33 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:59.741055 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1c1d4-229e-439b-b4fc-f0167a39ae33 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:59.742139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1c1d4-229e-439b-b4fc-f0167a39ae33 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:59.743047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 19:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:35:59.748420 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ec244-6b76-43d3-a5bc-4d0024abdaeb None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:59.748851 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ec244-6b76-43d3-a5bc-4d0024abdaeb None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:59.748981 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ec244-6b76-43d3-a5bc-4d0024abdaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:59.766487 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-1a9ec244-6b76-43d3-a5bc-4d0024abdaeb None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:35:59.767683 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-1a9ec244-6b76-43d3-a5bc-4d0024abdaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:35:59.775321 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 19:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:35:59.812410 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1c1d4-229e-439b-b4fc-f0167a39ae33 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:35:59.823628 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1c1d4-229e-439b-b4fc-f0167a39ae33 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:35:59.827142 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022188f-9ad8-40b4-88cb-24ba74e799c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:35:59.827777 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022188f-9ad8-40b4-88cb-24ba74e799c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:35:59.828060 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022188f-9ad8-40b4-88cb-24ba74e799c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:35:59.828337 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022188f-9ad8-40b4-88cb-24ba74e799c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:35:59.837206 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022188f-9ad8-40b4-88cb-24ba74e799c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:35:59.838657 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022188f-9ad8-40b4-88cb-24ba74e799c3 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:35:59.848469 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 732/1461] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:35:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:36:02.015649 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c8ef8-1868-4265-9a47-2fa87eb837ac None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:02.016221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c8ef8-1868-4265-9a47-2fa87eb837ac None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:02.016221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054c8ef8-1868-4265-9a47-2fa87eb837ac None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:02.017626 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 19:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:36:02.022866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb061b3-7bb5-478f-8072-4dac90eddb5d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:02.023296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb061b3-7bb5-478f-8072-4dac90eddb5d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:02.023429 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb061b3-7bb5-478f-8072-4dac90eddb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:02.029442 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=79 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:36:02.042517 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1cb061b3-7bb5-478f-8072-4dac90eddb5d None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:36:02.043703 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1cb061b3-7bb5-478f-8072-4dac90eddb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:36:02.052282 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 19:36:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:36:02.089701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c8ef8-1868-4265-9a47-2fa87eb837ac None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:36:02.095659 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=73 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:36:02.102054 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054c8ef8-1868-4265-9a47-2fa87eb837ac None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:36:02.105582 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e0848-417a-424d-91ee-78711c21df43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:36:02.106218 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e0848-417a-424d-91ee-78711c21df43 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:02.106503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e0848-417a-424d-91ee-78711c21df43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:02.106780 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e0848-417a-424d-91ee-78711c21df43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:02.116408 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e0848-417a-424d-91ee-78711c21df43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:36:02.117947 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e0848-417a-424d-91ee-78711c21df43 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:36:02.127310 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 731/1464] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:36:04.326104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cbc36-9ec2-471c-982d-c5ad484f8f59 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:04.327227 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cbc36-9ec2-471c-982d-c5ad484f8f59 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:04.327340 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cbc36-9ec2-471c-982d-c5ad484f8f59 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:04.328667 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 19:36:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:36:04.333956 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf999a3-31a7-47dd-8b3a-af23132fc339 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:04.334387 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf999a3-31a7-47dd-8b3a-af23132fc339 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:04.334503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf999a3-31a7-47dd-8b3a-af23132fc339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:04.351930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-daf999a3-31a7-47dd-8b3a-af23132fc339 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:36:04.353118 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-daf999a3-31a7-47dd-8b3a-af23132fc339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:36:04.361195 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 19:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:36:04.397726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cbc36-9ec2-471c-982d-c5ad484f8f59 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:36:04.408640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cbc36-9ec2-471c-982d-c5ad484f8f59 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:36:04.412194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69325bc6-2667-453d-8fe1-c386ae085ae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:36:04.412822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69325bc6-2667-453d-8fe1-c386ae085ae9 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:04.413103 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69325bc6-2667-453d-8fe1-c386ae085ae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:04.413398 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69325bc6-2667-453d-8fe1-c386ae085ae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:04.422453 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69325bc6-2667-453d-8fe1-c386ae085ae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:36:04.423868 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69325bc6-2667-453d-8fe1-c386ae085ae9 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:36:04.433138 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 735/1467] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:36:06.559288 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc799d-bf9e-4e23-8417-9b67661c7850 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:06.559851 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc799d-bf9e-4e23-8417-9b67661c7850 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:06.559851 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc799d-bf9e-4e23-8417-9b67661c7850 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:06.561802 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 19:36:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:36:06.567004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bb4cd-e8d0-4b7b-bd62-ee56390f0ab7 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:06.567405 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bb4cd-e8d0-4b7b-bd62-ee56390f0ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:06.567564 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bb4cd-e8d0-4b7b-bd62-ee56390f0ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:06.585248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a17bb4cd-e8d0-4b7b-bd62-ee56390f0ab7 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:36:06.586462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a17bb4cd-e8d0-4b7b-bd62-ee56390f0ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:36:06.594288 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 19:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:36:06.632512 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc799d-bf9e-4e23-8417-9b67661c7850 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:36:06.643067 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc799d-bf9e-4e23-8417-9b67661c7850 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:36:06.646511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdecbd7-3c82-455b-bab9-52c0024db523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:36:06.647140 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdecbd7-3c82-455b-bab9-52c0024db523 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:06.647425 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdecbd7-3c82-455b-bab9-52c0024db523 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:06.647711 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdecbd7-3c82-455b-bab9-52c0024db523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:06.656912 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdecbd7-3c82-455b-bab9-52c0024db523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:36:06.658632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdecbd7-3c82-455b-bab9-52c0024db523 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:36:06.667835 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 734/1470] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:36:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:36:16.580369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=11 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:36:16.663711 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=14 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:36:26.805569 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77bf06-3c02-4bd3-af3e-df92509bd312 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:26.806088 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77bf06-3c02-4bd3-af3e-df92509bd312 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:26.806203 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77bf06-3c02-4bd3-af3e-df92509bd312 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:26.807497 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 737/1471] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:36:26.813330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367073d1-083e-4330-a5a4-69c8456b3c4d None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:26.813834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367073d1-083e-4330-a5a4-69c8456b3c4d None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:26.813936 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367073d1-083e-4330-a5a4-69c8456b3c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:26.832478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-367073d1-083e-4330-a5a4-69c8456b3c4d None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:36:26.833717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-367073d1-083e-4330-a5a4-69c8456b3c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:36:26.841507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 735/1472] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:36:26.888872 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb0b15-4376-48bd-88f3-8714d4401ce1 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:26.889161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb0b15-4376-48bd-88f3-8714d4401ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:26.889499 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb0b15-4376-48bd-88f3-8714d4401ce1 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:26.890860 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 738/1473] 10.222.0.44 () {54 vars in 962 bytes} [Tue Jun 14 19:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:36:26.895659 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e879d9-c816-4bd8-9b4f-af963e4ca9a0 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:26.895953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e879d9-c816-4bd8-9b4f-af963e4ca9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:26.896240 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e879d9-c816-4bd8-9b4f-af963e4ca9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:26.914625 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-30e879d9-c816-4bd8-9b4f-af963e4ca9a0 None None] MFA Rules not processed for user `caa134b748854fb3b4de54b04390eec9`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:36:26.915818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-30e879d9-c816-4bd8-9b4f-af963e4ca9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:36:26.923050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 736/1474] 10.222.0.44 () {58 vars in 1059 bytes} [Tue Jun 14 19:36:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:36:26.930342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb0b15-4376-48bd-88f3-8714d4401ce1 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:36:26.940718 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb0b15-4376-48bd-88f3-8714d4401ce1 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:36:26.944225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d400a79-d209-40ce-ba26-7e063ffe77fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa134b748854fb3b4de54b04390eec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:36:26.944839 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d400a79-d209-40ce-ba26-7e063ffe77fc service glance] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:26.945122 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d400a79-d209-40ce-ba26-7e063ffe77fc service glance] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:26.945423 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d400a79-d209-40ce-ba26-7e063ffe77fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:26.954271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d400a79-d209-40ce-ba26-7e063ffe77fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:36:26.955697 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d400a79-d209-40ce-ba26-7e063ffe77fc service glance] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:36:26.964907 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 739/1475] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:36:29.187394 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8041cb-3433-40f1-8598-91e5426c517b None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:29.187920 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8041cb-3433-40f1-8598-91e5426c517b None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:29.187920 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8041cb-3433-40f1-8598-91e5426c517b None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:29.189260 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 737/1476] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:36:29.194618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff83b1-c478-45f7-ad92-0fd9e95683b1 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:29.195009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff83b1-c478-45f7-ad92-0fd9e95683b1 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:29.195182 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff83b1-c478-45f7-ad92-0fd9e95683b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:29.212636 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f3ff83b1-c478-45f7-ad92-0fd9e95683b1 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:36:29.213861 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f3ff83b1-c478-45f7-ad92-0fd9e95683b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:36:29.222280 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 740/1477] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:36:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:36:29.246028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8041cb-3433-40f1-8598-91e5426c517b None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:36:29.258285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8041cb-3433-40f1-8598-91e5426c517b None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:36:29.262612 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6cb4a5-88d3-4fa1-a232-babc53dd828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:36:29.263253 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cb4a5-88d3-4fa1-a232-babc53dd828f admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:29.263535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cb4a5-88d3-4fa1-a232-babc53dd828f admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:29.264309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6cb4a5-88d3-4fa1-a232-babc53dd828f admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:29.265034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6cb4a5-88d3-4fa1-a232-babc53dd828f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:36:29.266798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: WARNING py.warnings [None req-3c6cb4a5-88d3-4fa1-a232-babc53dd828f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:36:29.266798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: warnings.warn(msg) Jun 14 19:36:29.266798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: Jun 14 19:36:29.267918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6cb4a5-88d3-4fa1-a232-babc53dd828f admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:36:29.287578 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 738/1478] 10.222.0.44 () {56 vars in 1108 bytes} [Tue Jun 14 19:36:29 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:36:31.438017 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec43023-c40c-49fb-854f-84082c563aa3 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:31.438544 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec43023-c40c-49fb-854f-84082c563aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:31.438544 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec43023-c40c-49fb-854f-84082c563aa3 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:31.439829 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 741/1479] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:36:31.445479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e731cd6-52f9-4141-bdb8-66bff9f64d8f None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:31.445962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e731cd6-52f9-4141-bdb8-66bff9f64d8f None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:31.446092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e731cd6-52f9-4141-bdb8-66bff9f64d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:31.465696 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-0e731cd6-52f9-4141-bdb8-66bff9f64d8f None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:36:31.466993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-0e731cd6-52f9-4141-bdb8-66bff9f64d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:36:31.475358 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 739/1480] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:36:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:36:31.520234 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec43023-c40c-49fb-854f-84082c563aa3 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:36:31.535410 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec43023-c40c-49fb-854f-84082c563aa3 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:36:31.540916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c78466-4abe-44b8-9ce0-79e11f05b22f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:36:31.541596 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c78466-4abe-44b8-9ce0-79e11f05b22f service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:31.541886 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c78466-4abe-44b8-9ce0-79e11f05b22f service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:31.542171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c78466-4abe-44b8-9ce0-79e11f05b22f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:31.551467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c78466-4abe-44b8-9ce0-79e11f05b22f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:36:31.553060 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c78466-4abe-44b8-9ce0-79e11f05b22f service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:36:31.563691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 742/1481] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:36:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:36:33.948727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84df502-a1f4-4ea3-a62e-8fcba9796eb5 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:33.949323 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84df502-a1f4-4ea3-a62e-8fcba9796eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:33.949323 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84df502-a1f4-4ea3-a62e-8fcba9796eb5 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:33.950700 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 740/1482] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:36:33.956599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d445f-0fbb-46f8-8759-ea152061f97c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:33.957013 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d445f-0fbb-46f8-8759-ea152061f97c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:33.957188 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d445f-0fbb-46f8-8759-ea152061f97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:33.975147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-185d445f-0fbb-46f8-8759-ea152061f97c None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:36:33.976336 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-185d445f-0fbb-46f8-8759-ea152061f97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:36:33.984036 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 743/1483] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:36:34.020104 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84df502-a1f4-4ea3-a62e-8fcba9796eb5 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:36:34.031399 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84df502-a1f4-4ea3-a62e-8fcba9796eb5 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:36:34.035157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb75114-7bf8-4c75-aca7-7932061a01dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:36:34.035787 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb75114-7bf8-4c75-aca7-7932061a01dc service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:34.036077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb75114-7bf8-4c75-aca7-7932061a01dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:34.036358 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb75114-7bf8-4c75-aca7-7932061a01dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:34.045098 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb75114-7bf8-4c75-aca7-7932061a01dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:36:34.046705 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb75114-7bf8-4c75-aca7-7932061a01dc service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:36:34.056074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 741/1484] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:36:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:36:36.230186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4782d-33f1-4b3e-8b04-8b07d1744c60 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:36.230763 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4782d-33f1-4b3e-8b04-8b07d1744c60 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:36.230870 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4782d-33f1-4b3e-8b04-8b07d1744c60 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:36.232190 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 744/1485] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:36:36.237511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5ed9b-5063-415b-8ad1-4cfc44c35fe6 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:36.237921 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5ed9b-5063-415b-8ad1-4cfc44c35fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:36.238088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5ed9b-5063-415b-8ad1-4cfc44c35fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:36.257292 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-ecc5ed9b-5063-415b-8ad1-4cfc44c35fe6 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:36:36.258543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-ecc5ed9b-5063-415b-8ad1-4cfc44c35fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:36:36.267146 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 742/1486] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:36:36.306003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4782d-33f1-4b3e-8b04-8b07d1744c60 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:36:36.317356 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4782d-33f1-4b3e-8b04-8b07d1744c60 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:36:36.320923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06168d23-4bc6-4b4c-b829-7d37064bb8b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:36:36.321609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06168d23-4bc6-4b4c-b829-7d37064bb8b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:36.321897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06168d23-4bc6-4b4c-b829-7d37064bb8b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:36.322178 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06168d23-4bc6-4b4c-b829-7d37064bb8b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:36.331629 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06168d23-4bc6-4b4c-b829-7d37064bb8b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:36:36.333060 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06168d23-4bc6-4b4c-b829-7d37064bb8b8 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:36:36.342501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 745/1487] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:36:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:36:38.618971 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb46b5e-e07b-4b46-85bb-1a7a0fb75b42 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:38.619561 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb46b5e-e07b-4b46-85bb-1a7a0fb75b42 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:38.619561 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb46b5e-e07b-4b46-85bb-1a7a0fb75b42 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:38.620902 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 743/1488] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:36:38.626475 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd897e6-c5cb-4dfd-9118-69fe973e6304 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:38.626895 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd897e6-c5cb-4dfd-9118-69fe973e6304 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:38.627036 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd897e6-c5cb-4dfd-9118-69fe973e6304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:38.644876 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ccd897e6-c5cb-4dfd-9118-69fe973e6304 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:36:38.646120 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ccd897e6-c5cb-4dfd-9118-69fe973e6304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:36:38.653821 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 746/1489] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:36:38.694832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb46b5e-e07b-4b46-85bb-1a7a0fb75b42 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:36:38.705537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb46b5e-e07b-4b46-85bb-1a7a0fb75b42 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:36:38.708977 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcce79-dd30-47b8-b1ae-48a9408314f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:36:38.709625 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcce79-dd30-47b8-b1ae-48a9408314f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:38.709906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcce79-dd30-47b8-b1ae-48a9408314f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:38.710180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcce79-dd30-47b8-b1ae-48a9408314f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:38.719416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcce79-dd30-47b8-b1ae-48a9408314f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:36:38.720811 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcce79-dd30-47b8-b1ae-48a9408314f2 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:36:38.729912 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 744/1490] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:36:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:36:41.043929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206fe21-2b57-4146-a6c0-3c8f8770c05d None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:41.044458 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206fe21-2b57-4146-a6c0-3c8f8770c05d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:41.044458 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206fe21-2b57-4146-a6c0-3c8f8770c05d None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:41.045902 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 747/1491] 10.222.0.44 () {54 vars in 926 bytes} [Tue Jun 14 19:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:36:41.051489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0198eb0-e785-4a49-85f4-5cd97f67544c None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:41.051894 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0198eb0-e785-4a49-85f4-5cd97f67544c None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:41.052045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0198eb0-e785-4a49-85f4-5cd97f67544c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:41.069395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-b0198eb0-e785-4a49-85f4-5cd97f67544c None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:36:41.070577 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b0198eb0-e785-4a49-85f4-5cd97f67544c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:36:41.078405 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 745/1492] 10.222.0.44 () {58 vars in 1023 bytes} [Tue Jun 14 19:36:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:36:41.117221 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206fe21-2b57-4146-a6c0-3c8f8770c05d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:36:41.127844 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206fe21-2b57-4146-a6c0-3c8f8770c05d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:36:41.131312 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236acbeb-7eac-4043-bdc5-bc574117ded3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:36:41.131937 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236acbeb-7eac-4043-bdc5-bc574117ded3 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:36:41.132222 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236acbeb-7eac-4043-bdc5-bc574117ded3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:36:41.132501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236acbeb-7eac-4043-bdc5-bc574117ded3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:36:41.141298 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236acbeb-7eac-4043-bdc5-bc574117ded3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:36:41.142735 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236acbeb-7eac-4043-bdc5-bc574117ded3 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:36:41.151940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 748/1493] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:36:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:36:51.064352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=33 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:36:51.147921 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=33 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:38:08.800545 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07768d-b857-491f-ae0f-9a0852157804 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:38:08.801185 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07768d-b857-491f-ae0f-9a0852157804 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:38:08.801185 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07768d-b857-491f-ae0f-9a0852157804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:38:08.819825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-ee07768d-b857-491f-ae0f-9a0852157804 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:38:08.821031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-ee07768d-b857-491f-ae0f-9a0852157804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:38:08.829511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 746/1494] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:38:08.838739 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bdbb9-5a4a-46c1-a7c0-d5d7bac9a054 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:38:08.839267 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bdbb9-5a4a-46c1-a7c0-d5d7bac9a054 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:38:08.839369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bdbb9-5a4a-46c1-a7c0-d5d7bac9a054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:38:08.857651 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-627bdbb9-5a4a-46c1-a7c0-d5d7bac9a054 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:38:08.858845 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-627bdbb9-5a4a-46c1-a7c0-d5d7bac9a054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:38:08.866617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 749/1495] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:38:08.871211 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07768d-b857-491f-ae0f-9a0852157804 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:38:08.881184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07768d-b857-491f-ae0f-9a0852157804 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:38:08.885654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a701930-f678-42f5-99dc-c3f4b0878219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:38:08.886300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a701930-f678-42f5-99dc-c3f4b0878219 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:38:08.886584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a701930-f678-42f5-99dc-c3f4b0878219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:38:08.886861 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a701930-f678-42f5-99dc-c3f4b0878219 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:38:08.887591 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a701930-f678-42f5-99dc-c3f4b0878219 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:38:08.888448 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a701930-f678-42f5-99dc-c3f4b0878219 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:38:08.889477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: WARNING py.warnings [None req-9a701930-f678-42f5-99dc-c3f4b0878219 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:38:08.889477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: warnings.warn(msg) Jun 14 19:38:08.889477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: Jun 14 19:38:08.890417 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a701930-f678-42f5-99dc-c3f4b0878219 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:38:08.901753 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 747/1496] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:38:08.910211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627bdbb9-5a4a-46c1-a7c0-d5d7bac9a054 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:38:08.919254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627bdbb9-5a4a-46c1-a7c0-d5d7bac9a054 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:38:08.923773 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b4b9c-acc5-45d4-a428-5e413ac883d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:38:08.924415 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b4b9c-acc5-45d4-a428-5e413ac883d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:38:08.924702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b4b9c-acc5-45d4-a428-5e413ac883d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:38:08.924983 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b4b9c-acc5-45d4-a428-5e413ac883d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:38:08.925716 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b4b9c-acc5-45d4-a428-5e413ac883d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:38:08.927505 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: WARNING py.warnings [None req-a24b4b9c-acc5-45d4-a428-5e413ac883d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:38:08.927505 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: warnings.warn(msg) Jun 14 19:38:08.927505 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: Jun 14 19:38:08.928697 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b4b9c-acc5-45d4-a428-5e413ac883d2 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:38:08.965735 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 750/1497] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:38:08 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:38:08.970097 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a701930-f678-42f5-99dc-c3f4b0878219 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:38:08.979734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a701930-f678-42f5-99dc-c3f4b0878219 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:38:09.036384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820d8b6-a3ee-433f-b2d7-5c8813242d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:38:09.037041 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820d8b6-a3ee-433f-b2d7-5c8813242d22 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:38:09.037323 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820d8b6-a3ee-433f-b2d7-5c8813242d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:38:09.037627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820d8b6-a3ee-433f-b2d7-5c8813242d22 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:38:09.038316 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820d8b6-a3ee-433f-b2d7-5c8813242d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:38:09.039311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: WARNING py.warnings [None req-3820d8b6-a3ee-433f-b2d7-5c8813242d22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:38:09.039311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: warnings.warn(msg) Jun 14 19:38:09.039311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: Jun 14 19:38:09.040506 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820d8b6-a3ee-433f-b2d7-5c8813242d22 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:38:09.061105 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 748/1498] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:38:08 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:38:09.065264 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b4b9c-acc5-45d4-a428-5e413ac883d2 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:38:09.075461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b4b9c-acc5-45d4-a428-5e413ac883d2 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:38:09.080038 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e09ddd-ff12-4a16-9213-35cb1e6eac4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:38:09.080690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e09ddd-ff12-4a16-9213-35cb1e6eac4f admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:38:09.080975 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e09ddd-ff12-4a16-9213-35cb1e6eac4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:38:09.081253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e09ddd-ff12-4a16-9213-35cb1e6eac4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:38:09.082010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e09ddd-ff12-4a16-9213-35cb1e6eac4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:38:09.083023 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: WARNING py.warnings [None req-f4e09ddd-ff12-4a16-9213-35cb1e6eac4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:38:09.083023 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: warnings.warn(msg) Jun 14 19:38:09.083023 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: Jun 14 19:38:09.083920 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e09ddd-ff12-4a16-9213-35cb1e6eac4f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:38:09.096748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 751/1499] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:38:09.100727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820d8b6-a3ee-433f-b2d7-5c8813242d22 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:38:09.111058 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820d8b6-a3ee-433f-b2d7-5c8813242d22 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:38:09.115913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73f618-5c22-4a38-86ad-b28305e98554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:38:09.116567 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73f618-5c22-4a38-86ad-b28305e98554 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:38:09.116854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73f618-5c22-4a38-86ad-b28305e98554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:38:09.117137 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73f618-5c22-4a38-86ad-b28305e98554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:38:09.117905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73f618-5c22-4a38-86ad-b28305e98554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:38:09.118935 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: WARNING py.warnings [None req-6b73f618-5c22-4a38-86ad-b28305e98554 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:38:09.118935 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: warnings.warn(msg) Jun 14 19:38:09.118935 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: Jun 14 19:38:09.119812 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73f618-5c22-4a38-86ad-b28305e98554 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:38:09.133727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 749/1500] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:38:09.137927 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e09ddd-ff12-4a16-9213-35cb1e6eac4f admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:38:09.147951 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e09ddd-ff12-4a16-9213-35cb1e6eac4f admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:38:09.152471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377a6b6-0171-4604-a4e3-e4f71e69a15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:38:09.153433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377a6b6-0171-4604-a4e3-e4f71e69a15b admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:38:09.153883 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377a6b6-0171-4604-a4e3-e4f71e69a15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:38:09.154175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377a6b6-0171-4604-a4e3-e4f71e69a15b admin admin] PATH_INFO: `/v3/projects/60a96a97178942c58f5e548bcab5e0d9/users/a691e7a214cd4efb92a32a65970c8bee/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:38:09.168845 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377a6b6-0171-4604-a4e3-e4f71e69a15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a96a97178942c58f5e548bcab5e0d9, user_id=a691e7a214cd4efb92a32a65970c8bee, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:38:09.170435 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: WARNING py.warnings [None req-2377a6b6-0171-4604-a4e3-e4f71e69a15b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:38:09.170435 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: warnings.warn(msg) Jun 14 19:38:09.170435 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: Jun 14 19:38:09.172370 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2377a6b6-0171-4604-a4e3-e4f71e69a15b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:38:09.185420 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 752/1501] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:38:09 2022] PUT /identity/v3/projects/60a96a97178942c58f5e548bcab5e0d9/users/a691e7a214cd4efb92a32a65970c8bee/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:38:09.196814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8845b69-7dda-4925-8189-6904c1d53a10 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:38:09.197107 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8845b69-7dda-4925-8189-6904c1d53a10 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:38:09.197410 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8845b69-7dda-4925-8189-6904c1d53a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:38:09.222899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-c8845b69-7dda-4925-8189-6904c1d53a10 None None] MFA Rules not processed for user `a691e7a214cd4efb92a32a65970c8bee`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:38:09.224107 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c8845b69-7dda-4925-8189-6904c1d53a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:38:09.287731 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 750/1502] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:38:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:38:09.301394 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd8762-1983-47cd-9ecf-521fc2003eae None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:38:09.301718 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd8762-1983-47cd-9ecf-521fc2003eae None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:38:09.302003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dd8762-1983-47cd-9ecf-521fc2003eae None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:38:09.303374 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 753/1503] 10.222.0.44 () {54 vars in 963 bytes} [Tue Jun 14 19:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:38:09.308341 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30629ac-b113-4637-a72e-7eb94eee9423 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:38:09.308636 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30629ac-b113-4637-a72e-7eb94eee9423 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:38:09.308919 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30629ac-b113-4637-a72e-7eb94eee9423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:38:09.326940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-a30629ac-b113-4637-a72e-7eb94eee9423 None None] MFA Rules not processed for user `e5c2502cf1a14203bec13879a47f47ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:38:09.328061 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-a30629ac-b113-4637-a72e-7eb94eee9423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:38:09.370788 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:38:09.379000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 751/1504] 10.222.0.44 () {58 vars in 1060 bytes} [Tue Jun 14 19:38:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:38:09.386582 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd8762-1983-47cd-9ecf-521fc2003eae None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:38:09.397109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dd8762-1983-47cd-9ecf-521fc2003eae None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:38:09.400633 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0e30c-971b-456d-9a7f-12ab9f2212eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:38:09.401262 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0e30c-971b-456d-9a7f-12ab9f2212eb service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:38:09.401582 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0e30c-971b-456d-9a7f-12ab9f2212eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:38:09.401865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0e30c-971b-456d-9a7f-12ab9f2212eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:38:09.411100 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0e30c-971b-456d-9a7f-12ab9f2212eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:38:09.412517 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0e30c-971b-456d-9a7f-12ab9f2212eb service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:38:09.422112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 754/1505] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:38:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:38:09.463834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31744dfd-342b-4291-8e59-479df657e7a5 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:38:09.464198 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31744dfd-342b-4291-8e59-479df657e7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:38:09.464542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31744dfd-342b-4291-8e59-479df657e7a5 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:38:09.467064 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 752/1506] 10.222.0.44 () {52 vars in 829 bytes} [Tue Jun 14 19:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:38:09.471019 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0e30c-971b-456d-9a7f-12ab9f2212eb service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:38:09.532895 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0e30c-971b-456d-9a7f-12ab9f2212eb service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:38:09.537890 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c194d4d-f45b-4302-bf84-02254b8a9179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:38:09.538764 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c194d4d-f45b-4302-bf84-02254b8a9179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:38:09.539071 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c194d4d-f45b-4302-bf84-02254b8a9179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:38:09.539349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c194d4d-f45b-4302-bf84-02254b8a9179 admin admin] PATH_INFO: `/v3/users/a691e7a214cd4efb92a32a65970c8bee` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:38:09.540530 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c194d4d-f45b-4302-bf84-02254b8a9179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a691e7a214cd4efb92a32a65970c8bee)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:38:09.541599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: WARNING py.warnings [None req-5c194d4d-f45b-4302-bf84-02254b8a9179 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:38:09.541599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: warnings.warn(msg) Jun 14 19:38:09.541599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: Jun 14 19:38:09.542851 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c194d4d-f45b-4302-bf84-02254b8a9179 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:38:09.609572 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-5c194d4d-f45b-4302-bf84-02254b8a9179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a691e7a214cd4efb92a32a65970c8bee'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:38:09.610292 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-5c194d4d-f45b-4302-bf84-02254b8a9179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a691e7a214cd4efb92a32a65970c8bee'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:38:09.619504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-5c194d4d-f45b-4302-bf84-02254b8a9179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a691e7a214cd4efb92a32a65970c8bee'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:38:09.632590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-5c194d4d-f45b-4302-bf84-02254b8a9179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a691e7a214cd4efb92a32a65970c8bee'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:38:09.648425 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:38:09.651292 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-5c194d4d-f45b-4302-bf84-02254b8a9179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a691e7a214cd4efb92a32a65970c8bee'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:38:09.659548 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 755/1507] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:38:09 2022] DELETE /identity/v3/users/a691e7a214cd4efb92a32a65970c8bee => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:38:09.664058 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20411ea2-fe88-4cf9-8f37-b1128e0fd4ee None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:38:09.664394 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20411ea2-fe88-4cf9-8f37-b1128e0fd4ee None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:38:09.664706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20411ea2-fe88-4cf9-8f37-b1128e0fd4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:38:09.682490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-20411ea2-fe88-4cf9-8f37-b1128e0fd4ee None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:38:09.683679 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-20411ea2-fe88-4cf9-8f37-b1128e0fd4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:38:09.742918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 753/1508] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:38:09.753021 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c194d4d-f45b-4302-bf84-02254b8a9179 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:38:09.754461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5c194d4d-f45b-4302-bf84-02254b8a9179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:38:09.810424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c194d4d-f45b-4302-bf84-02254b8a9179 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:38:09.813957 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0473b8b-0182-4099-a531-3465dd0d8298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:38:09.814602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0473b8b-0182-4099-a531-3465dd0d8298 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:38:09.814884 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0473b8b-0182-4099-a531-3465dd0d8298 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:38:09.815159 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0473b8b-0182-4099-a531-3465dd0d8298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:38:09.824802 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0473b8b-0182-4099-a531-3465dd0d8298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:38:09.826809 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0473b8b-0182-4099-a531-3465dd0d8298 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:38:09.836427 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 756/1509] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:38:10.156946 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20411ea2-fe88-4cf9-8f37-b1128e0fd4ee None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:38:10.158506 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-20411ea2-fe88-4cf9-8f37-b1128e0fd4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:38:10.170657 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20411ea2-fe88-4cf9-8f37-b1128e0fd4ee None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:38:10.176314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe55d5-e243-498d-b13e-a623562a94b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:38:10.177225 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe55d5-e243-498d-b13e-a623562a94b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:38:10.177532 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe55d5-e243-498d-b13e-a623562a94b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:38:10.177806 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe55d5-e243-498d-b13e-a623562a94b0 admin admin] PATH_INFO: `/v3/projects/60a96a97178942c58f5e548bcab5e0d9` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:38:10.178971 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe55d5-e243-498d-b13e-a623562a94b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60a96a97178942c58f5e548bcab5e0d9)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:38:10.180702 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: WARNING py.warnings [None req-f5fe55d5-e243-498d-b13e-a623562a94b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:38:10.180702 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: warnings.warn(msg) Jun 14 19:38:10.180702 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: Jun 14 19:38:10.182089 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fe55d5-e243-498d-b13e-a623562a94b0 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:38:10.245336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f5fe55d5-e243-498d-b13e-a623562a94b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60a96a97178942c58f5e548bcab5e0d9', 'request_id': 'req-f5fe55d5-e243-498d-b13e-a623562a94b0'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:38:10.251798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f5fe55d5-e243-498d-b13e-a623562a94b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60a96a97178942c58f5e548bcab5e0d9', 'request_id': 'req-f5fe55d5-e243-498d-b13e-a623562a94b0'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:38:10.261326 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f5fe55d5-e243-498d-b13e-a623562a94b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60a96a97178942c58f5e548bcab5e0d9', 'request_id': 'req-f5fe55d5-e243-498d-b13e-a623562a94b0'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:38:10.280415 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f5fe55d5-e243-498d-b13e-a623562a94b0 admin admin] The token cache is being invalidate because project 60a96a97178942c58f5e548bcab5e0d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:38:10.280706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f5fe55d5-e243-498d-b13e-a623562a94b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:38:10.281489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f5fe55d5-e243-498d-b13e-a623562a94b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:38:10.283067 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 754/1510] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:38:10 2022] DELETE /identity/v3/projects/60a96a97178942c58f5e548bcab5e0d9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:38:19.832614 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:38:20.277192 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:39:50.801902 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d947e-bb30-4dcd-9180-7ce0980d36a4 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:39:50.802499 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d947e-bb30-4dcd-9180-7ce0980d36a4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:39:50.802499 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d947e-bb30-4dcd-9180-7ce0980d36a4 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:39:50.803833 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 19:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:39:50.808794 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eec9c-0bb4-4a01-8e17-8622b364d47e None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:39:50.809244 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eec9c-0bb4-4a01-8e17-8622b364d47e None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:39:50.809402 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3eec9c-0bb4-4a01-8e17-8622b364d47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:39:50.830913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-cb3eec9c-0bb4-4a01-8e17-8622b364d47e None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:39:50.832039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-cb3eec9c-0bb4-4a01-8e17-8622b364d47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:39:50.889622 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 19:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:39:51.061640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d947e-bb30-4dcd-9180-7ce0980d36a4 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:39:51.063422 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-eb5d947e-bb30-4dcd-9180-7ce0980d36a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:39:51.160177 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d947e-bb30-4dcd-9180-7ce0980d36a4 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:39:51.165357 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a298f-46e4-4b05-99f7-4d3ade860d7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:39:51.166024 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a298f-46e4-4b05-99f7-4d3ade860d7b service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:39:51.166306 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a298f-46e4-4b05-99f7-4d3ade860d7b service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:39:51.166584 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a298f-46e4-4b05-99f7-4d3ade860d7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:39:51.175001 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a298f-46e4-4b05-99f7-4d3ade860d7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:39:51.176604 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a298f-46e4-4b05-99f7-4d3ade860d7b service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:39:51.185921 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 758/1513] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:39:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:39:52.076960 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e46466-7148-4cb3-b362-45779ae4b4bf None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:39:52.077531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e46466-7148-4cb3-b362-45779ae4b4bf None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:39:52.077531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e46466-7148-4cb3-b362-45779ae4b4bf None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:39:52.078803 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 19:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:39:52.083614 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c1371-3d92-4db8-821d-dde0ccd7d1fd None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:39:52.084024 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c1371-3d92-4db8-821d-dde0ccd7d1fd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:39:52.084173 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c1371-3d92-4db8-821d-dde0ccd7d1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:39:52.102397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-200c1371-3d92-4db8-821d-dde0ccd7d1fd None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:39:52.103609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-200c1371-3d92-4db8-821d-dde0ccd7d1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:39:52.111984 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 19:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:39:52.267875 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e46466-7148-4cb3-b362-45779ae4b4bf None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:39:52.284225 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e46466-7148-4cb3-b362-45779ae4b4bf None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:39:52.289588 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c16aa-4cc2-4222-a72b-1ac866e489ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:39:52.290231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c16aa-4cc2-4222-a72b-1ac866e489ea service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:39:52.290517 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c16aa-4cc2-4222-a72b-1ac866e489ea service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:39:52.290796 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c16aa-4cc2-4222-a72b-1ac866e489ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:39:52.299882 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c16aa-4cc2-4222-a72b-1ac866e489ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:39:52.301566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c16aa-4cc2-4222-a72b-1ac866e489ea service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:39:52.312222 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 757/1516] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:39:52.664409 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75314fe7-ea16-48cf-a9a4-97c739daf3b1 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:39:52.664612 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75314fe7-ea16-48cf-a9a4-97c739daf3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:39:52.664874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75314fe7-ea16-48cf-a9a4-97c739daf3b1 None None] PATH_INFO: `/v3` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:39:52.666200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 760/1517] 10.222.0.46 () {54 vars in 925 bytes} [Tue Jun 14 19:39:52 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:39:52.688821 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c530a-ab92-4171-84b3-125d27714f02 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:39:52.689119 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c530a-ab92-4171-84b3-125d27714f02 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:39:52.689433 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c530a-ab92-4171-84b3-125d27714f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:39:52.707390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-854c530a-ab92-4171-84b3-125d27714f02 None None] MFA Rules not processed for user `e98915513674460485413c2dbee87fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:39:52.708607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-854c530a-ab92-4171-84b3-125d27714f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:39:52.770573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 758/1518] 10.222.0.46 () {58 vars in 1015 bytes} [Tue Jun 14 19:39:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:39:56.518303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a46e4-b74f-4b2b-ba88-c8d7daec72fb None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:39:56.518868 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a46e4-b74f-4b2b-ba88-c8d7daec72fb None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:39:56.518868 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a46e4-b74f-4b2b-ba88-c8d7daec72fb None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:39:56.520179 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 761/1519] 10.222.0.44 () {54 vars in 960 bytes} [Tue Jun 14 19:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:39:56.525303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da40b26-5d58-4cd8-b09e-522a0a3b9787 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:39:56.525741 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da40b26-5d58-4cd8-b09e-522a0a3b9787 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:39:56.525903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da40b26-5d58-4cd8-b09e-522a0a3b9787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:39:56.543904 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-3da40b26-5d58-4cd8-b09e-522a0a3b9787 None None] MFA Rules not processed for user `e98915513674460485413c2dbee87fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:39:56.545141 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-3da40b26-5d58-4cd8-b09e-522a0a3b9787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:39:56.553908 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 759/1520] 10.222.0.44 () {58 vars in 1057 bytes} [Tue Jun 14 19:39:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:39:56.561716 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a46e4-b74f-4b2b-ba88-c8d7daec72fb None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:39:56.575156 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a46e4-b74f-4b2b-ba88-c8d7daec72fb None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:39:56.580656 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4f98b-3b38-4e5a-aa0d-ce812672a456 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98915513674460485413c2dbee87fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:39:56.581277 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4f98b-3b38-4e5a-aa0d-ce812672a456 service placement] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:39:56.581586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4f98b-3b38-4e5a-aa0d-ce812672a456 service placement] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:39:56.581861 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4f98b-3b38-4e5a-aa0d-ce812672a456 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:39:56.589971 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4f98b-3b38-4e5a-aa0d-ce812672a456 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:39:56.591664 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4f98b-3b38-4e5a-aa0d-ce812672a456 service placement] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:39:56.601688 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 762/1521] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:39:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:40:03.572484 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe677a-0dab-45e9-9fcf-c279bdca0ddc None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:40:03.573058 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe677a-0dab-45e9-9fcf-c279bdca0ddc None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:40:03.573058 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe677a-0dab-45e9-9fcf-c279bdca0ddc None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:40:03.574484 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 19:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:40:03.579932 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc175b2-d625-4d2c-a40e-053a9b94b64e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:40:03.580342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc175b2-d625-4d2c-a40e-053a9b94b64e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:40:03.580484 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc175b2-d625-4d2c-a40e-053a9b94b64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:40:03.599044 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6bc175b2-d625-4d2c-a40e-053a9b94b64e None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:40:03.600249 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6bc175b2-d625-4d2c-a40e-053a9b94b64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:40:03.608957 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 19:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:40:03.762763 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe677a-0dab-45e9-9fcf-c279bdca0ddc None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:40:03.778184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe677a-0dab-45e9-9fcf-c279bdca0ddc None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:40:03.784410 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed3864-191b-4e69-9c18-60b5d74de2b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:40:03.785068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed3864-191b-4e69-9c18-60b5d74de2b6 service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:40:03.785351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed3864-191b-4e69-9c18-60b5d74de2b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:40:03.785679 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed3864-191b-4e69-9c18-60b5d74de2b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:40:03.793763 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed3864-191b-4e69-9c18-60b5d74de2b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:40:03.795479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed3864-191b-4e69-9c18-60b5d74de2b6 service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:40:03.804596 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 761/1524] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:40:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:40:04.682021 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b48c04-b242-4258-b458-180958ac771f None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:40:04.682609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b48c04-b242-4258-b458-180958ac771f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:40:04.682609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b48c04-b242-4258-b458-180958ac771f None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:40:04.684239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 14 19:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:40:04.689070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939ab3-489f-4ec4-9a7b-9dc3ed826a5c None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:40:04.689535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939ab3-489f-4ec4-9a7b-9dc3ed826a5c None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:40:04.689656 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939ab3-489f-4ec4-9a7b-9dc3ed826a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:40:04.707784 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-7c939ab3-489f-4ec4-9a7b-9dc3ed826a5c None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:40:04.708975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7c939ab3-489f-4ec4-9a7b-9dc3ed826a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:40:04.717365 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 14 19:40:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:40:04.869217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b48c04-b242-4258-b458-180958ac771f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:40:04.884327 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b48c04-b242-4258-b458-180958ac771f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:40:04.891442 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba462e-b53e-4344-a46b-3101c940072f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:40:04.892112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba462e-b53e-4344-a46b-3101c940072f service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:40:04.892397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba462e-b53e-4344-a46b-3101c940072f service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:40:04.892675 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba462e-b53e-4344-a46b-3101c940072f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:40:04.901035 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba462e-b53e-4344-a46b-3101c940072f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:40:04.902743 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba462e-b53e-4344-a46b-3101c940072f service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:40:04.912460 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 765/1527] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:40:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:40:08.843875 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aad67a-d1ef-46c8-afe5-5ecda43542a8 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:40:08.844391 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aad67a-d1ef-46c8-afe5-5ecda43542a8 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:40:08.844503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aad67a-d1ef-46c8-afe5-5ecda43542a8 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:40:08.845845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 19:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:40:08.851019 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d52edc-cefd-4d76-9fdd-e82238ba2882 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:40:08.851447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d52edc-cefd-4d76-9fdd-e82238ba2882 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:40:08.851551 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d52edc-cefd-4d76-9fdd-e82238ba2882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:40:08.869780 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-23d52edc-cefd-4d76-9fdd-e82238ba2882 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:40:08.870970 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-23d52edc-cefd-4d76-9fdd-e82238ba2882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:40:08.879445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 19:40:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:40:08.916846 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aad67a-d1ef-46c8-afe5-5ecda43542a8 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:40:08.918566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-97aad67a-d1ef-46c8-afe5-5ecda43542a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:40:08.976265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aad67a-d1ef-46c8-afe5-5ecda43542a8 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:40:08.979760 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f731e8-d008-41ee-81d8-1c4b454bb130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:40:08.980391 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f731e8-d008-41ee-81d8-1c4b454bb130 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:40:08.980671 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f731e8-d008-41ee-81d8-1c4b454bb130 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:40:08.980944 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f731e8-d008-41ee-81d8-1c4b454bb130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:40:08.990200 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f731e8-d008-41ee-81d8-1c4b454bb130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:40:08.991607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f731e8-d008-41ee-81d8-1c4b454bb130 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:40:08.996386 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:40:09.001906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 764/1530] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:40:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:40:11.132271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5d4b6-4245-4b3a-8f1e-b9da679778a0 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:40:11.132811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5d4b6-4245-4b3a-8f1e-b9da679778a0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:40:11.132811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5d4b6-4245-4b3a-8f1e-b9da679778a0 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:40:11.134154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 19:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:40:11.139827 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09797f6-c1f6-4013-928a-1ab1d4f13403 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:40:11.140264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09797f6-c1f6-4013-928a-1ab1d4f13403 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:40:11.140419 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09797f6-c1f6-4013-928a-1ab1d4f13403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:40:11.159116 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-f09797f6-c1f6-4013-928a-1ab1d4f13403 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:40:11.160304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-f09797f6-c1f6-4013-928a-1ab1d4f13403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:40:11.167985 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 19:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:40:11.204202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5d4b6-4245-4b3a-8f1e-b9da679778a0 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:40:11.205881 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3ff5d4b6-4245-4b3a-8f1e-b9da679778a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:40:11.219213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5d4b6-4245-4b3a-8f1e-b9da679778a0 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:40:11.222691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac325c-7684-4807-a26d-d34eacc3abb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:40:11.223319 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac325c-7684-4807-a26d-d34eacc3abb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:40:11.223603 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac325c-7684-4807-a26d-d34eacc3abb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:40:11.223881 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac325c-7684-4807-a26d-d34eacc3abb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:40:11.232682 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac325c-7684-4807-a26d-d34eacc3abb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:40:11.234129 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac325c-7684-4807-a26d-d34eacc3abb9 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:40:11.243568 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 768/1533] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:40:15.104643 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d8aea-1061-4a60-9c83-15acda926e6c None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:40:15.105169 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d8aea-1061-4a60-9c83-15acda926e6c None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:40:15.105169 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d8aea-1061-4a60-9c83-15acda926e6c None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:40:15.107073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 19:40:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:40:15.112551 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3480ae-71d8-4d70-9a65-760a4b640cd4 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:40:15.112992 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3480ae-71d8-4d70-9a65-760a4b640cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:40:15.113135 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3480ae-71d8-4d70-9a65-760a4b640cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:40:15.131455 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-dc3480ae-71d8-4d70-9a65-760a4b640cd4 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:40:15.132637 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-dc3480ae-71d8-4d70-9a65-760a4b640cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:40:15.140277 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 19:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:40:15.411822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d8aea-1061-4a60-9c83-15acda926e6c None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:40:15.413687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b50d8aea-1061-4a60-9c83-15acda926e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:40:15.470943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d8aea-1061-4a60-9c83-15acda926e6c None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:40:15.474458 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d631ca9-225c-4d82-b51d-01c9ab2e02ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:40:15.475101 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d631ca9-225c-4d82-b51d-01c9ab2e02ca service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:40:15.475385 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d631ca9-225c-4d82-b51d-01c9ab2e02ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:40:15.475666 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d631ca9-225c-4d82-b51d-01c9ab2e02ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:40:15.485012 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d631ca9-225c-4d82-b51d-01c9ab2e02ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:40:15.486465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d631ca9-225c-4d82-b51d-01c9ab2e02ca service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:40:15.495686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 767/1536] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:40:17.647956 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64072ee7-c79f-4a8f-99c6-22e33f7c7219 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:40:17.648527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64072ee7-c79f-4a8f-99c6-22e33f7c7219 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:40:17.648527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64072ee7-c79f-4a8f-99c6-22e33f7c7219 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:40:17.649919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 14 19:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:40:17.655631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88131b7c-f2f8-401b-a34f-22afedb0a506 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:40:17.656055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88131b7c-f2f8-401b-a34f-22afedb0a506 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:40:17.656192 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88131b7c-f2f8-401b-a34f-22afedb0a506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:40:17.675563 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-88131b7c-f2f8-401b-a34f-22afedb0a506 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:40:17.676756 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-88131b7c-f2f8-401b-a34f-22afedb0a506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:40:17.684713 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 14 19:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:40:17.946611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64072ee7-c79f-4a8f-99c6-22e33f7c7219 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:40:17.948294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-64072ee7-c79f-4a8f-99c6-22e33f7c7219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:40:17.961815 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64072ee7-c79f-4a8f-99c6-22e33f7c7219 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:40:17.965239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66faae8d-0558-4557-97d4-71ec96eb6d68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:40:17.966777 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66faae8d-0558-4557-97d4-71ec96eb6d68 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:40:17.967152 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66faae8d-0558-4557-97d4-71ec96eb6d68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:40:17.967429 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66faae8d-0558-4557-97d4-71ec96eb6d68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:40:17.976538 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66faae8d-0558-4557-97d4-71ec96eb6d68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:40:17.978001 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66faae8d-0558-4557-97d4-71ec96eb6d68 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:40:17.987283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 771/1539] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:40:27.670366 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=32 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:40:27.983229 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=70 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:46.841686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66876e4-3863-4d17-893d-0f809929ccd8 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:46.842336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66876e4-3863-4d17-893d-0f809929ccd8 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:46.842336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66876e4-3863-4d17-893d-0f809929ccd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:46.873269 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-d66876e4-3863-4d17-893d-0f809929ccd8 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:46.874507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-d66876e4-3863-4d17-893d-0f809929ccd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:46.880008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb739c-aeab-473a-984e-2f347ed55cf0 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:46.880945 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb739c-aeab-473a-984e-2f347ed55cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:46.881495 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb739c-aeab-473a-984e-2f347ed55cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:46.887089 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 769/1540] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:46.898711 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3db2c-fc47-4f01-a186-c481d228f041 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:46.899048 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3db2c-fc47-4f01-a186-c481d228f041 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:46.899282 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3db2c-fc47-4f01-a186-c481d228f041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:46.914629 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-abdb739c-aeab-473a-984e-2f347ed55cf0 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:46.915945 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-abdb739c-aeab-473a-984e-2f347ed55cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:46.928159 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 772/1541] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:46.939667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-2ca3db2c-fc47-4f01-a186-c481d228f041 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:46.939808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cdcc6-e9ff-4a87-8d61-92c9653b5426 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:46.940083 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cdcc6-e9ff-4a87-8d61-92c9653b5426 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:46.940373 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0cdcc6-e9ff-4a87-8d61-92c9653b5426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:46.940895 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-2ca3db2c-fc47-4f01-a186-c481d228f041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:46.967717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 770/1542] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:41:46.972783 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3db2c-fc47-4f01-a186-c481d228f041 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:46.973359 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6c0cdcc6-e9ff-4a87-8d61-92c9653b5426 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:46.974939 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6c0cdcc6-e9ff-4a87-8d61-92c9653b5426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:46.988894 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 773/1543] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:41:46.991617 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3db2c-fc47-4f01-a186-c481d228f041 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:46.993605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cdcc6-e9ff-4a87-8d61-92c9653b5426 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:47.014151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0cdcc6-e9ff-4a87-8d61-92c9653b5426 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:47.014388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc69cb9-dddd-4830-a0a2-5faba4539201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:47.014899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc69cb9-dddd-4830-a0a2-5faba4539201 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.015186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc69cb9-dddd-4830-a0a2-5faba4539201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.015586 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc69cb9-dddd-4830-a0a2-5faba4539201 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.016327 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc69cb9-dddd-4830-a0a2-5faba4539201 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:41:47.016637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc69cb9-dddd-4830-a0a2-5faba4539201 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:47.018336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc69cb9-dddd-4830-a0a2-5faba4539201 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:47.025891 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48855e80-7cd4-4e17-bd73-7c57d02c304e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:47.027040 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48855e80-7cd4-4e17-bd73-7c57d02c304e admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.027040 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48855e80-7cd4-4e17-bd73-7c57d02c304e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.027285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48855e80-7cd4-4e17-bd73-7c57d02c304e admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.032073 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48855e80-7cd4-4e17-bd73-7c57d02c304e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:41:47.032073 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48855e80-7cd4-4e17-bd73-7c57d02c304e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:47.032073 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: WARNING py.warnings [None req-48855e80-7cd4-4e17-bd73-7c57d02c304e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:41:47.032073 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: warnings.warn(msg) Jun 14 19:41:47.032073 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: Jun 14 19:41:47.032073 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48855e80-7cd4-4e17-bd73-7c57d02c304e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:47.049297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 774/1544] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:41:47.051903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 771/1545] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:41:47.057832 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48855e80-7cd4-4e17-bd73-7c57d02c304e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:47.063239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc69cb9-dddd-4830-a0a2-5faba4539201 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:47.072266 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48855e80-7cd4-4e17-bd73-7c57d02c304e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:47.080882 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c5242-8608-44dd-ac29-1d336825d67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:47.081611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c5242-8608-44dd-ac29-1d336825d67c admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.081902 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c5242-8608-44dd-ac29-1d336825d67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.082188 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c5242-8608-44dd-ac29-1d336825d67c admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.082915 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c5242-8608-44dd-ac29-1d336825d67c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:47.084886 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543c5242-8608-44dd-ac29-1d336825d67c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:47.085496 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc69cb9-dddd-4830-a0a2-5faba4539201 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:47.114184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8615b-53af-4a6e-9947-6395336bf0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:47.114882 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8615b-53af-4a6e-9947-6395336bf0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.115172 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8615b-53af-4a6e-9947-6395336bf0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.115455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8615b-53af-4a6e-9947-6395336bf0c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.116167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8615b-53af-4a6e-9947-6395336bf0c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:47.117183 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: WARNING py.warnings [None req-58f8615b-53af-4a6e-9947-6395336bf0c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:41:47.117183 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: warnings.warn(msg) Jun 14 19:41:47.117183 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: Jun 14 19:41:47.118411 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8615b-53af-4a6e-9947-6395336bf0c6 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:47.141604 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 775/1546] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:41:47 2022] POST /identity/v3/projects => generated 389 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:41:47.143666 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c5242-8608-44dd-ac29-1d336825d67c admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:47.190415 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 772/1547] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:41:47 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:41:47.197832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8615b-53af-4a6e-9947-6395336bf0c6 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:47.250321 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c5242-8608-44dd-ac29-1d336825d67c admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:47.332259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff8924-0042-42c9-8c8c-45f9f22175a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:47.332867 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff8924-0042-42c9-8c8c-45f9f22175a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.333154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff8924-0042-42c9-8c8c-45f9f22175a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.333456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff8924-0042-42c9-8c8c-45f9f22175a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.334165 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff8924-0042-42c9-8c8c-45f9f22175a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:47.335197 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: WARNING py.warnings [None req-e7ff8924-0042-42c9-8c8c-45f9f22175a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:41:47.335197 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: warnings.warn(msg) Jun 14 19:41:47.335197 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: Jun 14 19:41:47.336421 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff8924-0042-42c9-8c8c-45f9f22175a1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:47.339629 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8615b-53af-4a6e-9947-6395336bf0c6 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:47.354828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409cea7-0752-4673-87c7-c0d88c22ed5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:47.355520 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409cea7-0752-4673-87c7-c0d88c22ed5f admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.355803 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409cea7-0752-4673-87c7-c0d88c22ed5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.356716 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409cea7-0752-4673-87c7-c0d88c22ed5f admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.357638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409cea7-0752-4673-87c7-c0d88c22ed5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:47.359564 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409cea7-0752-4673-87c7-c0d88c22ed5f admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:47.385404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 776/1548] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:41:47 2022] POST /identity/v3/users => generated 295 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:41:47.386506 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51286f70-3adf-4848-8359-3b7dd02c72da None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.387681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51286f70-3adf-4848-8359-3b7dd02c72da None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.388180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51286f70-3adf-4848-8359-3b7dd02c72da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.400150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 773/1549] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:41:47 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:41:47.401258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b18e4-7fcd-4299-9d78-7df62f00a5d0 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.401575 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b18e4-7fcd-4299-9d78-7df62f00a5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.401856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b18e4-7fcd-4299-9d78-7df62f00a5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.428932 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-51286f70-3adf-4848-8359-3b7dd02c72da None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:47.430181 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-51286f70-3adf-4848-8359-3b7dd02c72da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:47.438718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-364b18e4-7fcd-4299-9d78-7df62f00a5d0 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:47.439899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-364b18e4-7fcd-4299-9d78-7df62f00a5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:47.447910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 777/1550] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:47.448987 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db086576-fd21-45df-b220-eedaeb6cdc01 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.449274 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db086576-fd21-45df-b220-eedaeb6cdc01 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.449578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db086576-fd21-45df-b220-eedaeb6cdc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.460509 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 774/1551] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:47.461356 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b18e4-7fcd-4299-9d78-7df62f00a5d0 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:47.478567 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b18e4-7fcd-4299-9d78-7df62f00a5d0 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:47.480512 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-db086576-fd21-45df-b220-eedaeb6cdc01 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:47.482275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-db086576-fd21-45df-b220-eedaeb6cdc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:47.484263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c2d94-0016-4606-850e-8721449b5a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:47.485049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c2d94-0016-4606-850e-8721449b5a19 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.485341 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c2d94-0016-4606-850e-8721449b5a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.485653 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c2d94-0016-4606-850e-8721449b5a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.486380 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c2d94-0016-4606-850e-8721449b5a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:47.487962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c2d94-0016-4606-850e-8721449b5a19 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:47.490101 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 778/1552] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:47.490868 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db086576-fd21-45df-b220-eedaeb6cdc01 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:47.499388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 775/1553] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:41:47.500500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5cab5-53db-42cf-b927-db7ca67ffe4a None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.500729 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db086576-fd21-45df-b220-eedaeb6cdc01 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:47.500859 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5cab5-53db-42cf-b927-db7ca67ffe4a None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.501062 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5cab5-53db-42cf-b927-db7ca67ffe4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.505508 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60b67d-a7c4-4af0-9ce4-4435f85d9903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:47.506171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60b67d-a7c4-4af0-9ce4-4435f85d9903 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.506455 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60b67d-a7c4-4af0-9ce4-4435f85d9903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.506731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60b67d-a7c4-4af0-9ce4-4435f85d9903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.507459 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60b67d-a7c4-4af0-9ce4-4435f85d9903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:47.509063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60b67d-a7c4-4af0-9ce4-4435f85d9903 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:47.519628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-cfd5cab5-53db-42cf-b927-db7ca67ffe4a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:47.519798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 779/1554] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:41:47.520968 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-cfd5cab5-53db-42cf-b927-db7ca67ffe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:47.521097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1b7b2-a3d3-474c-a7c3-686d4fa2e488 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.521269 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1b7b2-a3d3-474c-a7c3-686d4fa2e488 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.521569 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f1b7b2-a3d3-474c-a7c3-686d4fa2e488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.528810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 776/1555] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:47.530725 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a2c48-8678-466a-9563-9ef452902767 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.530725 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a2c48-8678-466a-9563-9ef452902767 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.530725 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a2c48-8678-466a-9563-9ef452902767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.543620 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-18f1b7b2-a3d3-474c-a7c3-686d4fa2e488 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:47.544810 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-18f1b7b2-a3d3-474c-a7c3-686d4fa2e488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:47.550334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-9c7a2c48-8678-466a-9563-9ef452902767 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:47.551493 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-9c7a2c48-8678-466a-9563-9ef452902767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:47.552675 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 780/1556] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:47.553894 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ff7d0-b988-4ac8-9531-a192f8bb94f1 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.554181 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ff7d0-b988-4ac8-9531-a192f8bb94f1 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.554478 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ff7d0-b988-4ac8-9531-a192f8bb94f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.560698 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 777/1557] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:47.561952 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32be8f-dd2e-43ee-aede-02219810905f None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.562240 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32be8f-dd2e-43ee-aede-02219810905f None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.562515 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b32be8f-dd2e-43ee-aede-02219810905f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.576464 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d17ff7d0-b988-4ac8-9531-a192f8bb94f1 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:47.577660 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d17ff7d0-b988-4ac8-9531-a192f8bb94f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:47.580244 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-1b32be8f-dd2e-43ee-aede-02219810905f None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:47.581440 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-1b32be8f-dd2e-43ee-aede-02219810905f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:47.585327 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 781/1558] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:47.586049 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ff7d0-b988-4ac8-9531-a192f8bb94f1 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:47.595358 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 778/1559] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:47.595970 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ff7d0-b988-4ac8-9531-a192f8bb94f1 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:47.596761 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2860687-c14f-4fc4-87aa-ae1688024532 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.597052 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2860687-c14f-4fc4-87aa-ae1688024532 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.597330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2860687-c14f-4fc4-87aa-ae1688024532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.600505 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb6a53-2df4-4e2a-8e70-fa8549c092b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:47.601154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb6a53-2df4-4e2a-8e70-fa8549c092b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.601463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb6a53-2df4-4e2a-8e70-fa8549c092b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.601742 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb6a53-2df4-4e2a-8e70-fa8549c092b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.602455 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb6a53-2df4-4e2a-8e70-fa8549c092b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:47.604237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eb6a53-2df4-4e2a-8e70-fa8549c092b3 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:47.610377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:47.616079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 782/1560] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:41:47.616412 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-c2860687-c14f-4fc4-87aa-ae1688024532 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:47.617117 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb6a53-2df4-4e2a-8e70-fa8549c092b3 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:47.617650 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c2860687-c14f-4fc4-87aa-ae1688024532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:47.626129 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 779/1561] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:47.627628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623292a-b444-470c-85cb-42255f18440b None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.627917 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623292a-b444-470c-85cb-42255f18440b None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.628198 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623292a-b444-470c-85cb-42255f18440b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.629890 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eb6a53-2df4-4e2a-8e70-fa8549c092b3 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:47.634699 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f6a56-aa7c-4b90-bd47-3948b07a3a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:47.635354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f6a56-aa7c-4b90-bd47-3948b07a3a33 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.635644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f6a56-aa7c-4b90-bd47-3948b07a3a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.635922 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f6a56-aa7c-4b90-bd47-3948b07a3a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.636703 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f6a56-aa7c-4b90-bd47-3948b07a3a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:47.638408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277f6a56-aa7c-4b90-bd47-3948b07a3a33 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:47.646862 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-7623292a-b444-470c-85cb-42255f18440b None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:47.648046 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7623292a-b444-470c-85cb-42255f18440b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:47.648429 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 783/1562] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:41:47.649302 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f6a56-aa7c-4b90-bd47-3948b07a3a33 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:47.658145 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 780/1563] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:47.658979 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623292a-b444-470c-85cb-42255f18440b None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:47.659937 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f6a56-aa7c-4b90-bd47-3948b07a3a33 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:47.664844 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e3ec6-c853-4933-914d-282aa516522f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:47.665522 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e3ec6-c853-4933-914d-282aa516522f admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.665810 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e3ec6-c853-4933-914d-282aa516522f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.666098 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e3ec6-c853-4933-914d-282aa516522f admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.666811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e3ec6-c853-4933-914d-282aa516522f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:41:47.667121 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e3ec6-c853-4933-914d-282aa516522f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:47.669776 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e3ec6-c853-4933-914d-282aa516522f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:47.673565 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7623292a-b444-470c-85cb-42255f18440b None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:47.678053 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31fad9-02b4-4446-b633-8aab65863621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:47.678710 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31fad9-02b4-4446-b633-8aab65863621 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.678988 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31fad9-02b4-4446-b633-8aab65863621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.679261 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31fad9-02b4-4446-b633-8aab65863621 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.679978 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31fad9-02b4-4446-b633-8aab65863621 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:41:47.680282 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31fad9-02b4-4446-b633-8aab65863621 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:47.681906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31fad9-02b4-4446-b633-8aab65863621 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:47.682518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 784/1564] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:41:47.683933 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887230cc-62c7-409f-a951-2cdd95e98f33 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.684336 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887230cc-62c7-409f-a951-2cdd95e98f33 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.684772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887230cc-62c7-409f-a951-2cdd95e98f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.708280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 781/1565] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:41:47.708280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2129a-c9d5-496f-838b-3c28e245c12f None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.708280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2129a-c9d5-496f-838b-3c28e245c12f None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.708280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a2129a-c9d5-496f-838b-3c28e245c12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.708772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-887230cc-62c7-409f-a951-2cdd95e98f33 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:47.708772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-887230cc-62c7-409f-a951-2cdd95e98f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:47.716570 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 785/1566] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:47.717624 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887230cc-62c7-409f-a951-2cdd95e98f33 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:47.722945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-80a2129a-c9d5-496f-838b-3c28e245c12f None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:47.724127 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-80a2129a-c9d5-496f-838b-3c28e245c12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:47.726632 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887230cc-62c7-409f-a951-2cdd95e98f33 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:47.733136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 782/1567] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:47.733950 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2129a-c9d5-496f-838b-3c28e245c12f None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:47.734270 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef32d97-91d3-4342-ba13-5618a3af89e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:47.735144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef32d97-91d3-4342-ba13-5618a3af89e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.735425 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef32d97-91d3-4342-ba13-5618a3af89e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.735696 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef32d97-91d3-4342-ba13-5618a3af89e1 admin admin] PATH_INFO: `/v3/projects/070bbe844e8945eca60ecc95244acd53/users/f60ed90fb1a54339ac563bc649e98989/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.744354 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a2129a-c9d5-496f-838b-3c28e245c12f None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:47.748939 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e9607-0f1c-4c21-bd66-dfd9a0220bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:47.749686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e9607-0f1c-4c21-bd66-dfd9a0220bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.749969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e9607-0f1c-4c21-bd66-dfd9a0220bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.750246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e9607-0f1c-4c21-bd66-dfd9a0220bf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.750485 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef32d97-91d3-4342-ba13-5618a3af89e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070bbe844e8945eca60ecc95244acd53, user_id=f60ed90fb1a54339ac563bc649e98989, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:47.750964 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e9607-0f1c-4c21-bd66-dfd9a0220bf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:41:47.751272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e9607-0f1c-4c21-bd66-dfd9a0220bf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:47.752838 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e9607-0f1c-4c21-bd66-dfd9a0220bf0 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:47.753212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef32d97-91d3-4342-ba13-5618a3af89e1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:47.772394 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 783/1568] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:41:47.772394 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e9607-0f1c-4c21-bd66-dfd9a0220bf0 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:47.772702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 786/1569] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:41:47 2022] PUT /identity/v3/projects/070bbe844e8945eca60ecc95244acd53/users/f60ed90fb1a54339ac563bc649e98989/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:41:47.772702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef32d97-91d3-4342-ba13-5618a3af89e1 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:47.779360 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e9607-0f1c-4c21-bd66-dfd9a0220bf0 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:47.791641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:47.833932 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef32d97-91d3-4342-ba13-5618a3af89e1 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:47.838553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa19737-fb54-4c01-aefb-6712d8c3523c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:47.838712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f69086-fe8a-4387-a08f-f47559b5ce99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:47.839324 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f69086-fe8a-4387-a08f-f47559b5ce99 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.839424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa19737-fb54-4c01-aefb-6712d8c3523c admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.839610 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f69086-fe8a-4387-a08f-f47559b5ce99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.839760 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa19737-fb54-4c01-aefb-6712d8c3523c admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.839934 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f69086-fe8a-4387-a08f-f47559b5ce99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.840035 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa19737-fb54-4c01-aefb-6712d8c3523c admin admin] PATH_INFO: `/v3/projects/b6c6e94029f24878baa7012e883ce5af/users/d7b608ebc4714a379b30857a06f701c6/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.841196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f69086-fe8a-4387-a08f-f47559b5ce99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:41:47.841595 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f69086-fe8a-4387-a08f-f47559b5ce99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:47.843158 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f69086-fe8a-4387-a08f-f47559b5ce99 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:47.854859 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 787/1570] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:41:47.855699 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f69086-fe8a-4387-a08f-f47559b5ce99 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:47.865018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa19737-fb54-4c01-aefb-6712d8c3523c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c6e94029f24878baa7012e883ce5af, user_id=d7b608ebc4714a379b30857a06f701c6, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:47.866092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: WARNING py.warnings [None req-7aa19737-fb54-4c01-aefb-6712d8c3523c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:41:47.866092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: warnings.warn(msg) Jun 14 19:41:47.866092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: Jun 14 19:41:47.867152 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f69086-fe8a-4387-a08f-f47559b5ce99 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:47.868889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa19737-fb54-4c01-aefb-6712d8c3523c admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:47.871694 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6cea6-21bb-4fc8-b0bd-03594772af8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:47.872400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6cea6-21bb-4fc8-b0bd-03594772af8d admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.872683 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6cea6-21bb-4fc8-b0bd-03594772af8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.872961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6cea6-21bb-4fc8-b0bd-03594772af8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.873679 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6cea6-21bb-4fc8-b0bd-03594772af8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:47.875586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6cea6-21bb-4fc8-b0bd-03594772af8d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:47.883223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 784/1571] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:41:47 2022] PUT /identity/v3/projects/b6c6e94029f24878baa7012e883ce5af/users/d7b608ebc4714a379b30857a06f701c6/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:41:47.884226 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa19737-fb54-4c01-aefb-6712d8c3523c admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:47.912579 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 788/1572] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:41:47 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:41:47.913496 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6cea6-21bb-4fc8-b0bd-03594772af8d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:47.960554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa19737-fb54-4c01-aefb-6712d8c3523c admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:47.976638 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6cea6-21bb-4fc8-b0bd-03594772af8d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:47.981224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5e12b-f459-4db6-81ce-76eb0d782d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:47.981994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5e12b-f459-4db6-81ce-76eb0d782d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:47.982280 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5e12b-f459-4db6-81ce-76eb0d782d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:47.982559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5e12b-f459-4db6-81ce-76eb0d782d22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:47.983278 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5e12b-f459-4db6-81ce-76eb0d782d22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:41:47.983585 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5e12b-f459-4db6-81ce-76eb0d782d22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:47.985185 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5e12b-f459-4db6-81ce-76eb0d782d22 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:47.996280 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 789/1573] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:41:47.997190 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5e12b-f459-4db6-81ce-76eb0d782d22 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.007356 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5e12b-f459-4db6-81ce-76eb0d782d22 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.012089 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe6720-745b-4112-86ad-2da960171b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.013293 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe6720-745b-4112-86ad-2da960171b03 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.013642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe6720-745b-4112-86ad-2da960171b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.013886 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe6720-745b-4112-86ad-2da960171b03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.014777 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe6720-745b-4112-86ad-2da960171b03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:41:48.015089 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe6720-745b-4112-86ad-2da960171b03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.016683 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe6720-745b-4112-86ad-2da960171b03 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.024839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247d5a92-11f8-4a64-bf5d-47822b282a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.025537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d5a92-11f8-4a64-bf5d-47822b282a57 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.025826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d5a92-11f8-4a64-bf5d-47822b282a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.026107 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247d5a92-11f8-4a64-bf5d-47822b282a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.026672 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:48.026847 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d5a92-11f8-4a64-bf5d-47822b282a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.029525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247d5a92-11f8-4a64-bf5d-47822b282a57 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.033448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 790/1574] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:41:48.034478 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe6720-745b-4112-86ad-2da960171b03 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.045596 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe6720-745b-4112-86ad-2da960171b03 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.051202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30195ef-6443-4a53-99c6-ddbfea5b644a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.052073 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30195ef-6443-4a53-99c6-ddbfea5b644a admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.052396 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30195ef-6443-4a53-99c6-ddbfea5b644a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.052764 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30195ef-6443-4a53-99c6-ddbfea5b644a admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.053570 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30195ef-6443-4a53-99c6-ddbfea5b644a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.055771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30195ef-6443-4a53-99c6-ddbfea5b644a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.067441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 785/1575] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:41:47 2022] POST /identity/v3/projects => generated 371 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:41:48.067441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c85b6-7a48-47ac-a497-1cae0f09cb85 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.067441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c85b6-7a48-47ac-a497-1cae0f09cb85 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.067441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c85b6-7a48-47ac-a497-1cae0f09cb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.084667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-572c85b6-7a48-47ac-a497-1cae0f09cb85 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:48.085907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-572c85b6-7a48-47ac-a497-1cae0f09cb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:48.088849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 791/1576] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:41:48 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:41:48.089629 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30195ef-6443-4a53-99c6-ddbfea5b644a admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.116503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:48.148855 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 786/1577] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:48.150173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e5916-3c92-4686-ad8e-46601fe521ed None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.150458 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e5916-3c92-4686-ad8e-46601fe521ed None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.150734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e5916-3c92-4686-ad8e-46601fe521ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.157751 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30195ef-6443-4a53-99c6-ddbfea5b644a admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.162515 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a20bd-605e-49df-a81f-26aa9314e948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.163258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a20bd-605e-49df-a81f-26aa9314e948 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.163616 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a20bd-605e-49df-a81f-26aa9314e948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.164012 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a20bd-605e-49df-a81f-26aa9314e948 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.164779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a20bd-605e-49df-a81f-26aa9314e948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.166801 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a20bd-605e-49df-a81f-26aa9314e948 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.180378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-ad1e5916-3c92-4686-ad8e-46601fe521ed None None] MFA Rules not processed for user `d7b608ebc4714a379b30857a06f701c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:48.181615 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-ad1e5916-3c92-4686-ad8e-46601fe521ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:48.193580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 792/1578] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:41:48 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:41:48.197398 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a20bd-605e-49df-a81f-26aa9314e948 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.247715 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 787/1579] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:48.248457 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e5916-3c92-4686-ad8e-46601fe521ed None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.258466 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e5916-3c92-4686-ad8e-46601fe521ed None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.263142 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4c80f-aac8-46c7-a9c3-cd0c2066b58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.263793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4c80f-aac8-46c7-a9c3-cd0c2066b58a admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.264074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4c80f-aac8-46c7-a9c3-cd0c2066b58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.264349 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe4c80f-aac8-46c7-a9c3-cd0c2066b58a admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.264469 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a20bd-605e-49df-a81f-26aa9314e948 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.265034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4c80f-aac8-46c7-a9c3-cd0c2066b58a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.266989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe4c80f-aac8-46c7-a9c3-cd0c2066b58a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.269113 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efb8de-8308-403d-bc3d-269153acc5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.269807 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efb8de-8308-403d-bc3d-269153acc5eb admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.270174 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efb8de-8308-403d-bc3d-269153acc5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.270368 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efb8de-8308-403d-bc3d-269153acc5eb admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.271136 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efb8de-8308-403d-bc3d-269153acc5eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.273655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efb8de-8308-403d-bc3d-269153acc5eb admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.298418 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 793/1580] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:41:48 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:41:48.299056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efb8de-8308-403d-bc3d-269153acc5eb admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.303393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 788/1581] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:41:48 2022] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:41:48.304357 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4c80f-aac8-46c7-a9c3-cd0c2066b58a admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.310810 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efb8de-8308-403d-bc3d-269153acc5eb admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.358443 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:48.367075 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe4c80f-aac8-46c7-a9c3-cd0c2066b58a admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.369007 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c296db-723d-4e47-8b78-853f72060f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.369737 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c296db-723d-4e47-8b78-853f72060f75 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.370029 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c296db-723d-4e47-8b78-853f72060f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.370311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c296db-723d-4e47-8b78-853f72060f75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.371006 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c296db-723d-4e47-8b78-853f72060f75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.371724 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699ca81-22ca-4763-a86f-56b699a6ecb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.372462 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699ca81-22ca-4763-a86f-56b699a6ecb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.372776 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699ca81-22ca-4763-a86f-56b699a6ecb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.373059 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c296db-723d-4e47-8b78-853f72060f75 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.373160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699ca81-22ca-4763-a86f-56b699a6ecb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.373774 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699ca81-22ca-4763-a86f-56b699a6ecb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.375710 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699ca81-22ca-4763-a86f-56b699a6ecb0 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.396884 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 789/1582] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:41:48 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:41:48.397838 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699ca81-22ca-4763-a86f-56b699a6ecb0 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.405661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 794/1583] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:41:48 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:41:48.405661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c296db-723d-4e47-8b78-853f72060f75 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.408790 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699ca81-22ca-4763-a86f-56b699a6ecb0 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.437775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:48.460271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c296db-723d-4e47-8b78-853f72060f75 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.464008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cbd21-3613-42be-b2c1-9d105925f9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.464728 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cbd21-3613-42be-b2c1-9d105925f9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.465118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cbd21-3613-42be-b2c1-9d105925f9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.465993 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cbd21-3613-42be-b2c1-9d105925f9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.468179 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb76d7-76d2-42b3-ba10-172aba7b818e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.468838 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb76d7-76d2-42b3-ba10-172aba7b818e admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.469120 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb76d7-76d2-42b3-ba10-172aba7b818e admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.469421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb76d7-76d2-42b3-ba10-172aba7b818e admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.470106 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb76d7-76d2-42b3-ba10-172aba7b818e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.472023 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb76d7-76d2-42b3-ba10-172aba7b818e admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.475083 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cbd21-3613-42be-b2c1-9d105925f9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.476508 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cbd21-3613-42be-b2c1-9d105925f9e7 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.487120 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 795/1584] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:41:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:41:48.487904 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cbd21-3613-42be-b2c1-9d105925f9e7 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.492932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 790/1585] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:41:48 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:41:48.494252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92442622-b4e2-401d-98dd-1665ab496e79 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.494544 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92442622-b4e2-401d-98dd-1665ab496e79 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.494852 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92442622-b4e2-401d-98dd-1665ab496e79 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.496041 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 791/1586] 10.222.0.44 () {54 vars in 961 bytes} [Tue Jun 14 19:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:41:48.496791 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92442622-b4e2-401d-98dd-1665ab496e79 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.500090 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cbd21-3613-42be-b2c1-9d105925f9e7 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.505122 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef1480-cbcb-47a2-acbc-e8455a84cb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.506043 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef1480-cbcb-47a2-acbc-e8455a84cb21 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.506402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef1480-cbcb-47a2-acbc-e8455a84cb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.506778 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef1480-cbcb-47a2-acbc-e8455a84cb21 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.507547 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef1480-cbcb-47a2-acbc-e8455a84cb21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.509563 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef1480-cbcb-47a2-acbc-e8455a84cb21 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.510759 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92442622-b4e2-401d-98dd-1665ab496e79 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.517499 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9393be3-eae2-47c0-b80a-f4b9d9b4b98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.518550 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9393be3-eae2-47c0-b80a-f4b9d9b4b98a admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.518895 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9393be3-eae2-47c0-b80a-f4b9d9b4b98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.519387 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9393be3-eae2-47c0-b80a-f4b9d9b4b98a admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.520511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9393be3-eae2-47c0-b80a-f4b9d9b4b98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.522620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9393be3-eae2-47c0-b80a-f4b9d9b4b98a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.537298 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 796/1587] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:41:48 2022] POST /identity/v3/users => generated 292 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:41:48.537298 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef1480-cbcb-47a2-acbc-e8455a84cb21 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.538946 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 792/1588] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:41:48.539835 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9393be3-eae2-47c0-b80a-f4b9d9b4b98a admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.546286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef1480-cbcb-47a2-acbc-e8455a84cb21 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.551357 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b2d0d-b61e-490e-9f82-407cc4e6d406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.552175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b2d0d-b61e-490e-9f82-407cc4e6d406 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.552693 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9393be3-eae2-47c0-b80a-f4b9d9b4b98a admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.552841 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b2d0d-b61e-490e-9f82-407cc4e6d406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.553008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b2d0d-b61e-490e-9f82-407cc4e6d406 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.553890 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b2d0d-b61e-490e-9f82-407cc4e6d406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.555855 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b2d0d-b61e-490e-9f82-407cc4e6d406 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.558213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e8395-0b2d-4773-b95b-c965ac293fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.559154 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e8395-0b2d-4773-b95b-c965ac293fec admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.560006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e8395-0b2d-4773-b95b-c965ac293fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.560355 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e8395-0b2d-4773-b95b-c965ac293fec admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.561337 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e8395-0b2d-4773-b95b-c965ac293fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.563070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0e8395-0b2d-4773-b95b-c965ac293fec admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.579816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 793/1589] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:41:48.580041 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 797/1590] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:41:48 2022] POST /identity/v3/users => generated 297 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:41:48.580143 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e8395-0b2d-4773-b95b-c965ac293fec admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.580254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b2d0d-b61e-490e-9f82-407cc4e6d406 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.589938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b2d0d-b61e-490e-9f82-407cc4e6d406 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.591718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e8395-0b2d-4773-b95b-c965ac293fec admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.595441 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24298101-0ea4-4248-95fa-083df2e38c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.596115 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24298101-0ea4-4248-95fa-083df2e38c7a admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.596397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24298101-0ea4-4248-95fa-083df2e38c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.597548 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24298101-0ea4-4248-95fa-083df2e38c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.597996 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24298101-0ea4-4248-95fa-083df2e38c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.598410 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dbb6b-17b9-41f9-b3ee-e90813f8e82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.599149 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dbb6b-17b9-41f9-b3ee-e90813f8e82a admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.599501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dbb6b-17b9-41f9-b3ee-e90813f8e82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.599647 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24298101-0ea4-4248-95fa-083df2e38c7a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.599906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dbb6b-17b9-41f9-b3ee-e90813f8e82a admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.600665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281dbb6b-17b9-41f9-b3ee-e90813f8e82a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.603235 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281dbb6b-17b9-41f9-b3ee-e90813f8e82a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.612200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 798/1591] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:41:48.613578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea671fcf-1db9-47e9-bf2e-eb5b398acbac None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.613876 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea671fcf-1db9-47e9-bf2e-eb5b398acbac None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.614157 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea671fcf-1db9-47e9-bf2e-eb5b398acbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.628126 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 794/1592] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:41:48 2022] POST /identity/v3/users => generated 289 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:41:48.628900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dbb6b-17b9-41f9-b3ee-e90813f8e82a admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.638555 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ea671fcf-1db9-47e9-bf2e-eb5b398acbac None None] MFA Rules not processed for user `37c521e20aea4cad9758568a4f082fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:48.639322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dbb6b-17b9-41f9-b3ee-e90813f8e82a admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.639768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ea671fcf-1db9-47e9-bf2e-eb5b398acbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:48.644453 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fef745-226a-440c-86db-29d26dcf6695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.645203 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fef745-226a-440c-86db-29d26dcf6695 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.645682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fef745-226a-440c-86db-29d26dcf6695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.646034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fef745-226a-440c-86db-29d26dcf6695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.646835 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fef745-226a-440c-86db-29d26dcf6695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.648501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fef745-226a-440c-86db-29d26dcf6695 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.659918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 795/1593] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:41:48.660673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fef745-226a-440c-86db-29d26dcf6695 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.676220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fef745-226a-440c-86db-29d26dcf6695 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.682132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d31b33-5dc7-469a-86cb-20c681bcd42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.682982 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d31b33-5dc7-469a-86cb-20c681bcd42b admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.683280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d31b33-5dc7-469a-86cb-20c681bcd42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.683700 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d31b33-5dc7-469a-86cb-20c681bcd42b admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.685139 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d31b33-5dc7-469a-86cb-20c681bcd42b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.686973 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d31b33-5dc7-469a-86cb-20c681bcd42b admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.698927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 796/1594] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:41:48.699815 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d31b33-5dc7-469a-86cb-20c681bcd42b admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.713210 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d31b33-5dc7-469a-86cb-20c681bcd42b admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.718954 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a6c70-b91c-43c0-aba7-91399deb5ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.719580 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a6c70-b91c-43c0-aba7-91399deb5ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.719869 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a6c70-b91c-43c0-aba7-91399deb5ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.720160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a6c70-b91c-43c0-aba7-91399deb5ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.723554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a6c70-b91c-43c0-aba7-91399deb5ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.725656 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a6c70-b91c-43c0-aba7-91399deb5ee1 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.729157 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 799/1595] 10.222.0.44 () {58 vars in 1058 bytes} [Tue Jun 14 19:41:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:48.730200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea671fcf-1db9-47e9-bf2e-eb5b398acbac None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.742883 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 797/1596] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:41:48.743242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea671fcf-1db9-47e9-bf2e-eb5b398acbac None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.743974 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a6c70-b91c-43c0-aba7-91399deb5ee1 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.749262 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b377dc-26fb-4b5e-a807-2ce634033322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.750141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b377dc-26fb-4b5e-a807-2ce634033322 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.750530 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b377dc-26fb-4b5e-a807-2ce634033322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.750948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b377dc-26fb-4b5e-a807-2ce634033322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.752009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b377dc-26fb-4b5e-a807-2ce634033322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.753597 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b377dc-26fb-4b5e-a807-2ce634033322 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.756253 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a6c70-b91c-43c0-aba7-91399deb5ee1 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.762426 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e2cdc-52fc-481c-a56a-8784c10cc493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.763232 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e2cdc-52fc-481c-a56a-8784c10cc493 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.763517 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e2cdc-52fc-481c-a56a-8784c10cc493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.763792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e2cdc-52fc-481c-a56a-8784c10cc493 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.764515 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e2cdc-52fc-481c-a56a-8784c10cc493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.765632 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 800/1597] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:41:48.766303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b377dc-26fb-4b5e-a807-2ce634033322 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.769559 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e2cdc-52fc-481c-a56a-8784c10cc493 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.777395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b377dc-26fb-4b5e-a807-2ce634033322 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.783723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 798/1598] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:41:48.783723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e2cdc-52fc-481c-a56a-8784c10cc493 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.784732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5349eea-a554-487c-930c-fee53e7f995e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.785594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5349eea-a554-487c-930c-fee53e7f995e admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.786186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5349eea-a554-487c-930c-fee53e7f995e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.786471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5349eea-a554-487c-930c-fee53e7f995e admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.787285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5349eea-a554-487c-930c-fee53e7f995e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.788961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5349eea-a554-487c-930c-fee53e7f995e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.796059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e2cdc-52fc-481c-a56a-8784c10cc493 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.800501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 801/1599] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:41:48.801757 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5349eea-a554-487c-930c-fee53e7f995e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.806826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf70b42-ba42-48c2-982f-892e0bfe120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.806826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf70b42-ba42-48c2-982f-892e0bfe120f admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.806826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf70b42-ba42-48c2-982f-892e0bfe120f admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.806826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf70b42-ba42-48c2-982f-892e0bfe120f admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.807334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf70b42-ba42-48c2-982f-892e0bfe120f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.808675 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf70b42-ba42-48c2-982f-892e0bfe120f admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.809250 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:48.816632 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5349eea-a554-487c-930c-fee53e7f995e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.824535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 799/1600] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:41:48.826186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf70b42-ba42-48c2-982f-892e0bfe120f admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.832123 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86f55e-4309-4feb-b470-28cc9f78aacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.833242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86f55e-4309-4feb-b470-28cc9f78aacd admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.834664 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86f55e-4309-4feb-b470-28cc9f78aacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.834956 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86f55e-4309-4feb-b470-28cc9f78aacd admin admin] PATH_INFO: `/v3/projects/bbda946832c44bbca1cc41990e32e861/users/359d538415604ef78c8e9ed0753231a5/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.839783 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf70b42-ba42-48c2-982f-892e0bfe120f admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:48.848177 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547d252-3a11-47e9-b056-91be5497f69d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:48.849985 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547d252-3a11-47e9-b056-91be5497f69d service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:48.850343 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547d252-3a11-47e9-b056-91be5497f69d service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:48.850555 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547d252-3a11-47e9-b056-91be5497f69d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:48.862987 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86f55e-4309-4feb-b470-28cc9f78aacd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbda946832c44bbca1cc41990e32e861, user_id=359d538415604ef78c8e9ed0753231a5, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.866809 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86f55e-4309-4feb-b470-28cc9f78aacd admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.897910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 802/1601] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:41:48 2022] PUT /identity/v3/projects/bbda946832c44bbca1cc41990e32e861/users/359d538415604ef78c8e9ed0753231a5/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:41:48.898949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86f55e-4309-4feb-b470-28cc9f78aacd admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.955688 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547d252-3a11-47e9-b056-91be5497f69d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:48.957321 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c547d252-3a11-47e9-b056-91be5497f69d service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:48.968280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 800/1602] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:41:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:41:48.969774 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547d252-3a11-47e9-b056-91be5497f69d service nova] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:48.982660 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547d252-3a11-47e9-b056-91be5497f69d service nova] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:49.007401 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86f55e-4309-4feb-b470-28cc9f78aacd admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:49.014902 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee223fe6-bb4f-4a25-a9c1-66cbfa3bf929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:49.017046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee223fe6-bb4f-4a25-a9c1-66cbfa3bf929 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:49.017742 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee223fe6-bb4f-4a25-a9c1-66cbfa3bf929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:49.018255 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee223fe6-bb4f-4a25-a9c1-66cbfa3bf929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:49.019868 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee223fe6-bb4f-4a25-a9c1-66cbfa3bf929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:49.020913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:49.022846 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee223fe6-bb4f-4a25-a9c1-66cbfa3bf929 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:49.042375 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 803/1603] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:41:49.044920 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee223fe6-bb4f-4a25-a9c1-66cbfa3bf929 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:49.061688 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee223fe6-bb4f-4a25-a9c1-66cbfa3bf929 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:49.071759 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059c92f-d846-49c1-867b-07225b8eaa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:49.074222 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059c92f-d846-49c1-867b-07225b8eaa54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:49.075618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059c92f-d846-49c1-867b-07225b8eaa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:49.077047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059c92f-d846-49c1-867b-07225b8eaa54 admin admin] PATH_INFO: `/v3/projects/f4aa8aab8447434b8619c3b7bb0b585a/users/18261f10678a4ce99626794c39bb5d7f/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:49.087749 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58796a0a-35bc-45cf-b319-cf25328115a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:49.088952 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58796a0a-35bc-45cf-b319-cf25328115a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:49.089458 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58796a0a-35bc-45cf-b319-cf25328115a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:49.089918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58796a0a-35bc-45cf-b319-cf25328115a5 admin admin] PATH_INFO: `/v3/projects/605b211405114782b9b1273be4dbed6a/users/16b898f7b0f34154910942558578a19c/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:49.100323 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059c92f-d846-49c1-867b-07225b8eaa54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4aa8aab8447434b8619c3b7bb0b585a, user_id=18261f10678a4ce99626794c39bb5d7f, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:49.104538 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059c92f-d846-49c1-867b-07225b8eaa54 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:49.112680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58796a0a-35bc-45cf-b319-cf25328115a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=605b211405114782b9b1273be4dbed6a, user_id=16b898f7b0f34154910942558578a19c, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:49.117546 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58796a0a-35bc-45cf-b319-cf25328115a5 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:49.127105 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 804/1604] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:41:49 2022] PUT /identity/v3/projects/f4aa8aab8447434b8619c3b7bb0b585a/users/18261f10678a4ce99626794c39bb5d7f/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:41:49.127105 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059c92f-d846-49c1-867b-07225b8eaa54 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:49.145842 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 801/1605] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:41:48 2022] PUT /identity/v3/projects/605b211405114782b9b1273be4dbed6a/users/16b898f7b0f34154910942558578a19c/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:41:49.157793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58796a0a-35bc-45cf-b319-cf25328115a5 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:49.214042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059c92f-d846-49c1-867b-07225b8eaa54 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:49.250553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58796a0a-35bc-45cf-b319-cf25328115a5 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:49.256175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c45d45-aae3-4236-abca-5920adbde95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:49.257169 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c45d45-aae3-4236-abca-5920adbde95c admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:49.258350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c45d45-aae3-4236-abca-5920adbde95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:49.258604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c45d45-aae3-4236-abca-5920adbde95c admin admin] PATH_INFO: `/v3/projects/b2b0a8b4f1e44e2da0750dd3f12fbb18/users/323c51f037db4ecca2f66cb6e9879246/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:49.275907 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:49.276943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c45d45-aae3-4236-abca-5920adbde95c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b0a8b4f1e44e2da0750dd3f12fbb18, user_id=323c51f037db4ecca2f66cb6e9879246, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:49.287147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28106505-fcda-47be-b920-e6f93b4de6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:49.287969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28106505-fcda-47be-b920-e6f93b4de6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:49.289000 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28106505-fcda-47be-b920-e6f93b4de6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:49.290091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28106505-fcda-47be-b920-e6f93b4de6e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:49.290923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28106505-fcda-47be-b920-e6f93b4de6e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:49.292672 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28106505-fcda-47be-b920-e6f93b4de6e4 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:49.295168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c45d45-aae3-4236-abca-5920adbde95c admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:49.309786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 805/1606] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:41:49 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:41:49.312061 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83cf2b-cbb8-451b-bbc1-c73895cc48e0 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:49.312453 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83cf2b-cbb8-451b-bbc1-c73895cc48e0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:49.312836 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83cf2b-cbb8-451b-bbc1-c73895cc48e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:49.323020 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 802/1607] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:41:49 2022] PUT /identity/v3/projects/b2b0a8b4f1e44e2da0750dd3f12fbb18/users/323c51f037db4ecca2f66cb6e9879246/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:41:49.323974 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c45d45-aae3-4236-abca-5920adbde95c admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:49.362958 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ab83cf2b-cbb8-451b-bbc1-c73895cc48e0 None None] MFA Rules not processed for user `359d538415604ef78c8e9ed0753231a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:49.363914 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ab83cf2b-cbb8-451b-bbc1-c73895cc48e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:49.394812 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c45d45-aae3-4236-abca-5920adbde95c admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:49.400219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b0031-f5c7-41f4-914a-36edfd0cd1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:49.401441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b0031-f5c7-41f4-914a-36edfd0cd1d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:49.401670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b0031-f5c7-41f4-914a-36edfd0cd1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:49.402055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b0031-f5c7-41f4-914a-36edfd0cd1d6 admin admin] PATH_INFO: `/v3/projects/05db8610cfa7449daeec7419d4f7ad6c/users/9b28c3b97f9f44148dd02f41509887e8/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:49.420422 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b0031-f5c7-41f4-914a-36edfd0cd1d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05db8610cfa7449daeec7419d4f7ad6c, user_id=9b28c3b97f9f44148dd02f41509887e8, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:49.423424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b0031-f5c7-41f4-914a-36edfd0cd1d6 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:49.440263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 803/1608] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:41:49 2022] PUT /identity/v3/projects/05db8610cfa7449daeec7419d4f7ad6c/users/9b28c3b97f9f44148dd02f41509887e8/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:41:49.441780 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fa607-6804-4f2d-950f-6f8e0573ea80 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:49.442179 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fa607-6804-4f2d-950f-6f8e0573ea80 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:49.442565 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fa607-6804-4f2d-950f-6f8e0573ea80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:49.445511 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 806/1609] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:49.447262 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c337e-6186-45f4-ab95-61bb91e4bdef None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:49.447559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c337e-6186-45f4-ab95-61bb91e4bdef None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:49.448279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c337e-6186-45f4-ab95-61bb91e4bdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:49.462842 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-3d5fa607-6804-4f2d-950f-6f8e0573ea80 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:49.464611 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-3d5fa607-6804-4f2d-950f-6f8e0573ea80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:49.475961 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:49.481832 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-3f1c337e-6186-45f4-ab95-61bb91e4bdef None None] MFA Rules not processed for user `16b898f7b0f34154910942558578a19c`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:49.492694 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3f1c337e-6186-45f4-ab95-61bb91e4bdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:49.547113 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 804/1610] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:49.547113 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffc157-4515-417b-9d6f-fbcd87a0421d None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:49.547113 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffc157-4515-417b-9d6f-fbcd87a0421d None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:49.547113 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffc157-4515-417b-9d6f-fbcd87a0421d None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:49.549439 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 805/1611] 10.222.0.44 () {54 vars in 912 bytes} [Tue Jun 14 19:41:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:41:49.556024 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffc157-4515-417b-9d6f-fbcd87a0421d None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:49.572604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffc157-4515-417b-9d6f-fbcd87a0421d None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:49.578266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6d24a-573f-41a9-8d01-56fb17be08dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:49.579276 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6d24a-573f-41a9-8d01-56fb17be08dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:49.579999 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6d24a-573f-41a9-8d01-56fb17be08dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:49.580385 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6d24a-573f-41a9-8d01-56fb17be08dc admin admin] PATH_INFO: `/v3/projects/58bb3d02c5c043d39785a31a7ee33b35/users/54575b28e7ec4f04a9884a35d5feec2e/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:49.590435 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 807/1612] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:49.590435 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a674e9-552b-410d-9501-e8e403de7ccd None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:49.590435 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a674e9-552b-410d-9501-e8e403de7ccd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:49.590435 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a674e9-552b-410d-9501-e8e403de7ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:49.597953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6d24a-573f-41a9-8d01-56fb17be08dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=58bb3d02c5c043d39785a31a7ee33b35, user_id=54575b28e7ec4f04a9884a35d5feec2e, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:49.600907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6d24a-573f-41a9-8d01-56fb17be08dc admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:49.622494 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c7a674e9-552b-410d-9501-e8e403de7ccd None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:49.624139 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 806/1613] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:41:49 2022] PUT /identity/v3/projects/58bb3d02c5c043d39785a31a7ee33b35/users/54575b28e7ec4f04a9884a35d5feec2e/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:41:49.625736 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240d6bf-17e4-4632-8cc9-ffdec34aaa96 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:49.626002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c7a674e9-552b-410d-9501-e8e403de7ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:49.626223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240d6bf-17e4-4632-8cc9-ffdec34aaa96 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:49.626565 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240d6bf-17e4-4632-8cc9-ffdec34aaa96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:49.646815 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-4240d6bf-17e4-4632-8cc9-ffdec34aaa96 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:49.648052 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-4240d6bf-17e4-4632-8cc9-ffdec34aaa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:49.712898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 807/1614] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:49.714635 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f73c2-a83a-47cc-947c-e2265addda14 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:49.715189 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f73c2-a83a-47cc-947c-e2265addda14 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:49.716246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f73c2-a83a-47cc-947c-e2265addda14 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:49.718409 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 808/1615] 10.222.0.44 () {54 vars in 961 bytes} [Tue Jun 14 19:41:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:41:49.719535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f73c2-a83a-47cc-947c-e2265addda14 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:49.728753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 808/1616] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:49.728753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815f4b7-e11a-41ee-9c64-c4b28ebb16bf None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:49.728753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815f4b7-e11a-41ee-9c64-c4b28ebb16bf None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:49.733406 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815f4b7-e11a-41ee-9c64-c4b28ebb16bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:49.758870 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-8815f4b7-e11a-41ee-9c64-c4b28ebb16bf None None] MFA Rules not processed for user `37c521e20aea4cad9758568a4f082fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:49.760261 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8815f4b7-e11a-41ee-9c64-c4b28ebb16bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:49.770297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:49.796880 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f73c2-a83a-47cc-947c-e2265addda14 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:49.802739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb6e8d-b562-4e34-ae2c-1f6a4668d179 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:49.803642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb6e8d-b562-4e34-ae2c-1f6a4668d179 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:49.803928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb6e8d-b562-4e34-ae2c-1f6a4668d179 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:49.804371 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb6e8d-b562-4e34-ae2c-1f6a4668d179 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:49.833313 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb6e8d-b562-4e34-ae2c-1f6a4668d179 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:49.834814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb6e8d-b562-4e34-ae2c-1f6a4668d179 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:49.845768 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 809/1617] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:41:49.847084 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3bdc7-3f1a-4c0c-ba31-9414ff92dd94 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:49.847378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3bdc7-3f1a-4c0c-ba31-9414ff92dd94 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:49.847663 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3bdc7-3f1a-4c0c-ba31-9414ff92dd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:49.851877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 809/1618] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jun 14 19:41:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:49.853452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295da3d-9d5b-47e8-9a60-1d42238bcc87 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:49.854203 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295da3d-9d5b-47e8-9a60-1d42238bcc87 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:49.856711 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295da3d-9d5b-47e8-9a60-1d42238bcc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:49.868411 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-bad3bdc7-3f1a-4c0c-ba31-9414ff92dd94 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:49.869768 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-bad3bdc7-3f1a-4c0c-ba31-9414ff92dd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:49.883254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a295da3d-9d5b-47e8-9a60-1d42238bcc87 None None] MFA Rules not processed for user `37c521e20aea4cad9758568a4f082fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:49.884292 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 810/1619] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:49.885100 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a295da3d-9d5b-47e8-9a60-1d42238bcc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:49.885730 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3bdc7-3f1a-4c0c-ba31-9414ff92dd94 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:49.897920 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 810/1620] 10.222.0.44 () {58 vars in 1058 bytes} [Tue Jun 14 19:41:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:49.898746 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295da3d-9d5b-47e8-9a60-1d42238bcc87 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:49.909973 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3bdc7-3f1a-4c0c-ba31-9414ff92dd94 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:49.910247 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295da3d-9d5b-47e8-9a60-1d42238bcc87 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:49.915151 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901c73f-8fc6-4331-976f-ace153a89b4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:49.916747 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901c73f-8fc6-4331-976f-ace153a89b4a service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:49.917092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901c73f-8fc6-4331-976f-ace153a89b4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:49.917922 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901c73f-8fc6-4331-976f-ace153a89b4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:49.918010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0016ae-55ec-4ca0-9702-3c36f98090a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:49.918901 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0016ae-55ec-4ca0-9702-3c36f98090a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:49.919417 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0016ae-55ec-4ca0-9702-3c36f98090a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:49.919821 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0016ae-55ec-4ca0-9702-3c36f98090a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:49.930523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901c73f-8fc6-4331-976f-ace153a89b4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:49.933626 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901c73f-8fc6-4331-976f-ace153a89b4a service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:49.935882 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0016ae-55ec-4ca0-9702-3c36f98090a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:49.938339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0016ae-55ec-4ca0-9702-3c36f98090a6 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:49.946428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 811/1621] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:41:49.947499 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901c73f-8fc6-4331-976f-ace153a89b4a service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:49.951383 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 811/1622] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:41:49.952241 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0016ae-55ec-4ca0-9702-3c36f98090a6 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:49.963477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:49.967316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0016ae-55ec-4ca0-9702-3c36f98090a6 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:49.977247 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a8b6a-f879-4abc-86b9-8161fcfa663a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:49.977950 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a8b6a-f879-4abc-86b9-8161fcfa663a service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:49.978237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a8b6a-f879-4abc-86b9-8161fcfa663a service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:49.978517 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a8b6a-f879-4abc-86b9-8161fcfa663a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:50.065201 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901c73f-8fc6-4331-976f-ace153a89b4a service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:50.078756 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c1bd5-d1b1-4cc4-8a0a-a4740fb3fccc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:50.079567 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c1bd5-d1b1-4cc4-8a0a-a4740fb3fccc service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:50.079956 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c1bd5-d1b1-4cc4-8a0a-a4740fb3fccc service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:50.080338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c1bd5-d1b1-4cc4-8a0a-a4740fb3fccc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:50.081822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a8b6a-f879-4abc-86b9-8161fcfa663a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:50.083919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a8b6a-f879-4abc-86b9-8161fcfa663a service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:50.105237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 812/1623] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:41:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:41:50.107750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c1bd5-d1b1-4cc4-8a0a-a4740fb3fccc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:50.108649 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a8b6a-f879-4abc-86b9-8161fcfa663a service nova] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:50.114481 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c1bd5-d1b1-4cc4-8a0a-a4740fb3fccc service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:50.135623 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a8b6a-f879-4abc-86b9-8161fcfa663a service nova] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:50.141028 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f8ec1-5d46-4342-91f8-bb88eb844e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:50.141757 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f8ec1-5d46-4342-91f8-bb88eb844e95 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:50.142049 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f8ec1-5d46-4342-91f8-bb88eb844e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:50.142383 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f8ec1-5d46-4342-91f8-bb88eb844e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:50.150771 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 812/1624] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:41:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:41:50.163353 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f8ec1-5d46-4342-91f8-bb88eb844e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:50.166059 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3f8ec1-5d46-4342-91f8-bb88eb844e95 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:50.204507 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 813/1625] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:41:50.487568 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c1bd5-d1b1-4cc4-8a0a-a4740fb3fccc service cinder] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:50.502658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c1bd5-d1b1-4cc4-8a0a-a4740fb3fccc service cinder] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:50.511269 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f12b0-4f2f-448f-9c99-06b2e2f2d6ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:50.512612 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f12b0-4f2f-448f-9c99-06b2e2f2d6ca service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:50.513067 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f12b0-4f2f-448f-9c99-06b2e2f2d6ca service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:50.513644 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f12b0-4f2f-448f-9c99-06b2e2f2d6ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:50.619242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f12b0-4f2f-448f-9c99-06b2e2f2d6ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:50.621099 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f12b0-4f2f-448f-9c99-06b2e2f2d6ca service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:50.633651 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 813/1626] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:41:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:41:50.758913 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392943bb-04d5-4578-a759-eff69495851c None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:50.758913 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392943bb-04d5-4578-a759-eff69495851c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:50.758913 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392943bb-04d5-4578-a759-eff69495851c None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:50.758913 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 814/1627] 10.222.0.44 () {54 vars in 912 bytes} [Tue Jun 14 19:41:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:41:50.765774 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211929d-9e88-42fd-b282-1c7453876abe None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:50.765774 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211929d-9e88-42fd-b282-1c7453876abe None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:50.765774 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211929d-9e88-42fd-b282-1c7453876abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:50.766401 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-7211929d-9e88-42fd-b282-1c7453876abe None None] MFA Rules not processed for user `37c521e20aea4cad9758568a4f082fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:50.774077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7211929d-9e88-42fd-b282-1c7453876abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:50.813967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 814/1628] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jun 14 19:41:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:50.828633 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392943bb-04d5-4578-a759-eff69495851c None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:50.848463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392943bb-04d5-4578-a759-eff69495851c None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:50.858230 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b459d-0ed7-4df0-87a5-7904a811cc41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:50.860175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b459d-0ed7-4df0-87a5-7904a811cc41 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:50.860484 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b459d-0ed7-4df0-87a5-7904a811cc41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:50.861767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b459d-0ed7-4df0-87a5-7904a811cc41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:50.888901 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b459d-0ed7-4df0-87a5-7904a811cc41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:50.890410 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b459d-0ed7-4df0-87a5-7904a811cc41 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:50.928523 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 815/1629] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:41:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:41:51.672726 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211929d-9e88-42fd-b282-1c7453876abe None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:51.691756 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211929d-9e88-42fd-b282-1c7453876abe None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:51.707117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98997811-d029-4848-ab62-78ad94c1f462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:51.709526 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98997811-d029-4848-ab62-78ad94c1f462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:51.710004 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98997811-d029-4848-ab62-78ad94c1f462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:51.710491 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98997811-d029-4848-ab62-78ad94c1f462 admin admin] PATH_INFO: `/v3/users/359d538415604ef78c8e9ed0753231a5` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:51.712160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98997811-d029-4848-ab62-78ad94c1f462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=359d538415604ef78c8e9ed0753231a5)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:51.713590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: WARNING py.warnings [None req-98997811-d029-4848-ab62-78ad94c1f462 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:41:51.713590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: warnings.warn(msg) Jun 14 19:41:51.713590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: Jun 14 19:41:51.716460 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98997811-d029-4848-ab62-78ad94c1f462 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:51.826980 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-98997811-d029-4848-ab62-78ad94c1f462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '359d538415604ef78c8e9ed0753231a5'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:41:51.828061 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-98997811-d029-4848-ab62-78ad94c1f462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '359d538415604ef78c8e9ed0753231a5'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:41:51.862349 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-98997811-d029-4848-ab62-78ad94c1f462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '359d538415604ef78c8e9ed0753231a5'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:41:51.893796 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-98997811-d029-4848-ab62-78ad94c1f462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '359d538415604ef78c8e9ed0753231a5'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:41:51.968788 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-98997811-d029-4848-ab62-78ad94c1f462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '359d538415604ef78c8e9ed0753231a5'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:41:51.982754 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 815/1630] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:41:51 2022] DELETE /identity/v3/users/359d538415604ef78c8e9ed0753231a5 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:41:51.987203 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f07503-0906-4e38-b22e-dc5e7810c735 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:51.987733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f07503-0906-4e38-b22e-dc5e7810c735 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:51.987883 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f07503-0906-4e38-b22e-dc5e7810c735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:52.022125 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f9f07503-0906-4e38-b22e-dc5e7810c735 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:52.023442 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f9f07503-0906-4e38-b22e-dc5e7810c735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:52.207682 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:52.231360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 816/1631] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:52.264639 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98997811-d029-4848-ab62-78ad94c1f462 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:52.266412 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-98997811-d029-4848-ab62-78ad94c1f462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:52.332095 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:52.445022 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98997811-d029-4848-ab62-78ad94c1f462 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:52.453931 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da30ee8-d347-4494-a734-424904b33b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:52.455766 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da30ee8-d347-4494-a734-424904b33b18 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:52.456060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da30ee8-d347-4494-a734-424904b33b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:52.457065 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da30ee8-d347-4494-a734-424904b33b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:52.483973 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da30ee8-d347-4494-a734-424904b33b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:52.486721 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da30ee8-d347-4494-a734-424904b33b18 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:52.515871 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 816/1632] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:41:53.837506 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bd4c3-462e-4d2d-9bad-ffee711847c0 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:53.838358 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bd4c3-462e-4d2d-9bad-ffee711847c0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:53.838358 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bd4c3-462e-4d2d-9bad-ffee711847c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:53.925037 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-df0bd4c3-462e-4d2d-9bad-ffee711847c0 None None] MFA Rules not processed for user `54575b28e7ec4f04a9884a35d5feec2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:53.929621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-df0bd4c3-462e-4d2d-9bad-ffee711847c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:54.136172 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 817/1633] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:54.139070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8a82a-d608-4455-b141-f229c54917f5 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:54.139612 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8a82a-d608-4455-b141-f229c54917f5 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:54.139708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8a82a-d608-4455-b141-f229c54917f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:54.173129 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-e2c8a82a-d608-4455-b141-f229c54917f5 None None] MFA Rules not processed for user `54575b28e7ec4f04a9884a35d5feec2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:54.174714 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e2c8a82a-d608-4455-b141-f229c54917f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:54.208863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 817/1634] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:54.221563 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bd4c3-462e-4d2d-9bad-ffee711847c0 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:54.223144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-df0bd4c3-462e-4d2d-9bad-ffee711847c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:54.404026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bd4c3-462e-4d2d-9bad-ffee711847c0 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:54.413484 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e078e02-35e6-4f0d-b31e-b506c0e278b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:54.414190 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e078e02-35e6-4f0d-b31e-b506c0e278b3 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:54.414459 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e078e02-35e6-4f0d-b31e-b506c0e278b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:54.414734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e078e02-35e6-4f0d-b31e-b506c0e278b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:54.435204 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e078e02-35e6-4f0d-b31e-b506c0e278b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:54.437028 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e078e02-35e6-4f0d-b31e-b506c0e278b3 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:54.464449 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 818/1635] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:41:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:41:54.492904 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8a82a-d608-4455-b141-f229c54917f5 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:54.495075 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e2c8a82a-d608-4455-b141-f229c54917f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:54.525250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8a82a-d608-4455-b141-f229c54917f5 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:54.539795 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c7116-bc6b-4824-9169-6b44116e7c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:54.540610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c7116-bc6b-4824-9169-6b44116e7c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:54.540903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c7116-bc6b-4824-9169-6b44116e7c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:54.541185 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c7116-bc6b-4824-9169-6b44116e7c63 admin admin] PATH_INFO: `/v3/projects/bbda946832c44bbca1cc41990e32e861` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:54.542569 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c7116-bc6b-4824-9169-6b44116e7c63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbda946832c44bbca1cc41990e32e861)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:54.545764 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c7116-bc6b-4824-9169-6b44116e7c63 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:54.636465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-913c7116-bc6b-4824-9169-6b44116e7c63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbda946832c44bbca1cc41990e32e861', 'request_id': 'req-913c7116-bc6b-4824-9169-6b44116e7c63'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:41:54.678418 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-913c7116-bc6b-4824-9169-6b44116e7c63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbda946832c44bbca1cc41990e32e861', 'request_id': 'req-913c7116-bc6b-4824-9169-6b44116e7c63'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:41:54.681059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-913c7116-bc6b-4824-9169-6b44116e7c63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbda946832c44bbca1cc41990e32e861', 'request_id': 'req-913c7116-bc6b-4824-9169-6b44116e7c63'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:41:54.711036 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-913c7116-bc6b-4824-9169-6b44116e7c63 admin admin] The token cache is being invalidate because project bbda946832c44bbca1cc41990e32e861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:41:54.711591 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-913c7116-bc6b-4824-9169-6b44116e7c63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:41:54.713276 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-913c7116-bc6b-4824-9169-6b44116e7c63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:41:54.716149 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 818/1636] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:41:54 2022] DELETE /identity/v3/projects/bbda946832c44bbca1cc41990e32e861 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:41:54.721692 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1a518-dc79-489f-8ed6-6ad9fced7e92 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:54.722142 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1a518-dc79-489f-8ed6-6ad9fced7e92 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:54.722555 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1a518-dc79-489f-8ed6-6ad9fced7e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:54.751709 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-44f1a518-dc79-489f-8ed6-6ad9fced7e92 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:54.752912 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-44f1a518-dc79-489f-8ed6-6ad9fced7e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:54.891518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 819/1637] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:54.899108 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca6a90-efef-458a-9516-a9b0da6d8148 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:54.899726 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca6a90-efef-458a-9516-a9b0da6d8148 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:54.900248 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eca6a90-efef-458a-9516-a9b0da6d8148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:54.947573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-4eca6a90-efef-458a-9516-a9b0da6d8148 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:54.952896 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-4eca6a90-efef-458a-9516-a9b0da6d8148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:54.975063 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 819/1638] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:41:54.983096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1a518-dc79-489f-8ed6-6ad9fced7e92 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:55.003108 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1a518-dc79-489f-8ed6-6ad9fced7e92 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:55.009130 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2ed17-d123-4cb2-aef9-3325ab8f8b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:55.009909 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2ed17-d123-4cb2-aef9-3325ab8f8b4b admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:55.010200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2ed17-d123-4cb2-aef9-3325ab8f8b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:55.010479 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2ed17-d123-4cb2-aef9-3325ab8f8b4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:55.011220 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2ed17-d123-4cb2-aef9-3325ab8f8b4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:41:55.011526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2ed17-d123-4cb2-aef9-3325ab8f8b4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:55.013768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2ed17-d123-4cb2-aef9-3325ab8f8b4b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:55.030052 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:55.034911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 820/1639] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:41:55.039643 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca6a90-efef-458a-9516-a9b0da6d8148 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:55.054674 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eca6a90-efef-458a-9516-a9b0da6d8148 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:55.068241 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2867b8-1f95-470f-8f77-3803adf2b8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:55.069543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2867b8-1f95-470f-8f77-3803adf2b8d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:55.069969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2867b8-1f95-470f-8f77-3803adf2b8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:55.072099 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2867b8-1f95-470f-8f77-3803adf2b8d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:55.072753 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2867b8-1f95-470f-8f77-3803adf2b8d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:55.082896 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2867b8-1f95-470f-8f77-3803adf2b8d2 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:55.208520 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2ed17-d123-4cb2-aef9-3325ab8f8b4b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:55.210100 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 820/1640] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:41:55 2022] POST /identity/v3/projects => generated 405 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:41:55.226218 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2ed17-d123-4cb2-aef9-3325ab8f8b4b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:55.418263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aca9fd-ff4a-49ea-81c2-f794db6fc448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:55.419091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aca9fd-ff4a-49ea-81c2-f794db6fc448 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:55.419481 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aca9fd-ff4a-49ea-81c2-f794db6fc448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:55.420530 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aca9fd-ff4a-49ea-81c2-f794db6fc448 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:55.423136 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aca9fd-ff4a-49ea-81c2-f794db6fc448 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:55.425283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aca9fd-ff4a-49ea-81c2-f794db6fc448 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:55.475523 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 821/1641] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:41:55 2022] POST /identity/v3/users => generated 303 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:41:55.477212 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2867b8-1f95-470f-8f77-3803adf2b8d2 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:55.488767 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2867b8-1f95-470f-8f77-3803adf2b8d2 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:55.499619 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2f32e-e922-4434-a241-458c7d7cad56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:55.500365 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2f32e-e922-4434-a241-458c7d7cad56 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:55.500663 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2f32e-e922-4434-a241-458c7d7cad56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:55.501023 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad2f32e-e922-4434-a241-458c7d7cad56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:55.504011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2f32e-e922-4434-a241-458c7d7cad56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:55.507467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad2f32e-e922-4434-a241-458c7d7cad56 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:55.524496 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 821/1642] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:41:55.528373 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aca9fd-ff4a-49ea-81c2-f794db6fc448 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:55.544642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aca9fd-ff4a-49ea-81c2-f794db6fc448 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:55.563499 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f73cf-9c34-4769-b68b-8da2cfded663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:55.564331 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f73cf-9c34-4769-b68b-8da2cfded663 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:55.564501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f73cf-9c34-4769-b68b-8da2cfded663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:55.564784 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f73cf-9c34-4769-b68b-8da2cfded663 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:55.565560 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f73cf-9c34-4769-b68b-8da2cfded663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:55.567223 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f73cf-9c34-4769-b68b-8da2cfded663 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:55.599145 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2f32e-e922-4434-a241-458c7d7cad56 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:55.612184 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 822/1643] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:41:55.615180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad2f32e-e922-4434-a241-458c7d7cad56 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:55.630221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee02a24-4735-4b0a-9058-0ad0cef8ef7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:55.631418 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee02a24-4735-4b0a-9058-0ad0cef8ef7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:55.631418 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee02a24-4735-4b0a-9058-0ad0cef8ef7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:55.631707 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee02a24-4735-4b0a-9058-0ad0cef8ef7a admin admin] PATH_INFO: `/v3/projects/39896446cbb44621ba24ff7d55245b5c/users/38b80bb0d8a64940a3cbecf28fd1aa7a/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:55.706146 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee02a24-4735-4b0a-9058-0ad0cef8ef7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=39896446cbb44621ba24ff7d55245b5c, user_id=38b80bb0d8a64940a3cbecf28fd1aa7a, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:55.711668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee02a24-4735-4b0a-9058-0ad0cef8ef7a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:55.749223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 822/1644] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:41:55 2022] PUT /identity/v3/projects/39896446cbb44621ba24ff7d55245b5c/users/38b80bb0d8a64940a3cbecf28fd1aa7a/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:41:55.758640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72545c-354f-46c1-98f1-18241a418d50 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:55.759338 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72545c-354f-46c1-98f1-18241a418d50 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:55.759706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72545c-354f-46c1-98f1-18241a418d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:55.771227 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b83327-5077-4af7-b478-cf7cf05e6fbc None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:55.772716 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b83327-5077-4af7-b478-cf7cf05e6fbc None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:55.773126 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b83327-5077-4af7-b478-cf7cf05e6fbc None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:55.781077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 823/1645] 10.222.0.44 () {54 vars in 912 bytes} [Tue Jun 14 19:41:55 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:41:55.787329 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa63bee-5f13-4f65-820b-3eb66534fb67 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:55.787652 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa63bee-5f13-4f65-820b-3eb66534fb67 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:55.787947 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa63bee-5f13-4f65-820b-3eb66534fb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:55.809808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-bf72545c-354f-46c1-98f1-18241a418d50 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:55.815387 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bf72545c-354f-46c1-98f1-18241a418d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:55.940741 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-2fa63bee-5f13-4f65-820b-3eb66534fb67 None None] MFA Rules not processed for user `791ed0f433834b4599d6bc825440279d`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:55.949088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-2fa63bee-5f13-4f65-820b-3eb66534fb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:56.022820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:56.086947 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 823/1646] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:56.092052 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72545c-354f-46c1-98f1-18241a418d50 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:56.097231 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bf72545c-354f-46c1-98f1-18241a418d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:56.138863 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72545c-354f-46c1-98f1-18241a418d50 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:56.149799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 824/1647] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jun 14 19:41:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:56.150269 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383c54d-6aa9-4c19-b665-ea54b27f852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:56.151361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383c54d-6aa9-4c19-b665-ea54b27f852b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:56.151653 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383c54d-6aa9-4c19-b665-ea54b27f852b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:56.151941 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383c54d-6aa9-4c19-b665-ea54b27f852b admin admin] PATH_INFO: `/v3/users/16b898f7b0f34154910942558578a19c` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:56.153840 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383c54d-6aa9-4c19-b665-ea54b27f852b admin admin] RBAC: Authorizing `identity:delete_user(user_id=16b898f7b0f34154910942558578a19c)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:56.156426 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383c54d-6aa9-4c19-b665-ea54b27f852b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:56.219722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa63bee-5f13-4f65-820b-3eb66534fb67 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:56.221341 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-2fa63bee-5f13-4f65-820b-3eb66534fb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:56.241399 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa63bee-5f13-4f65-820b-3eb66534fb67 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:56.245955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfc218-7c6c-4a59-abf2-377efa5dad68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:56.259365 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfc218-7c6c-4a59-abf2-377efa5dad68 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:56.260292 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfc218-7c6c-4a59-abf2-377efa5dad68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:56.260630 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfc218-7c6c-4a59-abf2-377efa5dad68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:56.287988 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3383c54d-6aa9-4c19-b665-ea54b27f852b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16b898f7b0f34154910942558578a19c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:41:56.289157 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3383c54d-6aa9-4c19-b665-ea54b27f852b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16b898f7b0f34154910942558578a19c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:41:56.302627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3383c54d-6aa9-4c19-b665-ea54b27f852b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16b898f7b0f34154910942558578a19c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:41:56.303700 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfc218-7c6c-4a59-abf2-377efa5dad68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:56.307196 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfc218-7c6c-4a59-abf2-377efa5dad68 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:56.322950 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3383c54d-6aa9-4c19-b665-ea54b27f852b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16b898f7b0f34154910942558578a19c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:41:56.323829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 825/1648] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:41:56.325834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfc218-7c6c-4a59-abf2-377efa5dad68 service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:56.344471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:56.348679 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfc218-7c6c-4a59-abf2-377efa5dad68 service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:56.352101 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3383c54d-6aa9-4c19-b665-ea54b27f852b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16b898f7b0f34154910942558578a19c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:41:56.361975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939dc2b-ae37-446d-9b43-8d1e612a8022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:56.365955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939dc2b-ae37-446d-9b43-8d1e612a8022 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:56.366445 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939dc2b-ae37-446d-9b43-8d1e612a8022 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:56.367968 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939dc2b-ae37-446d-9b43-8d1e612a8022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:56.370751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-8939dc2b-ae37-446d-9b43-8d1e612a8022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:56.382173 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 824/1649] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:41:56 2022] DELETE /identity/v3/users/16b898f7b0f34154910942558578a19c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:41:56.385576 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231bd34-c69d-4b8e-a23d-9d6ad339e776 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:56.386056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231bd34-c69d-4b8e-a23d-9d6ad339e776 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:56.387761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231bd34-c69d-4b8e-a23d-9d6ad339e776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:56.426430 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939dc2b-ae37-446d-9b43-8d1e612a8022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:56.431388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939dc2b-ae37-446d-9b43-8d1e612a8022 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:56.445070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 826/1650] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:41:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:41:56.459930 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1231bd34-c69d-4b8e-a23d-9d6ad339e776 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:56.465459 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1231bd34-c69d-4b8e-a23d-9d6ad339e776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:56.636013 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 825/1651] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:41:56.674633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939dc2b-ae37-446d-9b43-8d1e612a8022 service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:56.676545 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-8939dc2b-ae37-446d-9b43-8d1e612a8022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:56.693501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939dc2b-ae37-446d-9b43-8d1e612a8022 service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:56.823903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d124dd-b3f1-4977-acb6-0839692de8aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:56.824707 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d124dd-b3f1-4977-acb6-0839692de8aa service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:56.825026 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d124dd-b3f1-4977-acb6-0839692de8aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:56.825324 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d124dd-b3f1-4977-acb6-0839692de8aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:56.843686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d124dd-b3f1-4977-acb6-0839692de8aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:56.845987 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d124dd-b3f1-4977-acb6-0839692de8aa service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:56.863967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 827/1652] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:41:58.084391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76424afd-ea3f-4d4b-825d-27ba7ce0a6e4 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:58.084952 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76424afd-ea3f-4d4b-825d-27ba7ce0a6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:58.084952 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76424afd-ea3f-4d4b-825d-27ba7ce0a6e4 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:58.087487 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 826/1653] 10.222.0.44 () {54 vars in 960 bytes} [Tue Jun 14 19:41:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:41:58.095913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9ab0b-520d-4655-b89b-55bb7e5a78b4 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:58.096443 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9ab0b-520d-4655-b89b-55bb7e5a78b4 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:58.096521 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9ab0b-520d-4655-b89b-55bb7e5a78b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:58.134309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-1bb9ab0b-520d-4655-b89b-55bb7e5a78b4 None None] MFA Rules not processed for user `e98915513674460485413c2dbee87fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:58.136063 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-1bb9ab0b-520d-4655-b89b-55bb7e5a78b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:58.330987 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 828/1654] 10.222.0.44 () {58 vars in 1057 bytes} [Tue Jun 14 19:41:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:58.357226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76424afd-ea3f-4d4b-825d-27ba7ce0a6e4 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:58.384792 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76424afd-ea3f-4d4b-825d-27ba7ce0a6e4 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:58.392461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d9c93-64ae-4b24-a678-9a46ac4f0d3d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98915513674460485413c2dbee87fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:58.398266 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d9c93-64ae-4b24-a678-9a46ac4f0d3d service placement] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:58.398707 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d9c93-64ae-4b24-a678-9a46ac4f0d3d service placement] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:58.399094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d9c93-64ae-4b24-a678-9a46ac4f0d3d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:58.401469 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e70d9c93-64ae-4b24-a678-9a46ac4f0d3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:58.422837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d9c93-64ae-4b24-a678-9a46ac4f0d3d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:58.424784 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d9c93-64ae-4b24-a678-9a46ac4f0d3d service placement] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:58.454946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 827/1655] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:41:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:41:58.817192 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7df8cf-e36c-4ff5-8525-7f65b8833a82 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:58.817517 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7df8cf-e36c-4ff5-8525-7f65b8833a82 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:58.817801 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7df8cf-e36c-4ff5-8525-7f65b8833a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:58.900449 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-ca7df8cf-e36c-4ff5-8525-7f65b8833a82 None None] MFA Rules not processed for user `f60ed90fb1a54339ac563bc649e98989`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:58.902060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-ca7df8cf-e36c-4ff5-8525-7f65b8833a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:59.014322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:41:59.125338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 829/1656] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:59.143118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d9c93-64ae-4b24-a678-9a46ac4f0d3d service placement] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:59.145165 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e70d9c93-64ae-4b24-a678-9a46ac4f0d3d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:59.246234 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7df8cf-e36c-4ff5-8525-7f65b8833a82 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:59.247599 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-ca7df8cf-e36c-4ff5-8525-7f65b8833a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:59.279372 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7df8cf-e36c-4ff5-8525-7f65b8833a82 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:59.308750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e9ef6-f692-4e75-b5e3-4d4dea819432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:59.309940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e9ef6-f692-4e75-b5e3-4d4dea819432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:59.319126 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e9ef6-f692-4e75-b5e3-4d4dea819432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:59.319425 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e9ef6-f692-4e75-b5e3-4d4dea819432 admin admin] PATH_INFO: `/v3/users/d7b608ebc4714a379b30857a06f701c6` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:59.322985 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e9ef6-f692-4e75-b5e3-4d4dea819432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b608ebc4714a379b30857a06f701c6)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:59.325857 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d9c93-64ae-4b24-a678-9a46ac4f0d3d service placement] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:41:59.331649 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e9ef6-f692-4e75-b5e3-4d4dea819432 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:59.348492 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d78c9d-11f7-4e2f-8b72-087e4b2ee8f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:41:59.349202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d78c9d-11f7-4e2f-8b72-087e4b2ee8f2 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:59.349516 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d78c9d-11f7-4e2f-8b72-087e4b2ee8f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:59.349790 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d78c9d-11f7-4e2f-8b72-087e4b2ee8f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:59.376205 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d78c9d-11f7-4e2f-8b72-087e4b2ee8f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:41:59.377909 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d78c9d-11f7-4e2f-8b72-087e4b2ee8f2 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:41:59.429803 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 828/1657] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:41:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:41:59.555224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ac2e9ef6-f692-4e75-b5e3-4d4dea819432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b608ebc4714a379b30857a06f701c6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:41:59.557232 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ac2e9ef6-f692-4e75-b5e3-4d4dea819432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b608ebc4714a379b30857a06f701c6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:41:59.584922 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ac2e9ef6-f692-4e75-b5e3-4d4dea819432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b608ebc4714a379b30857a06f701c6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:41:59.612265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ac2e9ef6-f692-4e75-b5e3-4d4dea819432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b608ebc4714a379b30857a06f701c6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:41:59.645755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ac2e9ef6-f692-4e75-b5e3-4d4dea819432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b608ebc4714a379b30857a06f701c6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:41:59.662321 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 830/1658] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:41:59 2022] DELETE /identity/v3/users/d7b608ebc4714a379b30857a06f701c6 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:41:59.666986 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906da1f3-d842-43d9-a7a9-d5c8abffffdb None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:41:59.667284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906da1f3-d842-43d9-a7a9-d5c8abffffdb None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:41:59.667608 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906da1f3-d842-43d9-a7a9-d5c8abffffdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:41:59.735975 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-906da1f3-d842-43d9-a7a9-d5c8abffffdb None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:41:59.737600 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-906da1f3-d842-43d9-a7a9-d5c8abffffdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:59.952640 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e9ef6-f692-4e75-b5e3-4d4dea819432 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:41:59.954183 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-ac2e9ef6-f692-4e75-b5e3-4d4dea819432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:41:59.960537 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 829/1659] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:41:59.982280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e9ef6-f692-4e75-b5e3-4d4dea819432 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:00.001886 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14a428-4bf1-42eb-91c4-4845dd241cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:00.002791 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14a428-4bf1-42eb-91c4-4845dd241cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:00.003081 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14a428-4bf1-42eb-91c4-4845dd241cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:00.003359 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14a428-4bf1-42eb-91c4-4845dd241cd9 admin admin] PATH_INFO: `/v3/projects/605b211405114782b9b1273be4dbed6a` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:00.005032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906da1f3-d842-43d9-a7a9-d5c8abffffdb None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:00.008250 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-906da1f3-d842-43d9-a7a9-d5c8abffffdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:00.008562 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14a428-4bf1-42eb-91c4-4845dd241cd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=605b211405114782b9b1273be4dbed6a)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:00.012875 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14a428-4bf1-42eb-91c4-4845dd241cd9 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:00.017974 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:00.138474 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2e14a428-4bf1-42eb-91c4-4845dd241cd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '605b211405114782b9b1273be4dbed6a', 'request_id': 'req-2e14a428-4bf1-42eb-91c4-4845dd241cd9'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:00.153189 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2e14a428-4bf1-42eb-91c4-4845dd241cd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '605b211405114782b9b1273be4dbed6a', 'request_id': 'req-2e14a428-4bf1-42eb-91c4-4845dd241cd9'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:00.166359 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2e14a428-4bf1-42eb-91c4-4845dd241cd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '605b211405114782b9b1273be4dbed6a', 'request_id': 'req-2e14a428-4bf1-42eb-91c4-4845dd241cd9'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:00.189094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2e14a428-4bf1-42eb-91c4-4845dd241cd9 admin admin] The token cache is being invalidate because project 605b211405114782b9b1273be4dbed6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:42:00.189584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2e14a428-4bf1-42eb-91c4-4845dd241cd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:00.192663 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2e14a428-4bf1-42eb-91c4-4845dd241cd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:00.197140 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 831/1660] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:41:59 2022] DELETE /identity/v3/projects/605b211405114782b9b1273be4dbed6a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:00.202901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0faa8-1709-4be8-a6f5-78a26a4944da None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:00.203199 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0faa8-1709-4be8-a6f5-78a26a4944da None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:00.203528 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0faa8-1709-4be8-a6f5-78a26a4944da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:00.245692 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906da1f3-d842-43d9-a7a9-d5c8abffffdb None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:00.254465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-72f0faa8-1709-4be8-a6f5-78a26a4944da None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:00.256990 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-72f0faa8-1709-4be8-a6f5-78a26a4944da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:00.339235 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:00.388114 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b6781-6e45-4994-a4a5-f1528f5a87c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:00.389178 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b6781-6e45-4994-a4a5-f1528f5a87c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:00.389760 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b6781-6e45-4994-a4a5-f1528f5a87c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:00.390134 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b6781-6e45-4994-a4a5-f1528f5a87c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:00.399034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bb3b6781-6e45-4994-a4a5-f1528f5a87c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:00.437355 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 832/1661] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:00.443449 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a6009-f403-4c9f-b115-ceb5cdd62a0d None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:00.443579 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a6009-f403-4c9f-b115-ceb5cdd62a0d None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:00.443782 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a6009-f403-4c9f-b115-ceb5cdd62a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:00.482943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-c25a6009-f403-4c9f-b115-ceb5cdd62a0d None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:00.486207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c25a6009-f403-4c9f-b115-ceb5cdd62a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:00.513575 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 833/1662] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:00.517901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a6009-f403-4c9f-b115-ceb5cdd62a0d None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:00.540856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a6009-f403-4c9f-b115-ceb5cdd62a0d None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:00.569777 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8823bf-7ad8-4a04-bac1-8d344e925c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:00.570400 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8823bf-7ad8-4a04-bac1-8d344e925c0e admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:00.570804 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8823bf-7ad8-4a04-bac1-8d344e925c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:00.571090 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8823bf-7ad8-4a04-bac1-8d344e925c0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:00.571841 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8823bf-7ad8-4a04-bac1-8d344e925c0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:42:00.572155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8823bf-7ad8-4a04-bac1-8d344e925c0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:00.578080 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8823bf-7ad8-4a04-bac1-8d344e925c0e admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:00.613181 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 834/1663] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:42:00.615045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8823bf-7ad8-4a04-bac1-8d344e925c0e admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:00.650702 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8823bf-7ad8-4a04-bac1-8d344e925c0e admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:00.660957 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b6781-6e45-4994-a4a5-f1528f5a87c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:00.661269 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699ea17-a90e-41ed-832d-7089a1a1df41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:00.661982 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699ea17-a90e-41ed-832d-7089a1a1df41 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:00.662280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699ea17-a90e-41ed-832d-7089a1a1df41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:00.662552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699ea17-a90e-41ed-832d-7089a1a1df41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:00.663313 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699ea17-a90e-41ed-832d-7089a1a1df41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:00.663973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b6781-6e45-4994-a4a5-f1528f5a87c3 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:00.667665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699ea17-a90e-41ed-832d-7089a1a1df41 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:00.696514 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 830/1664] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:00.736512 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 835/1665] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:00 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:42:00.741150 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b6781-6e45-4994-a4a5-f1528f5a87c3 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:00.758718 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b6781-6e45-4994-a4a5-f1528f5a87c3 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:00.909156 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d4f4c-db1b-4851-9d23-1be1cc2cc14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:00.909892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d4f4c-db1b-4851-9d23-1be1cc2cc14a admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:00.910177 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d4f4c-db1b-4851-9d23-1be1cc2cc14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:00.910453 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d4f4c-db1b-4851-9d23-1be1cc2cc14a admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:00.911828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d4f4c-db1b-4851-9d23-1be1cc2cc14a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:00.920006 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d4f4c-db1b-4851-9d23-1be1cc2cc14a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:00.958390 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:00.981714 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699ea17-a90e-41ed-832d-7089a1a1df41 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:00.982003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 831/1666] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:00 2022] POST /identity/v3/users => generated 290 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:01.003330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699ea17-a90e-41ed-832d-7089a1a1df41 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:01.023589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f9cb4-22bd-4cb8-bf8d-9ad0d2caf250 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:01.023899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f9cb4-22bd-4cb8-bf8d-9ad0d2caf250 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:01.024157 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f9cb4-22bd-4cb8-bf8d-9ad0d2caf250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:01.025895 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ccf88-c7cf-4b48-9a38-0019eee3e99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:01.026732 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ccf88-c7cf-4b48-9a38-0019eee3e99f admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:01.027030 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ccf88-c7cf-4b48-9a38-0019eee3e99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:01.027963 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ccf88-c7cf-4b48-9a38-0019eee3e99f admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:01.032475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ccf88-c7cf-4b48-9a38-0019eee3e99f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:01.034190 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ccf88-c7cf-4b48-9a38-0019eee3e99f admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:01.072703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 836/1667] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:01.073719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ccf88-c7cf-4b48-9a38-0019eee3e99f admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:01.098553 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-fa4f9cb4-22bd-4cb8-bf8d-9ad0d2caf250 None None] MFA Rules not processed for user `38b80bb0d8a64940a3cbecf28fd1aa7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:01.100689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-fa4f9cb4-22bd-4cb8-bf8d-9ad0d2caf250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:01.108938 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ccf88-c7cf-4b48-9a38-0019eee3e99f admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:01.131731 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80aea1b-729c-46eb-914f-118eb7bdd569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:01.132338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80aea1b-729c-46eb-914f-118eb7bdd569 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:01.132635 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80aea1b-729c-46eb-914f-118eb7bdd569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:01.133502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80aea1b-729c-46eb-914f-118eb7bdd569 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:01.133839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80aea1b-729c-46eb-914f-118eb7bdd569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:01.135410 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80aea1b-729c-46eb-914f-118eb7bdd569 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:01.173026 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 837/1668] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:01.177284 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80aea1b-729c-46eb-914f-118eb7bdd569 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:01.217015 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80aea1b-729c-46eb-914f-118eb7bdd569 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:01.230600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504304f-d409-48f5-bd3a-78f9a2d4a7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:01.231816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504304f-d409-48f5-bd3a-78f9a2d4a7c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:01.232106 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504304f-d409-48f5-bd3a-78f9a2d4a7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:01.232406 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504304f-d409-48f5-bd3a-78f9a2d4a7c6 admin admin] PATH_INFO: `/v3/projects/e68c314e3d2040ca97ae138b56ab62c1/users/7e3249cf6be84f4eb895903b30c2aad2/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:01.273089 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504304f-d409-48f5-bd3a-78f9a2d4a7c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e68c314e3d2040ca97ae138b56ab62c1, user_id=7e3249cf6be84f4eb895903b30c2aad2, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:01.278129 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504304f-d409-48f5-bd3a-78f9a2d4a7c6 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:01.284321 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 832/1669] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:01 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:01.289306 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f9cb4-22bd-4cb8-bf8d-9ad0d2caf250 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:01.291075 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-fa4f9cb4-22bd-4cb8-bf8d-9ad0d2caf250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:01.307964 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 838/1670] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:01 2022] PUT /identity/v3/projects/e68c314e3d2040ca97ae138b56ab62c1/users/7e3249cf6be84f4eb895903b30c2aad2/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:01.315842 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f9cb4-22bd-4cb8-bf8d-9ad0d2caf250 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:01.319486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3e550-6f26-4f39-9165-dfdb491d676c None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:01.319777 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3e550-6f26-4f39-9165-dfdb491d676c None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:01.320092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b3e550-6f26-4f39-9165-dfdb491d676c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:01.375330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-47b3e550-6f26-4f39-9165-dfdb491d676c None None] MFA Rules not processed for user `7e3249cf6be84f4eb895903b30c2aad2`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:01.376267 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-47b3e550-6f26-4f39-9165-dfdb491d676c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:01.420854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d1b3c-fb2e-40f6-a377-4cbd821d59b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:01.422168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d1b3c-fb2e-40f6-a377-4cbd821d59b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:01.422780 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d1b3c-fb2e-40f6-a377-4cbd821d59b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:01.423328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d1b3c-fb2e-40f6-a377-4cbd821d59b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:01.424411 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d1b3c-fb2e-40f6-a377-4cbd821d59b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:01.428829 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d1b3c-fb2e-40f6-a377-4cbd821d59b5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:01.486692 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 833/1671] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:01 2022] POST /identity/v3/projects => generated 403 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:01.488318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d1b3c-fb2e-40f6-a377-4cbd821d59b5 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:01.562323 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 839/1672] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:42:01.566731 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3e550-6f26-4f39-9165-dfdb491d676c None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:01.603901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b3e550-6f26-4f39-9165-dfdb491d676c None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:01.656005 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d1b3c-fb2e-40f6-a377-4cbd821d59b5 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:01.670605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f08452-6420-404f-bc43-8994696ce520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:01.671651 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f08452-6420-404f-bc43-8994696ce520 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:01.675382 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f08452-6420-404f-bc43-8994696ce520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:01.675822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f08452-6420-404f-bc43-8994696ce520 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:01.677236 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f08452-6420-404f-bc43-8994696ce520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:01.677786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:01.684167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f08452-6420-404f-bc43-8994696ce520 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:01.742345 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 834/1673] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:01 2022] POST /identity/v3/users => generated 308 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:01.743647 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f08452-6420-404f-bc43-8994696ce520 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:01.759144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:01.766604 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f08452-6420-404f-bc43-8994696ce520 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:01.779170 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7864a5-b565-40a5-b314-914bf6cbdfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:01.780937 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7864a5-b565-40a5-b314-914bf6cbdfe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:01.781472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7864a5-b565-40a5-b314-914bf6cbdfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:01.781584 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7864a5-b565-40a5-b314-914bf6cbdfe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:01.783710 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d53ae7-689d-4184-b57a-e37c4e0cd2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:01.783840 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7864a5-b565-40a5-b314-914bf6cbdfe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:01.784403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d53ae7-689d-4184-b57a-e37c4e0cd2b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:01.784697 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d53ae7-689d-4184-b57a-e37c4e0cd2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:01.784980 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d53ae7-689d-4184-b57a-e37c4e0cd2b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:01.785733 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d53ae7-689d-4184-b57a-e37c4e0cd2b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:01.789680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d53ae7-689d-4184-b57a-e37c4e0cd2b1 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:01.792109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7864a5-b565-40a5-b314-914bf6cbdfe9 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:01.823619 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 835/1674] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:01.825237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7864a5-b565-40a5-b314-914bf6cbdfe9 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:01.852322 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7864a5-b565-40a5-b314-914bf6cbdfe9 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:01.861501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3cefa-9806-4b85-b707-3e6d6fe31e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:01.863248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3cefa-9806-4b85-b707-3e6d6fe31e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:01.863937 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3cefa-9806-4b85-b707-3e6d6fe31e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:01.864310 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3cefa-9806-4b85-b707-3e6d6fe31e32 admin admin] PATH_INFO: `/v3/projects/81d1618cbce14081842afdb30404782b/users/7bbcd6732d0c415abf28b3e33efce73d/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:01.890066 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 840/1675] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:01 2022] POST /identity/v3/projects => generated 379 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:42:01.891328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d53ae7-689d-4184-b57a-e37c4e0cd2b1 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:01.900038 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3cefa-9806-4b85-b707-3e6d6fe31e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d1618cbce14081842afdb30404782b, user_id=7bbcd6732d0c415abf28b3e33efce73d, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:01.921990 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3cefa-9806-4b85-b707-3e6d6fe31e32 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:01.969921 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 836/1676] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:01 2022] PUT /identity/v3/projects/81d1618cbce14081842afdb30404782b/users/7bbcd6732d0c415abf28b3e33efce73d/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:01.974086 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3cefa-9806-4b85-b707-3e6d6fe31e32 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:02.070225 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d53ae7-689d-4184-b57a-e37c4e0cd2b1 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:02.182820 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3cefa-9806-4b85-b707-3e6d6fe31e32 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:02.196583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dc8de-d33a-472c-9378-714d392d23da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:02.198657 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dc8de-d33a-472c-9378-714d392d23da admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:02.199398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dc8de-d33a-472c-9378-714d392d23da admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:02.199651 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81df2a4-8c38-452a-8f72-0f0a294edcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:02.202094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81df2a4-8c38-452a-8f72-0f0a294edcdb admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:02.202530 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dc8de-d33a-472c-9378-714d392d23da admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:02.203385 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dc8de-d33a-472c-9378-714d392d23da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:02.203748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81df2a4-8c38-452a-8f72-0f0a294edcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:02.204124 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81df2a4-8c38-452a-8f72-0f0a294edcdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:02.206637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dc8de-d33a-472c-9378-714d392d23da admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:02.208152 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81df2a4-8c38-452a-8f72-0f0a294edcdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:02.209519 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81df2a4-8c38-452a-8f72-0f0a294edcdb admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:02.221798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 837/1677] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:02.223507 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb451b6-8cc9-4046-8d21-ded22b3884ee None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:02.224203 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb451b6-8cc9-4046-8d21-ded22b3884ee None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:02.224638 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb451b6-8cc9-4046-8d21-ded22b3884ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:02.252810 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-bdb451b6-8cc9-4046-8d21-ded22b3884ee None None] MFA Rules not processed for user `d16be8774cb842199cfb9e3b9965bd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:02.254488 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bdb451b6-8cc9-4046-8d21-ded22b3884ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:02.256417 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 841/1678] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:01 2022] POST /identity/v3/users => generated 296 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:42:02.258832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dc8de-d33a-472c-9378-714d392d23da admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:02.278239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dc8de-d33a-472c-9378-714d392d23da admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:02.284908 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46fea3-7b8e-4fab-9d40-44caae5b444f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:02.286453 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46fea3-7b8e-4fab-9d40-44caae5b444f admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:02.287105 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46fea3-7b8e-4fab-9d40-44caae5b444f admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:02.287576 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46fea3-7b8e-4fab-9d40-44caae5b444f admin admin] PATH_INFO: `/v3/projects/81d1618cbce14081842afdb30404782b/users/7bbcd6732d0c415abf28b3e33efce73d/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:02.289873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46fea3-7b8e-4fab-9d40-44caae5b444f admin admin] RBAC: Authorizing `identity:create_grant(project_id=81d1618cbce14081842afdb30404782b, user_id=7bbcd6732d0c415abf28b3e33efce73d, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:02.293930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46fea3-7b8e-4fab-9d40-44caae5b444f admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:02.335886 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 842/1679] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:02 2022] PUT /identity/v3/projects/81d1618cbce14081842afdb30404782b/users/7bbcd6732d0c415abf28b3e33efce73d/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:02.337219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46fea3-7b8e-4fab-9d40-44caae5b444f admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:02.353744 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 838/1680] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jun 14 19:42:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:02.528469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:02.582654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46fea3-7b8e-4fab-9d40-44caae5b444f admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:02.598521 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c95cac-a66a-4ca6-9e19-47d4605b7bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:02.599384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c95cac-a66a-4ca6-9e19-47d4605b7bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:02.600849 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c95cac-a66a-4ca6-9e19-47d4605b7bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:02.601143 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c95cac-a66a-4ca6-9e19-47d4605b7bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:02.603576 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c95cac-a66a-4ca6-9e19-47d4605b7bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:02.610905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c95cac-a66a-4ca6-9e19-47d4605b7bd8 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:02.627946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb451b6-8cc9-4046-8d21-ded22b3884ee None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:02.629365 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bdb451b6-8cc9-4046-8d21-ded22b3884ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:02.641988 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 843/1681] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:02.643098 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c95cac-a66a-4ca6-9e19-47d4605b7bd8 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:02.657706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c95cac-a66a-4ca6-9e19-47d4605b7bd8 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:02.664214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6bd51-59f5-46e9-bd42-7f9345fc47ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:02.665208 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6bd51-59f5-46e9-bd42-7f9345fc47ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:02.666221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6bd51-59f5-46e9-bd42-7f9345fc47ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:02.666572 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6bd51-59f5-46e9-bd42-7f9345fc47ba admin admin] PATH_INFO: `/v3/projects/55e1f5e3613c4abf9d762abf1b44cb79/users/eb857cee9c3c4098aec777a7f319f307/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:02.695070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6bd51-59f5-46e9-bd42-7f9345fc47ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e1f5e3613c4abf9d762abf1b44cb79, user_id=eb857cee9c3c4098aec777a7f319f307, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:02.699158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6bd51-59f5-46e9-bd42-7f9345fc47ba admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:02.749477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 844/1682] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:02 2022] PUT /identity/v3/projects/55e1f5e3613c4abf9d762abf1b44cb79/users/eb857cee9c3c4098aec777a7f319f307/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:02.750764 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6bd51-59f5-46e9-bd42-7f9345fc47ba admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:02.806278 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb451b6-8cc9-4046-8d21-ded22b3884ee None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:02.823823 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:02.927439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61116f7-0885-4609-8e34-ad1ebbcdf8bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fff5414195f4873bcc8752c914b6b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:02.928219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61116f7-0885-4609-8e34-ad1ebbcdf8bf service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:02.928599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61116f7-0885-4609-8e34-ad1ebbcdf8bf service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:02.928974 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61116f7-0885-4609-8e34-ad1ebbcdf8bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:02.955334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6bd51-59f5-46e9-bd42-7f9345fc47ba admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:02.963590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd25a8f-69ae-4494-83dc-99ee1e2a8088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:02.964291 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd25a8f-69ae-4494-83dc-99ee1e2a8088 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:02.964616 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd25a8f-69ae-4494-83dc-99ee1e2a8088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:02.965518 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd25a8f-69ae-4494-83dc-99ee1e2a8088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:02.966267 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd25a8f-69ae-4494-83dc-99ee1e2a8088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:02.967931 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd25a8f-69ae-4494-83dc-99ee1e2a8088 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:03.001773 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 845/1683] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:03.003228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd25a8f-69ae-4494-83dc-99ee1e2a8088 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:03.005899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-6dd25a8f-69ae-4494-83dc-99ee1e2a8088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:03.037403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd25a8f-69ae-4494-83dc-99ee1e2a8088 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:03.054720 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61116f7-0885-4609-8e34-ad1ebbcdf8bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:03.057231 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61116f7-0885-4609-8e34-ad1ebbcdf8bf service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:03.065418 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35e084-acb2-46df-9656-31a8f6b38e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:03.066337 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35e084-acb2-46df-9656-31a8f6b38e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:03.066628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35e084-acb2-46df-9656-31a8f6b38e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:03.067483 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35e084-acb2-46df-9656-31a8f6b38e20 admin admin] PATH_INFO: `/v3/projects/b6c6e94029f24878baa7012e883ce5af` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:03.068893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35e084-acb2-46df-9656-31a8f6b38e20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c6e94029f24878baa7012e883ce5af)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:03.071206 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35e084-acb2-46df-9656-31a8f6b38e20 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:03.077354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 839/1684] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jun 14 19:42:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 19:42:03.079678 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61116f7-0885-4609-8e34-ad1ebbcdf8bf service swift] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:03.113593 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61116f7-0885-4609-8e34-ad1ebbcdf8bf service swift] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:03.119973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43172f-05db-452f-adb1-74bff5abc6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:03.121276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43172f-05db-452f-adb1-74bff5abc6ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:03.121634 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43172f-05db-452f-adb1-74bff5abc6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:03.122073 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43172f-05db-452f-adb1-74bff5abc6ab admin admin] PATH_INFO: `/v3/projects/55e1f5e3613c4abf9d762abf1b44cb79/users/eb857cee9c3c4098aec777a7f319f307/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:03.124598 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43172f-05db-452f-adb1-74bff5abc6ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e1f5e3613c4abf9d762abf1b44cb79, user_id=eb857cee9c3c4098aec777a7f319f307, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:03.145644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43172f-05db-452f-adb1-74bff5abc6ab admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:03.177856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-5e35e084-acb2-46df-9656-31a8f6b38e20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c6e94029f24878baa7012e883ce5af', 'request_id': 'req-5e35e084-acb2-46df-9656-31a8f6b38e20'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:03.187964 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-5e35e084-acb2-46df-9656-31a8f6b38e20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c6e94029f24878baa7012e883ce5af', 'request_id': 'req-5e35e084-acb2-46df-9656-31a8f6b38e20'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:03.197593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-5e35e084-acb2-46df-9656-31a8f6b38e20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c6e94029f24878baa7012e883ce5af', 'request_id': 'req-5e35e084-acb2-46df-9656-31a8f6b38e20'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:03.199095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 840/1685] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:03 2022] PUT /identity/v3/projects/55e1f5e3613c4abf9d762abf1b44cb79/users/eb857cee9c3c4098aec777a7f319f307/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:03.214064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db709033-9109-484e-8828-3166e5c543a5 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:03.214764 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db709033-9109-484e-8828-3166e5c543a5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:03.215303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db709033-9109-484e-8828-3166e5c543a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:03.267267 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-5e35e084-acb2-46df-9656-31a8f6b38e20 admin admin] The token cache is being invalidate because project b6c6e94029f24878baa7012e883ce5af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:42:03.267567 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-5e35e084-acb2-46df-9656-31a8f6b38e20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:03.271227 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-5e35e084-acb2-46df-9656-31a8f6b38e20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:03.274303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 846/1686] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:42:03 2022] DELETE /identity/v3/projects/b6c6e94029f24878baa7012e883ce5af => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:03.286226 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdbe73-5a53-423e-aa5e-1de17d509143 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:03.286226 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdbe73-5a53-423e-aa5e-1de17d509143 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:03.287664 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdbe73-5a53-423e-aa5e-1de17d509143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:03.313211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-db709033-9109-484e-8828-3166e5c543a5 None None] MFA Rules not processed for user `eb857cee9c3c4098aec777a7f319f307`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:03.317250 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-db709033-9109-484e-8828-3166e5c543a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:03.358832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-27bdbe73-5a53-423e-aa5e-1de17d509143 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:03.366157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-27bdbe73-5a53-423e-aa5e-1de17d509143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:03.564820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:03.717027 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 841/1687] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 504 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:42:03.726869 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db709033-9109-484e-8828-3166e5c543a5 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:03.738157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 847/1688] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:03.738363 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-db709033-9109-484e-8828-3166e5c543a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:03.740231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22aefd6-ccbd-456e-b2ee-5d3ff4234638 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:03.740596 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22aefd6-ccbd-456e-b2ee-5d3ff4234638 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:03.740955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22aefd6-ccbd-456e-b2ee-5d3ff4234638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:03.784358 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-b22aefd6-ccbd-456e-b2ee-5d3ff4234638 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:03.785650 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b22aefd6-ccbd-456e-b2ee-5d3ff4234638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:03.817672 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 848/1689] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:42:03.822483 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22aefd6-ccbd-456e-b2ee-5d3ff4234638 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:03.851649 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22aefd6-ccbd-456e-b2ee-5d3ff4234638 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:03.860661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:03.864716 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bbde0-116b-471e-baea-7e545dcae9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:03.865437 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bbde0-116b-471e-baea-7e545dcae9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:03.865825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bbde0-116b-471e-baea-7e545dcae9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:03.866001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bbde0-116b-471e-baea-7e545dcae9c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:03.868187 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bbde0-116b-471e-baea-7e545dcae9c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:42:03.868511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bbde0-116b-471e-baea-7e545dcae9c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:03.876597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bbde0-116b-471e-baea-7e545dcae9c0 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:03.911966 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 849/1690] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:42:03.917342 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bbde0-116b-471e-baea-7e545dcae9c0 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:03.944006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bbde0-116b-471e-baea-7e545dcae9c0 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:03.955864 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce1426-0f1e-4cc1-8a8f-d37a5372aecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:03.960802 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce1426-0f1e-4cc1-8a8f-d37a5372aecf admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:03.961533 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce1426-0f1e-4cc1-8a8f-d37a5372aecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:03.961533 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce1426-0f1e-4cc1-8a8f-d37a5372aecf admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:03.963851 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce1426-0f1e-4cc1-8a8f-d37a5372aecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:03.968457 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce1426-0f1e-4cc1-8a8f-d37a5372aecf admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:03.969195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db709033-9109-484e-8828-3166e5c543a5 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:03.974877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161faa3-768c-4a67-99ac-796bb07c6d9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:03.976085 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161faa3-768c-4a67-99ac-796bb07c6d9b service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:03.977854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161faa3-768c-4a67-99ac-796bb07c6d9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:03.978424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161faa3-768c-4a67-99ac-796bb07c6d9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:04.002400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161faa3-768c-4a67-99ac-796bb07c6d9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:04.004863 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161faa3-768c-4a67-99ac-796bb07c6d9b service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:04.052305 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 850/1691] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:03 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:04.056352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce1426-0f1e-4cc1-8a8f-d37a5372aecf admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:04.058979 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 842/1692] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:04.242047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161faa3-768c-4a67-99ac-796bb07c6d9b service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:04.243270 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce1426-0f1e-4cc1-8a8f-d37a5372aecf admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:04.251292 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161faa3-768c-4a67-99ac-796bb07c6d9b service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:04.262837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dc1bb-4401-4068-936b-f63294dc350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:04.263532 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dc1bb-4401-4068-936b-f63294dc350c admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:04.263965 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dc1bb-4401-4068-936b-f63294dc350c admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:04.264250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61dc1bb-4401-4068-936b-f63294dc350c admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:04.264948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dc1bb-4401-4068-936b-f63294dc350c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:04.269404 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61dc1bb-4401-4068-936b-f63294dc350c admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:04.327693 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 851/1693] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:04 2022] POST /identity/v3/users => generated 287 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:04.330528 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dc1bb-4401-4068-936b-f63294dc350c admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:04.357960 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61dc1bb-4401-4068-936b-f63294dc350c admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:04.374267 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baf971-78a7-49e7-a61c-73da911eb871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:04.376450 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baf971-78a7-49e7-a61c-73da911eb871 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:04.377677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baf971-78a7-49e7-a61c-73da911eb871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:04.378119 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baf971-78a7-49e7-a61c-73da911eb871 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:04.380573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7baf971-78a7-49e7-a61c-73da911eb871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:04.384554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7baf971-78a7-49e7-a61c-73da911eb871 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:04.409676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 852/1694] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:04.410953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baf971-78a7-49e7-a61c-73da911eb871 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:04.432399 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baf971-78a7-49e7-a61c-73da911eb871 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:04.433369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480775f3-8219-4cf9-a6ac-ccf094c4c55e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:04.434056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480775f3-8219-4cf9-a6ac-ccf094c4c55e service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:04.434350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480775f3-8219-4cf9-a6ac-ccf094c4c55e service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:04.434629 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480775f3-8219-4cf9-a6ac-ccf094c4c55e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:04.436534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-480775f3-8219-4cf9-a6ac-ccf094c4c55e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:04.444406 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ff659-b21d-4c9a-bbcd-3bcfa73e43e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:04.445214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ff659-b21d-4c9a-bbcd-3bcfa73e43e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:04.447660 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ff659-b21d-4c9a-bbcd-3bcfa73e43e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:04.448059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ff659-b21d-4c9a-bbcd-3bcfa73e43e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:04.449561 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ff659-b21d-4c9a-bbcd-3bcfa73e43e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:04.454109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09ff659-b21d-4c9a-bbcd-3bcfa73e43e6 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:04.482455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 853/1695] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:04.483910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ff659-b21d-4c9a-bbcd-3bcfa73e43e6 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:04.504042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ff659-b21d-4c9a-bbcd-3bcfa73e43e6 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:04.524601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255bcfb-a881-480b-8fe2-3e01bb47dcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:04.527991 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255bcfb-a881-480b-8fe2-3e01bb47dcd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:04.533353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255bcfb-a881-480b-8fe2-3e01bb47dcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:04.533827 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255bcfb-a881-480b-8fe2-3e01bb47dcd8 admin admin] PATH_INFO: `/v3/projects/d14122819acf4334b67a18fa8772393d/users/9474b6bb32044a4aaf208bdd72402032/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:04.576159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255bcfb-a881-480b-8fe2-3e01bb47dcd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14122819acf4334b67a18fa8772393d, user_id=9474b6bb32044a4aaf208bdd72402032, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:04.584219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255bcfb-a881-480b-8fe2-3e01bb47dcd8 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:04.591220 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480775f3-8219-4cf9-a6ac-ccf094c4c55e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:04.592710 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480775f3-8219-4cf9-a6ac-ccf094c4c55e service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:04.631946 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 854/1696] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:04 2022] PUT /identity/v3/projects/d14122819acf4334b67a18fa8772393d/users/9474b6bb32044a4aaf208bdd72402032/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:04.639000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37a874-520a-451d-a35b-a3db695872d3 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:04.639498 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37a874-520a-451d-a35b-a3db695872d3 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:04.639854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37a874-520a-451d-a35b-a3db695872d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:04.658635 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 843/1697] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:04.701446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-6e37a874-520a-451d-a35b-a3db695872d3 None None] MFA Rules not processed for user `9474b6bb32044a4aaf208bdd72402032`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:04.703045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-6e37a874-520a-451d-a35b-a3db695872d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:04.761302 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:04.951568 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 855/1698] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:04.954113 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480775f3-8219-4cf9-a6ac-ccf094c4c55e service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:04.971333 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480775f3-8219-4cf9-a6ac-ccf094c4c55e service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:05.226564 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c2ab5-9f2f-4b28-a27b-b51acd80e675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:05.228715 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c2ab5-9f2f-4b28-a27b-b51acd80e675 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:05.228864 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c2ab5-9f2f-4b28-a27b-b51acd80e675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:05.229095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c2ab5-9f2f-4b28-a27b-b51acd80e675 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:05.229966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c2ab5-9f2f-4b28-a27b-b51acd80e675 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:05.237931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c2ab5-9f2f-4b28-a27b-b51acd80e675 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:05.348854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37a874-520a-451d-a35b-a3db695872d3 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:05.364040 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 844/1699] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:04 2022] POST /identity/v3/projects => generated 373 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:05.373801 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37a874-520a-451d-a35b-a3db695872d3 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:05.555986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99213de5-ee12-4321-9fad-6d08d4ca373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:05.556733 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99213de5-ee12-4321-9fad-6d08d4ca373d admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:05.557499 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99213de5-ee12-4321-9fad-6d08d4ca373d admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:05.557807 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99213de5-ee12-4321-9fad-6d08d4ca373d admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:05.560287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99213de5-ee12-4321-9fad-6d08d4ca373d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:05.566427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99213de5-ee12-4321-9fad-6d08d4ca373d admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:05.602637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 856/1700] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:05 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:05.606518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c2ab5-9f2f-4b28-a27b-b51acd80e675 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:05.622893 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c2ab5-9f2f-4b28-a27b-b51acd80e675 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:05.639865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5dca80-b40e-4e44-a3fe-f491b47748bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:05.642278 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5dca80-b40e-4e44-a3fe-f491b47748bc admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:05.643402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5dca80-b40e-4e44-a3fe-f491b47748bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:05.644855 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5dca80-b40e-4e44-a3fe-f491b47748bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:05.650773 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5dca80-b40e-4e44-a3fe-f491b47748bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:05.657466 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5dca80-b40e-4e44-a3fe-f491b47748bc admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:05.669889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:05.695350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 845/1701] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:05.700057 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99213de5-ee12-4321-9fad-6d08d4ca373d admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:05.722761 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99213de5-ee12-4321-9fad-6d08d4ca373d admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:05.731412 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38715f5-6a70-4e35-b504-0dd7803a9de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:05.732469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38715f5-6a70-4e35-b504-0dd7803a9de6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:05.732897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38715f5-6a70-4e35-b504-0dd7803a9de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:05.735591 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38715f5-6a70-4e35-b504-0dd7803a9de6 admin admin] PATH_INFO: `/v3/projects/1549df26bb034fe696a5b09ae99219be/users/7d662c2575d642be98124feafe165fc3/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:05.770286 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38715f5-6a70-4e35-b504-0dd7803a9de6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1549df26bb034fe696a5b09ae99219be, user_id=7d662c2575d642be98124feafe165fc3, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:05.773504 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38715f5-6a70-4e35-b504-0dd7803a9de6 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:05.804369 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 857/1702] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:05 2022] PUT /identity/v3/projects/1549df26bb034fe696a5b09ae99219be/users/7d662c2575d642be98124feafe165fc3/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:42:05.808818 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5dca80-b40e-4e44-a3fe-f491b47748bc admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:05.833752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5dca80-b40e-4e44-a3fe-f491b47748bc admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:05.989748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ccca7-b98e-4e7b-9405-ab69a7d1c9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:05.989748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ccca7-b98e-4e7b-9405-ab69a7d1c9ea admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:05.989748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ccca7-b98e-4e7b-9405-ab69a7d1c9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:05.989748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ccca7-b98e-4e7b-9405-ab69a7d1c9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:05.990921 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ccca7-b98e-4e7b-9405-ab69a7d1c9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:05.996971 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ccca7-b98e-4e7b-9405-ab69a7d1c9ea admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:06.062785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38715f5-6a70-4e35-b504-0dd7803a9de6 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:06.063275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 846/1703] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:06.087132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38715f5-6a70-4e35-b504-0dd7803a9de6 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:06.106734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96560347-e4db-479b-aa20-a8f6fe692e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:06.108540 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96560347-e4db-479b-aa20-a8f6fe692e2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:06.110831 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96560347-e4db-479b-aa20-a8f6fe692e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:06.111401 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96560347-e4db-479b-aa20-a8f6fe692e2e admin admin] PATH_INFO: `/v3/projects/1549df26bb034fe696a5b09ae99219be/users/7d662c2575d642be98124feafe165fc3/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:06.121579 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96560347-e4db-479b-aa20-a8f6fe692e2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1549df26bb034fe696a5b09ae99219be, user_id=7d662c2575d642be98124feafe165fc3, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:06.134549 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96560347-e4db-479b-aa20-a8f6fe692e2e admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:06.183281 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 858/1704] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:06 2022] PUT /identity/v3/projects/1549df26bb034fe696a5b09ae99219be/users/7d662c2575d642be98124feafe165fc3/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:06.186556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4023758-a42c-4d38-a9e4-1d45d4f0e754 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:06.186913 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4023758-a42c-4d38-a9e4-1d45d4f0e754 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:06.187303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4023758-a42c-4d38-a9e4-1d45d4f0e754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:06.282993 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d4023758-a42c-4d38-a9e4-1d45d4f0e754 None None] MFA Rules not processed for user `7d662c2575d642be98124feafe165fc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:06.288724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d4023758-a42c-4d38-a9e4-1d45d4f0e754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:06.596547 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 847/1705] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:06.610844 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96560347-e4db-479b-aa20-a8f6fe692e2e admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:06.863146 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96560347-e4db-479b-aa20-a8f6fe692e2e admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:06.888305 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26553b79-20a1-4f08-856f-f962c56fb7f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:06.895026 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26553b79-20a1-4f08-856f-f962c56fb7f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:06.895355 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26553b79-20a1-4f08-856f-f962c56fb7f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:06.897512 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26553b79-20a1-4f08-856f-f962c56fb7f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:06.932775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26553b79-20a1-4f08-856f-f962c56fb7f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:06.936569 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26553b79-20a1-4f08-856f-f962c56fb7f3 service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:06.971248 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 859/1706] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:07.885554 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4023758-a42c-4d38-a9e4-1d45d4f0e754 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:08.117101 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4023758-a42c-4d38-a9e4-1d45d4f0e754 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:08.123171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d542e-c94c-4fb7-82cc-04d2bddfabc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:08.124173 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d542e-c94c-4fb7-82cc-04d2bddfabc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:08.124538 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d542e-c94c-4fb7-82cc-04d2bddfabc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:08.125103 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d542e-c94c-4fb7-82cc-04d2bddfabc1 admin admin] PATH_INFO: `/v3/users/9474b6bb32044a4aaf208bdd72402032` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:08.126420 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d542e-c94c-4fb7-82cc-04d2bddfabc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9474b6bb32044a4aaf208bdd72402032)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:08.130452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d542e-c94c-4fb7-82cc-04d2bddfabc1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:08.201028 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:08.279678 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ca1d542e-c94c-4fb7-82cc-04d2bddfabc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9474b6bb32044a4aaf208bdd72402032'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:08.283121 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ca1d542e-c94c-4fb7-82cc-04d2bddfabc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9474b6bb32044a4aaf208bdd72402032'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:08.328319 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ca1d542e-c94c-4fb7-82cc-04d2bddfabc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9474b6bb32044a4aaf208bdd72402032'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:08.353541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ca1d542e-c94c-4fb7-82cc-04d2bddfabc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9474b6bb32044a4aaf208bdd72402032'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:08.436354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ca1d542e-c94c-4fb7-82cc-04d2bddfabc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9474b6bb32044a4aaf208bdd72402032'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:08.466131 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 848/1707] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:42:07 2022] DELETE /identity/v3/users/9474b6bb32044a4aaf208bdd72402032 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:08.471107 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92472de-046c-40d8-b59f-dc810606a872 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:08.471645 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92472de-046c-40d8-b59f-dc810606a872 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:08.471742 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92472de-046c-40d8-b59f-dc810606a872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:08.543140 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-a92472de-046c-40d8-b59f-dc810606a872 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:08.544239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-a92472de-046c-40d8-b59f-dc810606a872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:08.615031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:08.683033 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364639f-84b8-4dcc-8014-792242f94f58 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:08.683423 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364639f-84b8-4dcc-8014-792242f94f58 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:08.683707 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364639f-84b8-4dcc-8014-792242f94f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:08.813264 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a364639f-84b8-4dcc-8014-792242f94f58 None None] MFA Rules not processed for user `791ed0f433834b4599d6bc825440279d`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:08.814744 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a364639f-84b8-4dcc-8014-792242f94f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:08.867513 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 860/1708] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:08.880811 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6e29c-dd83-48fc-b51c-b1a43ea36b63 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:08.881506 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6e29c-dd83-48fc-b51c-b1a43ea36b63 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:08.882022 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6e29c-dd83-48fc-b51c-b1a43ea36b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:08.966851 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-ccf6e29c-dd83-48fc-b51c-b1a43ea36b63 None None] MFA Rules not processed for user `7bbcd6732d0c415abf28b3e33efce73d`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:08.968329 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-ccf6e29c-dd83-48fc-b51c-b1a43ea36b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:09.138269 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 849/1709] 10.222.0.46 () {58 vars in 1015 bytes} [Tue Jun 14 19:42:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:09.142243 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 861/1710] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:08 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:42:09.173321 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364639f-84b8-4dcc-8014-792242f94f58 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:09.179176 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a364639f-84b8-4dcc-8014-792242f94f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:09.249025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364639f-84b8-4dcc-8014-792242f94f58 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:09.263620 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41892aa0-f9cd-45bc-9ae8-4ef9c3ce07e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:09.264625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41892aa0-f9cd-45bc-9ae8-4ef9c3ce07e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:09.271434 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41892aa0-f9cd-45bc-9ae8-4ef9c3ce07e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:09.272918 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41892aa0-f9cd-45bc-9ae8-4ef9c3ce07e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:09.309693 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41892aa0-f9cd-45bc-9ae8-4ef9c3ce07e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:09.322711 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41892aa0-f9cd-45bc-9ae8-4ef9c3ce07e8 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:09.327127 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6e29c-dd83-48fc-b51c-b1a43ea36b63 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:09.341544 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6e29c-dd83-48fc-b51c-b1a43ea36b63 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:09.365593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8d840-3655-427f-9cc2-448de04c8b36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:09.366409 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8d840-3655-427f-9cc2-448de04c8b36 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:09.366810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8d840-3655-427f-9cc2-448de04c8b36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:09.367163 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8d840-3655-427f-9cc2-448de04c8b36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:09.367777 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 850/1711] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:09.379397 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8d840-3655-427f-9cc2-448de04c8b36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:09.381085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8d840-3655-427f-9cc2-448de04c8b36 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:09.392451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 862/1712] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:10.868189 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb4794-5c90-4444-a21d-00527992dc4a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:10.868753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb4794-5c90-4444-a21d-00527992dc4a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:10.868879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb4794-5c90-4444-a21d-00527992dc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:10.895477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8d840-3655-427f-9cc2-448de04c8b36 service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:10.897295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7cc8d840-3655-427f-9cc2-448de04c8b36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:10.942167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-55bb4794-5c90-4444-a21d-00527992dc4a None None] MFA Rules not processed for user `323c51f037db4ecca2f66cb6e9879246`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:10.950185 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-55bb4794-5c90-4444-a21d-00527992dc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:10.959702 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8d840-3655-427f-9cc2-448de04c8b36 service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:10.979744 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24719c-d041-4749-a1d4-243ba4d12831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:10.980860 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24719c-d041-4749-a1d4-243ba4d12831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:10.981310 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24719c-d041-4749-a1d4-243ba4d12831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:10.981626 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24719c-d041-4749-a1d4-243ba4d12831 admin admin] PATH_INFO: `/v3/projects/d14122819acf4334b67a18fa8772393d` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:10.983402 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24719c-d041-4749-a1d4-243ba4d12831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d14122819acf4334b67a18fa8772393d)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:10.989464 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24719c-d041-4749-a1d4-243ba4d12831 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:11.186688 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0d24719c-d041-4749-a1d4-243ba4d12831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd14122819acf4334b67a18fa8772393d', 'request_id': 'req-0d24719c-d041-4749-a1d4-243ba4d12831'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:11.202854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0d24719c-d041-4749-a1d4-243ba4d12831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd14122819acf4334b67a18fa8772393d', 'request_id': 'req-0d24719c-d041-4749-a1d4-243ba4d12831'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:11.218072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0d24719c-d041-4749-a1d4-243ba4d12831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd14122819acf4334b67a18fa8772393d', 'request_id': 'req-0d24719c-d041-4749-a1d4-243ba4d12831'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:11.238867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0d24719c-d041-4749-a1d4-243ba4d12831 admin admin] The token cache is being invalidate because project d14122819acf4334b67a18fa8772393d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:42:11.239166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0d24719c-d041-4749-a1d4-243ba4d12831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:11.240934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0d24719c-d041-4749-a1d4-243ba4d12831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:11.256389 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 863/1713] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:42:10 2022] DELETE /identity/v3/projects/d14122819acf4334b67a18fa8772393d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:11.257568 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c00e98-5a6f-4d15-8f41-be5f181a64ea None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:11.257867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c00e98-5a6f-4d15-8f41-be5f181a64ea None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:11.258150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c00e98-5a6f-4d15-8f41-be5f181a64ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:11.314678 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 851/1714] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:11.315390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-e6c00e98-5a6f-4d15-8f41-be5f181a64ea None None] MFA Rules not processed for user `f60ed90fb1a54339ac563bc649e98989`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:11.315672 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb4794-5c90-4444-a21d-00527992dc4a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:11.316623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e6c00e98-5a6f-4d15-8f41-be5f181a64ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:11.317093 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-55bb4794-5c90-4444-a21d-00527992dc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:11.331346 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:11.335740 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb4794-5c90-4444-a21d-00527992dc4a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:11.361744 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:11.417363 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba308d-078d-4b69-865f-b5ed8cc7a9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:11.418632 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba308d-078d-4b69-865f-b5ed8cc7a9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:11.419033 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba308d-078d-4b69-865f-b5ed8cc7a9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:11.419457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba308d-078d-4b69-865f-b5ed8cc7a9d9 admin admin] PATH_INFO: `/v3/users/7d662c2575d642be98124feafe165fc3` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:11.421252 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba308d-078d-4b69-865f-b5ed8cc7a9d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d662c2575d642be98124feafe165fc3)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:11.424059 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba308d-078d-4b69-865f-b5ed8cc7a9d9 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:11.478633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 864/1715] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:11.486701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c00e98-5a6f-4d15-8f41-be5f181a64ea None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:11.491864 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e6c00e98-5a6f-4d15-8f41-be5f181a64ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:11.532228 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-65ba308d-078d-4b69-865f-b5ed8cc7a9d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d662c2575d642be98124feafe165fc3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:11.536102 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-65ba308d-078d-4b69-865f-b5ed8cc7a9d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d662c2575d642be98124feafe165fc3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:11.557478 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-65ba308d-078d-4b69-865f-b5ed8cc7a9d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d662c2575d642be98124feafe165fc3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:11.587432 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-65ba308d-078d-4b69-865f-b5ed8cc7a9d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d662c2575d642be98124feafe165fc3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:11.650305 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-65ba308d-078d-4b69-865f-b5ed8cc7a9d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d662c2575d642be98124feafe165fc3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:11.662641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c00e98-5a6f-4d15-8f41-be5f181a64ea None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:11.676155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 852/1716] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:42:11 2022] DELETE /identity/v3/users/7d662c2575d642be98124feafe165fc3 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:11.680825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c26d0c-ab5f-4952-b51c-65a13685d36d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:11.682080 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c26d0c-ab5f-4952-b51c-65a13685d36d service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:11.682564 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c26d0c-ab5f-4952-b51c-65a13685d36d service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:11.683052 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c26d0c-ab5f-4952-b51c-65a13685d36d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:11.687457 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-f0c26d0c-ab5f-4952-b51c-65a13685d36d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:11.813948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c26d0c-ab5f-4952-b51c-65a13685d36d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:11.815662 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c26d0c-ab5f-4952-b51c-65a13685d36d service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:11.836734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 865/1717] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:12.129397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8142de-24be-4680-9fd5-b7c6c9bc7684 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:12.129999 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8142de-24be-4680-9fd5-b7c6c9bc7684 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:12.130106 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8142de-24be-4680-9fd5-b7c6c9bc7684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:12.205418 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-aa8142de-24be-4680-9fd5-b7c6c9bc7684 None None] MFA Rules not processed for user `18261f10678a4ce99626794c39bb5d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:12.210270 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-aa8142de-24be-4680-9fd5-b7c6c9bc7684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:12.373848 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 853/1718] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:12.380255 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c26d0c-ab5f-4952-b51c-65a13685d36d service nova] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:12.386487 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-f0c26d0c-ab5f-4952-b51c-65a13685d36d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:12.436791 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c26d0c-ab5f-4952-b51c-65a13685d36d service nova] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:12.629333 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:12.664536 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15bb71-d537-4f56-bd15-92a40ca57b66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:12.665217 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15bb71-d537-4f56-bd15-92a40ca57b66 service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:12.665554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15bb71-d537-4f56-bd15-92a40ca57b66 service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:12.665988 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15bb71-d537-4f56-bd15-92a40ca57b66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:12.687811 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15bb71-d537-4f56-bd15-92a40ca57b66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:12.689492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd15bb71-d537-4f56-bd15-92a40ca57b66 service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:12.723698 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 866/1719] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:12.738181 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e97e1-3001-48ba-8c04-333dc7f86498 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:12.738476 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e97e1-3001-48ba-8c04-333dc7f86498 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:12.738761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e97e1-3001-48ba-8c04-333dc7f86498 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:12.740446 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 854/1720] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jun 14 19:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:42:12.853806 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a18f6-212e-4ee9-9cfe-09a988744503 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:12.854105 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a18f6-212e-4ee9-9cfe-09a988744503 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:12.854391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a18f6-212e-4ee9-9cfe-09a988744503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:12.908022 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-cf3a18f6-212e-4ee9-9cfe-09a988744503 None None] MFA Rules not processed for user `37c521e20aea4cad9758568a4f082fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:12.908022 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-cf3a18f6-212e-4ee9-9cfe-09a988744503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:12.981251 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 855/1721] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jun 14 19:42:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:13.013010 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15bb71-d537-4f56-bd15-92a40ca57b66 service nova] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:13.042203 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd15bb71-d537-4f56-bd15-92a40ca57b66 service nova] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:13.063065 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8584a496-0ffb-4e66-9e39-3cb6f153a2cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:13.063876 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584a496-0ffb-4e66-9e39-3cb6f153a2cb service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:13.064302 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584a496-0ffb-4e66-9e39-3cb6f153a2cb service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:13.064721 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8584a496-0ffb-4e66-9e39-3cb6f153a2cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:13.094111 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584a496-0ffb-4e66-9e39-3cb6f153a2cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:13.096554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8584a496-0ffb-4e66-9e39-3cb6f153a2cb service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:13.140591 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 867/1722] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:13.222364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cf0a5-9b40-452c-a6b8-c0aa75ad31e2 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:13.223279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cf0a5-9b40-452c-a6b8-c0aa75ad31e2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:13.223774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2cf0a5-9b40-452c-a6b8-c0aa75ad31e2 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:13.225349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 856/1723] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jun 14 19:42:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:42:13.325918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99625a5b-887c-4fb2-a1de-42b16a60973d None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:13.326287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99625a5b-887c-4fb2-a1de-42b16a60973d None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:13.326585 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99625a5b-887c-4fb2-a1de-42b16a60973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:13.393261 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-99625a5b-887c-4fb2-a1de-42b16a60973d None None] MFA Rules not processed for user `e98915513674460485413c2dbee87fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:13.394650 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-99625a5b-887c-4fb2-a1de-42b16a60973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:13.568525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 868/1724] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jun 14 19:42:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 14 19:42:13.859924 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2cf0a5-9b40-452c-a6b8-c0aa75ad31e2 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:13.863178 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1b2cf0a5-9b40-452c-a6b8-c0aa75ad31e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:13.916681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2cf0a5-9b40-452c-a6b8-c0aa75ad31e2 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:13.938623 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5077e1c8-888c-4f0e-a2d0-30f9aba3b053 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98915513674460485413c2dbee87fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:13.939229 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077e1c8-888c-4f0e-a2d0-30f9aba3b053 service placement] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:13.939523 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077e1c8-888c-4f0e-a2d0-30f9aba3b053 service placement] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:13.939979 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5077e1c8-888c-4f0e-a2d0-30f9aba3b053 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:13.971894 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077e1c8-888c-4f0e-a2d0-30f9aba3b053 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:13.973629 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5077e1c8-888c-4f0e-a2d0-30f9aba3b053 service placement] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:14.018640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 857/1725] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:15.079510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bca457-e7d9-4a8a-b331-06c54d261b9e None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:15.082179 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bca457-e7d9-4a8a-b331-06c54d261b9e None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:15.082633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bca457-e7d9-4a8a-b331-06c54d261b9e None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:15.090743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 869/1726] 10.222.0.44 () {54 vars in 912 bytes} [Tue Jun 14 19:42:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:42:15.092498 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0fe00-e9a9-4cae-9d38-90b5b7405575 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:15.093332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0fe00-e9a9-4cae-9d38-90b5b7405575 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:15.094221 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0fe00-e9a9-4cae-9d38-90b5b7405575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:15.118615 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba27bc1-7ea1-4930-9a0c-0bb55d5f47fb None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:15.118921 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba27bc1-7ea1-4930-9a0c-0bb55d5f47fb None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:15.119209 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba27bc1-7ea1-4930-9a0c-0bb55d5f47fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:15.216192 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-8ba27bc1-7ea1-4930-9a0c-0bb55d5f47fb None None] MFA Rules not processed for user `791ed0f433834b4599d6bc825440279d`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:15.221510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-8ba27bc1-7ea1-4930-9a0c-0bb55d5f47fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:15.228219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:15.249880 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-bea0fe00-e9a9-4cae-9d38-90b5b7405575 None None] MFA Rules not processed for user `9b28c3b97f9f44148dd02f41509887e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:15.251264 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bea0fe00-e9a9-4cae-9d38-90b5b7405575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:15.586401 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 858/1727] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:15.595229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 870/1728] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jun 14 19:42:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 14 19:42:15.598815 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae9ed1-0962-46f6-a415-79d58f97bbea None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:15.599301 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae9ed1-0962-46f6-a415-79d58f97bbea None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:15.599747 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae9ed1-0962-46f6-a415-79d58f97bbea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:15.648575 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b0ae9ed1-0962-46f6-a415-79d58f97bbea None None] MFA Rules not processed for user `9b28c3b97f9f44148dd02f41509887e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:15.650004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b0ae9ed1-0962-46f6-a415-79d58f97bbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:15.664147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba27bc1-7ea1-4930-9a0c-0bb55d5f47fb None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:15.666416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-8ba27bc1-7ea1-4930-9a0c-0bb55d5f47fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:15.683099 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 859/1729] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:42:15.704943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba27bc1-7ea1-4930-9a0c-0bb55d5f47fb None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:15.717005 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424db068-9e0a-4450-a8e9-0f5244e844c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:15.717966 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424db068-9e0a-4450-a8e9-0f5244e844c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:15.718428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424db068-9e0a-4450-a8e9-0f5244e844c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:15.718859 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424db068-9e0a-4450-a8e9-0f5244e844c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:15.737494 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424db068-9e0a-4450-a8e9-0f5244e844c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:15.739231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424db068-9e0a-4450-a8e9-0f5244e844c9 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:15.773332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 871/1730] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:15.934888 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae9ed1-0962-46f6-a415-79d58f97bbea None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:15.936456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b0ae9ed1-0962-46f6-a415-79d58f97bbea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:16.196968 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae9ed1-0962-46f6-a415-79d58f97bbea None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:16.204273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5af51-954a-4909-986c-3ac298e0aff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:16.205560 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5af51-954a-4909-986c-3ac298e0aff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:16.206079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5af51-954a-4909-986c-3ac298e0aff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:16.206547 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5af51-954a-4909-986c-3ac298e0aff5 admin admin] PATH_INFO: `/v3/users/7e3249cf6be84f4eb895903b30c2aad2` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:16.214470 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5af51-954a-4909-986c-3ac298e0aff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e3249cf6be84f4eb895903b30c2aad2)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:16.216795 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5af51-954a-4909-986c-3ac298e0aff5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:16.340163 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c5a5af51-954a-4909-986c-3ac298e0aff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e3249cf6be84f4eb895903b30c2aad2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:16.341527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c5a5af51-954a-4909-986c-3ac298e0aff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e3249cf6be84f4eb895903b30c2aad2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:16.369779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c5a5af51-954a-4909-986c-3ac298e0aff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e3249cf6be84f4eb895903b30c2aad2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:16.381879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c5a5af51-954a-4909-986c-3ac298e0aff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e3249cf6be84f4eb895903b30c2aad2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:16.402470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424db068-9e0a-4450-a8e9-0f5244e844c9 service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:16.410864 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-424db068-9e0a-4450-a8e9-0f5244e844c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:16.418255 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c5a5af51-954a-4909-986c-3ac298e0aff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e3249cf6be84f4eb895903b30c2aad2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:16.436951 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 860/1731] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:42:15 2022] DELETE /identity/v3/users/7e3249cf6be84f4eb895903b30c2aad2 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:16.441217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52104367-a86e-49b7-b56b-ed6a2e1475fe None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:16.441760 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52104367-a86e-49b7-b56b-ed6a2e1475fe None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:16.442555 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52104367-a86e-49b7-b56b-ed6a2e1475fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:16.450648 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424db068-9e0a-4450-a8e9-0f5244e844c9 service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:16.492009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-52104367-a86e-49b7-b56b-ed6a2e1475fe None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:16.497819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-52104367-a86e-49b7-b56b-ed6a2e1475fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:16.548475 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:16.627717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00f413-5d07-48b7-a8ce-e3b183bb48b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:16.630258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00f413-5d07-48b7-a8ce-e3b183bb48b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:16.632540 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00f413-5d07-48b7-a8ce-e3b183bb48b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:16.633524 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00f413-5d07-48b7-a8ce-e3b183bb48b1 admin admin] PATH_INFO: `/v3/projects/1549df26bb034fe696a5b09ae99219be` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:16.638596 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00f413-5d07-48b7-a8ce-e3b183bb48b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1549df26bb034fe696a5b09ae99219be)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:16.655703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00f413-5d07-48b7-a8ce-e3b183bb48b1 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:16.662116 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:16.737470 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 861/1732] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:16.781329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52104367-a86e-49b7-b56b-ed6a2e1475fe None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:16.787222 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-52104367-a86e-49b7-b56b-ed6a2e1475fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:16.789073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-4f00f413-5d07-48b7-a8ce-e3b183bb48b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1549df26bb034fe696a5b09ae99219be', 'request_id': 'req-4f00f413-5d07-48b7-a8ce-e3b183bb48b1'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:16.801919 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-4f00f413-5d07-48b7-a8ce-e3b183bb48b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1549df26bb034fe696a5b09ae99219be', 'request_id': 'req-4f00f413-5d07-48b7-a8ce-e3b183bb48b1'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:16.822943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-4f00f413-5d07-48b7-a8ce-e3b183bb48b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1549df26bb034fe696a5b09ae99219be', 'request_id': 'req-4f00f413-5d07-48b7-a8ce-e3b183bb48b1'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:16.852572 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-4f00f413-5d07-48b7-a8ce-e3b183bb48b1 admin admin] The token cache is being invalidate because project 1549df26bb034fe696a5b09ae99219be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:42:16.855112 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-4f00f413-5d07-48b7-a8ce-e3b183bb48b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:16.856640 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-4f00f413-5d07-48b7-a8ce-e3b183bb48b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:16.862066 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 872/1733] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:42:16 2022] DELETE /identity/v3/projects/1549df26bb034fe696a5b09ae99219be => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:42:16.867057 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10780a6c-2de7-4648-8b7e-04305f8a91e4 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:16.867497 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10780a6c-2de7-4648-8b7e-04305f8a91e4 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:16.867921 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10780a6c-2de7-4648-8b7e-04305f8a91e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:16.925737 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-10780a6c-2de7-4648-8b7e-04305f8a91e4 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:16.934465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-10780a6c-2de7-4648-8b7e-04305f8a91e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:16.968651 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52104367-a86e-49b7-b56b-ed6a2e1475fe None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:17.095372 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 873/1734] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:17.095372 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10780a6c-2de7-4648-8b7e-04305f8a91e4 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:17.097662 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-10780a6c-2de7-4648-8b7e-04305f8a91e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:17.129255 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4938295-5738-4780-81c7-fa78de0a61da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:17.130147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4938295-5738-4780-81c7-fa78de0a61da service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:17.131365 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4938295-5738-4780-81c7-fa78de0a61da service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:17.131760 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4938295-5738-4780-81c7-fa78de0a61da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:17.137956 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a4938295-5738-4780-81c7-fa78de0a61da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:17.193846 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4938295-5738-4780-81c7-fa78de0a61da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:17.197779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4938295-5738-4780-81c7-fa78de0a61da service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:17.228028 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 862/1735] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:42:17.229726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25ad5f-c815-4a39-9f25-4299adfa1e64 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:17.231191 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25ad5f-c815-4a39-9f25-4299adfa1e64 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:17.233075 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25ad5f-c815-4a39-9f25-4299adfa1e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:17.286137 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1c25ad5f-c815-4a39-9f25-4299adfa1e64 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:17.287601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1c25ad5f-c815-4a39-9f25-4299adfa1e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:17.310768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 863/1736] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:17.315209 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25ad5f-c815-4a39-9f25-4299adfa1e64 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:17.342003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25ad5f-c815-4a39-9f25-4299adfa1e64 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:17.355571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0843432-2fcf-417d-aa8f-32586e105c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:17.356835 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0843432-2fcf-417d-aa8f-32586e105c33 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:17.357237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0843432-2fcf-417d-aa8f-32586e105c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:17.357663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0843432-2fcf-417d-aa8f-32586e105c33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:17.358531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0843432-2fcf-417d-aa8f-32586e105c33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:42:17.358952 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0843432-2fcf-417d-aa8f-32586e105c33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:17.361781 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0843432-2fcf-417d-aa8f-32586e105c33 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:17.376015 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 864/1737] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:42:17.380337 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0843432-2fcf-417d-aa8f-32586e105c33 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:17.398192 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0843432-2fcf-417d-aa8f-32586e105c33 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:17.403811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90ff3b-b1cb-452f-ab5d-4a9015420da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:17.404917 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90ff3b-b1cb-452f-ab5d-4a9015420da2 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:17.405448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90ff3b-b1cb-452f-ab5d-4a9015420da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:17.405752 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10780a6c-2de7-4648-8b7e-04305f8a91e4 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:17.406218 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90ff3b-b1cb-452f-ab5d-4a9015420da2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:17.407707 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90ff3b-b1cb-452f-ab5d-4a9015420da2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:17.413752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90ff3b-b1cb-452f-ab5d-4a9015420da2 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:17.425082 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c7593-6651-4572-a272-d0706321149a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:17.427861 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c7593-6651-4572-a272-d0706321149a service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:17.428169 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c7593-6651-4572-a272-d0706321149a service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:17.428457 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c7593-6651-4572-a272-d0706321149a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:17.437336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-f25c7593-6651-4572-a272-d0706321149a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:17.503377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 865/1738] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:17 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:17.507831 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90ff3b-b1cb-452f-ab5d-4a9015420da2 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:17.531465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:17.649854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:17.673809 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c7593-6651-4572-a272-d0706321149a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:17.681681 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c7593-6651-4572-a272-d0706321149a service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:17.719691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90ff3b-b1cb-452f-ab5d-4a9015420da2 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:17.723769 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 874/1739] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:17.746674 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93561fff-b523-4f94-be53-50a4eb5bc8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:17.748531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93561fff-b523-4f94-be53-50a4eb5bc8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:17.750303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93561fff-b523-4f94-be53-50a4eb5bc8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:17.750798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93561fff-b523-4f94-be53-50a4eb5bc8e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:17.756337 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93561fff-b523-4f94-be53-50a4eb5bc8e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:17.763792 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93561fff-b523-4f94-be53-50a4eb5bc8e6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:17.828866 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c7593-6651-4572-a272-d0706321149a service nova] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:17.834471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 866/1740] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:17 2022] POST /identity/v3/users => generated 291 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:17.847176 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c7593-6651-4572-a272-d0706321149a service nova] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:17.872625 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d729d-2ed1-49b5-a9b5-328b040e93a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:17.873333 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d729d-2ed1-49b5-a9b5-328b040e93a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:17.873650 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d729d-2ed1-49b5-a9b5-328b040e93a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:17.873933 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d729d-2ed1-49b5-a9b5-328b040e93a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:17.878979 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d729d-2ed1-49b5-a9b5-328b040e93a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:17.887763 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686d729d-2ed1-49b5-a9b5-328b040e93a5 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:17.935810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 875/1741] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:42:17.937333 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93561fff-b523-4f94-be53-50a4eb5bc8e6 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:17.951221 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93561fff-b523-4f94-be53-50a4eb5bc8e6 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:17.967980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c08cea-c432-4ab3-b122-c1499c52fbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:17.970107 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c08cea-c432-4ab3-b122-c1499c52fbad admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:17.975037 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c08cea-c432-4ab3-b122-c1499c52fbad admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:17.975476 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c08cea-c432-4ab3-b122-c1499c52fbad admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:17.979265 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c08cea-c432-4ab3-b122-c1499c52fbad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:17.986662 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c08cea-c432-4ab3-b122-c1499c52fbad admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:18.020663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 867/1742] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:18.025107 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d729d-2ed1-49b5-a9b5-328b040e93a5 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:18.045185 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d729d-2ed1-49b5-a9b5-328b040e93a5 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:18.053797 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac351b-042a-4801-93a1-113696477b6c None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:18.054283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac351b-042a-4801-93a1-113696477b6c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:18.054836 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac351b-042a-4801-93a1-113696477b6c None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:18.058503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 868/1743] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jun 14 19:42:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:42:18.061204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38784a-f424-4588-b762-74d18aa362c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:18.061413 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38784a-f424-4588-b762-74d18aa362c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:18.061774 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38784a-f424-4588-b762-74d18aa362c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:18.061915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38784a-f424-4588-b762-74d18aa362c1 admin admin] PATH_INFO: `/v3/projects/fe3ade8cc2f34504b9062f2ed6f8561c/users/c84939fc88eb43d893db6c425618d842/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:18.082933 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0c737-9b5e-4f37-91c0-16243845c1d8 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:18.083353 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0c737-9b5e-4f37-91c0-16243845c1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:18.083796 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0c737-9b5e-4f37-91c0-16243845c1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:18.101143 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38784a-f424-4588-b762-74d18aa362c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3ade8cc2f34504b9062f2ed6f8561c, user_id=c84939fc88eb43d893db6c425618d842, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:18.106513 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38784a-f424-4588-b762-74d18aa362c1 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:18.115692 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ded0c737-9b5e-4f37-91c0-16243845c1d8 None None] MFA Rules not processed for user `e98915513674460485413c2dbee87fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:18.118949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ded0c737-9b5e-4f37-91c0-16243845c1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:18.137209 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 876/1744] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:18 2022] PUT /identity/v3/projects/fe3ade8cc2f34504b9062f2ed6f8561c/users/c84939fc88eb43d893db6c425618d842/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:18.147893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474bb5f-5f79-45f2-8a36-d9a5b2534ff3 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:18.148355 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474bb5f-5f79-45f2-8a36-d9a5b2534ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:18.148745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474bb5f-5f79-45f2-8a36-d9a5b2534ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:18.212658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-6474bb5f-5f79-45f2-8a36-d9a5b2534ff3 None None] MFA Rules not processed for user `c84939fc88eb43d893db6c425618d842`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:18.217335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-6474bb5f-5f79-45f2-8a36-d9a5b2534ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:18.294182 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 869/1745] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jun 14 19:42:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:42:18.324178 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0c737-9b5e-4f37-91c0-16243845c1d8 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:18.326167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ded0c737-9b5e-4f37-91c0-16243845c1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:18.353329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0c737-9b5e-4f37-91c0-16243845c1d8 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:18.391674 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 877/1746] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:42:18.396343 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474bb5f-5f79-45f2-8a36-d9a5b2534ff3 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:18.496260 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6a78f-65ce-446b-8042-8958f53e0f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:18.497339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6a78f-65ce-446b-8042-8958f53e0f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:18.497754 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6a78f-65ce-446b-8042-8958f53e0f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:18.498297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6a78f-65ce-446b-8042-8958f53e0f13 admin admin] PATH_INFO: `/v3/users/38b80bb0d8a64940a3cbecf28fd1aa7a` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:18.503744 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6a78f-65ce-446b-8042-8958f53e0f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38b80bb0d8a64940a3cbecf28fd1aa7a)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:18.506354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6a78f-65ce-446b-8042-8958f53e0f13 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:18.527842 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474bb5f-5f79-45f2-8a36-d9a5b2534ff3 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:18.544425 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bcde1-20f2-4bd8-af87-ec81ed8e442e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:18.545636 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bcde1-20f2-4bd8-af87-ec81ed8e442e admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:18.546087 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bcde1-20f2-4bd8-af87-ec81ed8e442e admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:18.546519 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bcde1-20f2-4bd8-af87-ec81ed8e442e admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:18.547522 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594bcde1-20f2-4bd8-af87-ec81ed8e442e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:18.549657 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594bcde1-20f2-4bd8-af87-ec81ed8e442e admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:18.607675 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ecf6a78f-65ce-446b-8042-8958f53e0f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38b80bb0d8a64940a3cbecf28fd1aa7a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:18.608873 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ecf6a78f-65ce-446b-8042-8958f53e0f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38b80bb0d8a64940a3cbecf28fd1aa7a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:18.646338 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:18.671349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ecf6a78f-65ce-446b-8042-8958f53e0f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38b80bb0d8a64940a3cbecf28fd1aa7a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:18.707842 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ecf6a78f-65ce-446b-8042-8958f53e0f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38b80bb0d8a64940a3cbecf28fd1aa7a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:18.716542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 878/1747] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:18 2022] POST /identity/v3/projects => generated 381 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:42:18.717712 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bcde1-20f2-4bd8-af87-ec81ed8e442e admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:18.729264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-594bcde1-20f2-4bd8-af87-ec81ed8e442e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:18.751987 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ecf6a78f-65ce-446b-8042-8958f53e0f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38b80bb0d8a64940a3cbecf28fd1aa7a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:18.765565 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 870/1748] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:42:18 2022] DELETE /identity/v3/users/38b80bb0d8a64940a3cbecf28fd1aa7a => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:42:18.773883 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6a78f-65ce-446b-8042-8958f53e0f13 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:18.778353 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ecf6a78f-65ce-446b-8042-8958f53e0f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:18.778840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:18.941644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6a78f-65ce-446b-8042-8958f53e0f13 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:18.953279 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bcde1-20f2-4bd8-af87-ec81ed8e442e admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:18.956863 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efa5fb-ec2c-48de-bcf1-b5da6ea2d330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:18.957922 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efa5fb-ec2c-48de-bcf1-b5da6ea2d330 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:18.958374 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efa5fb-ec2c-48de-bcf1-b5da6ea2d330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:18.959429 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efa5fb-ec2c-48de-bcf1-b5da6ea2d330 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:18.960309 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efa5fb-ec2c-48de-bcf1-b5da6ea2d330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:18.964489 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efa5fb-ec2c-48de-bcf1-b5da6ea2d330 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:19.007651 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 871/1749] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:18 2022] POST /identity/v3/users => generated 297 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:19.011839 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efa5fb-ec2c-48de-bcf1-b5da6ea2d330 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:19.035709 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efa5fb-ec2c-48de-bcf1-b5da6ea2d330 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:19.049722 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b060a-55a6-44df-80d0-181f4f25d3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:19.050412 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b060a-55a6-44df-80d0-181f4f25d3eb admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:19.050757 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b060a-55a6-44df-80d0-181f4f25d3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:19.051043 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b060a-55a6-44df-80d0-181f4f25d3eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:19.051788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b060a-55a6-44df-80d0-181f4f25d3eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:19.057178 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451b060a-55a6-44df-80d0-181f4f25d3eb admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:19.082093 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 872/1750] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:19.091211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b060a-55a6-44df-80d0-181f4f25d3eb admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:19.110589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b060a-55a6-44df-80d0-181f4f25d3eb admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:19.112949 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091816e4-0255-4ad0-acf7-be02c2205692 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98915513674460485413c2dbee87fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:19.113981 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091816e4-0255-4ad0-acf7-be02c2205692 service placement] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:19.114508 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091816e4-0255-4ad0-acf7-be02c2205692 service placement] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:19.115032 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091816e4-0255-4ad0-acf7-be02c2205692 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:19.118037 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c1b92-acd5-4c2b-bf45-ea45d9f519ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:19.119248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c1b92-acd5-4c2b-bf45-ea45d9f519ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:19.119748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c1b92-acd5-4c2b-bf45-ea45d9f519ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:19.122999 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c1b92-acd5-4c2b-bf45-ea45d9f519ca admin admin] PATH_INFO: `/v3/projects/c9f4c2a6618a4776995bf5db7ddc07e3/users/782c79ba24c94bc1928c0db1a6a5d1fe/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:19.124566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-091816e4-0255-4ad0-acf7-be02c2205692 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:19.164083 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091816e4-0255-4ad0-acf7-be02c2205692 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:19.166688 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091816e4-0255-4ad0-acf7-be02c2205692 service placement] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:19.179177 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c1b92-acd5-4c2b-bf45-ea45d9f519ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f4c2a6618a4776995bf5db7ddc07e3, user_id=782c79ba24c94bc1928c0db1a6a5d1fe, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:19.184211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c1b92-acd5-4c2b-bf45-ea45d9f519ca admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:19.188745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 879/1751] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:19.208434 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 873/1752] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:19 2022] PUT /identity/v3/projects/c9f4c2a6618a4776995bf5db7ddc07e3/users/782c79ba24c94bc1928c0db1a6a5d1fe/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:19.210265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091816e4-0255-4ad0-acf7-be02c2205692 service placement] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:19.242227 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091816e4-0255-4ad0-acf7-be02c2205692 service placement] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:19.454303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40873e1c-a33a-4cff-9ef2-630fa005a5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:19.455377 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40873e1c-a33a-4cff-9ef2-630fa005a5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:19.455876 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40873e1c-a33a-4cff-9ef2-630fa005a5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:19.456362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40873e1c-a33a-4cff-9ef2-630fa005a5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:19.457298 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40873e1c-a33a-4cff-9ef2-630fa005a5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:19.459224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40873e1c-a33a-4cff-9ef2-630fa005a5c8 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:19.474347 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 880/1753] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:19.479274 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c1b92-acd5-4c2b-bf45-ea45d9f519ca admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:19.504590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c1b92-acd5-4c2b-bf45-ea45d9f519ca admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:19.535291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a32169-02cf-449f-b5b3-2bca5aab1a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:19.536130 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a32169-02cf-449f-b5b3-2bca5aab1a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:19.536468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a32169-02cf-449f-b5b3-2bca5aab1a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:19.536680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a32169-02cf-449f-b5b3-2bca5aab1a79 admin admin] PATH_INFO: `/v3/projects/c9f4c2a6618a4776995bf5db7ddc07e3/users/782c79ba24c94bc1928c0db1a6a5d1fe/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:19.540020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a32169-02cf-449f-b5b3-2bca5aab1a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f4c2a6618a4776995bf5db7ddc07e3, user_id=782c79ba24c94bc1928c0db1a6a5d1fe, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:19.547217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a32169-02cf-449f-b5b3-2bca5aab1a79 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:19.590399 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 874/1754] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:19 2022] PUT /identity/v3/projects/c9f4c2a6618a4776995bf5db7ddc07e3/users/782c79ba24c94bc1928c0db1a6a5d1fe/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:19.591278 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ef6f7-ed9c-46f3-b088-c321d26d8ba6 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:19.591784 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ef6f7-ed9c-46f3-b088-c321d26d8ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:19.591865 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ef6f7-ed9c-46f3-b088-c321d26d8ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:19.671581 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-cb9ef6f7-ed9c-46f3-b088-c321d26d8ba6 None None] MFA Rules not processed for user `782c79ba24c94bc1928c0db1a6a5d1fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:19.672845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-cb9ef6f7-ed9c-46f3-b088-c321d26d8ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:19.727766 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:19.838437 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 881/1755] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:42:19.855730 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a32169-02cf-449f-b5b3-2bca5aab1a79 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:19.858571 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f8874-a709-4306-a664-9ef2f207ed25 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:19.859630 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-86a32169-02cf-449f-b5b3-2bca5aab1a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:19.860679 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f8874-a709-4306-a664-9ef2f207ed25 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:19.861099 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f8874-a709-4306-a664-9ef2f207ed25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:19.951598 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-208f8874-a709-4306-a664-9ef2f207ed25 None None] MFA Rules not processed for user `18261f10678a4ce99626794c39bb5d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:19.960040 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-208f8874-a709-4306-a664-9ef2f207ed25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:20.076125 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a32169-02cf-449f-b5b3-2bca5aab1a79 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:20.087633 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15e81f-6331-4676-93f3-73dcf963e066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:20.088308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15e81f-6331-4676-93f3-73dcf963e066 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:20.088593 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15e81f-6331-4676-93f3-73dcf963e066 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:20.088923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15e81f-6331-4676-93f3-73dcf963e066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:20.113258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15e81f-6331-4676-93f3-73dcf963e066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:20.116993 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15e81f-6331-4676-93f3-73dcf963e066 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:20.127973 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 882/1756] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:20.127973 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f8874-a709-4306-a664-9ef2f207ed25 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:20.131253 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-208f8874-a709-4306-a664-9ef2f207ed25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:20.143082 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 875/1757] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:20.409259 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f8874-a709-4306-a664-9ef2f207ed25 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:20.423327 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21425a01-1871-45eb-bdd8-25c1d68200a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:20.424230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21425a01-1871-45eb-bdd8-25c1d68200a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:20.424562 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21425a01-1871-45eb-bdd8-25c1d68200a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:20.424856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21425a01-1871-45eb-bdd8-25c1d68200a6 admin admin] PATH_INFO: `/v3/projects/39896446cbb44621ba24ff7d55245b5c` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:20.427064 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21425a01-1871-45eb-bdd8-25c1d68200a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39896446cbb44621ba24ff7d55245b5c)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:20.430505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21425a01-1871-45eb-bdd8-25c1d68200a6 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:20.512982 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499e99b-3575-47ae-82dc-16498af5ccfb None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:20.513520 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499e99b-3575-47ae-82dc-16498af5ccfb None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:20.513605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499e99b-3575-47ae-82dc-16498af5ccfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:20.576041 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6499e99b-3575-47ae-82dc-16498af5ccfb None None] MFA Rules not processed for user `9b28c3b97f9f44148dd02f41509887e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:20.578784 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6499e99b-3575-47ae-82dc-16498af5ccfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:20.598699 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:20.631365 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-21425a01-1871-45eb-bdd8-25c1d68200a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39896446cbb44621ba24ff7d55245b5c', 'request_id': 'req-21425a01-1871-45eb-bdd8-25c1d68200a6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:20.664561 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-21425a01-1871-45eb-bdd8-25c1d68200a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39896446cbb44621ba24ff7d55245b5c', 'request_id': 'req-21425a01-1871-45eb-bdd8-25c1d68200a6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:20.696925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-21425a01-1871-45eb-bdd8-25c1d68200a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39896446cbb44621ba24ff7d55245b5c', 'request_id': 'req-21425a01-1871-45eb-bdd8-25c1d68200a6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:20.701745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:20.730814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-21425a01-1871-45eb-bdd8-25c1d68200a6 admin admin] The token cache is being invalidate because project 39896446cbb44621ba24ff7d55245b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:42:20.731378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-21425a01-1871-45eb-bdd8-25c1d68200a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:20.732286 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-21425a01-1871-45eb-bdd8-25c1d68200a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:20.735098 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 883/1758] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:42:20 2022] DELETE /identity/v3/projects/39896446cbb44621ba24ff7d55245b5c => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:20.751186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21425a01-1871-45eb-bdd8-25c1d68200a6 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:20.756832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-21425a01-1871-45eb-bdd8-25c1d68200a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:20.803765 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 876/1759] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:20.804735 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499e99b-3575-47ae-82dc-16498af5ccfb None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:20.812820 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6499e99b-3575-47ae-82dc-16498af5ccfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:20.945899 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21425a01-1871-45eb-bdd8-25c1d68200a6 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:20.958192 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f83a01-d4cf-406b-a740-4ab1f1fec847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:20.959687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f83a01-d4cf-406b-a740-4ab1f1fec847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:20.959687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f83a01-d4cf-406b-a740-4ab1f1fec847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:20.959687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f83a01-d4cf-406b-a740-4ab1f1fec847 admin admin] PATH_INFO: `/v3/projects/e68c314e3d2040ca97ae138b56ab62c1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:20.962873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f83a01-d4cf-406b-a740-4ab1f1fec847 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e68c314e3d2040ca97ae138b56ab62c1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:20.968849 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f83a01-d4cf-406b-a740-4ab1f1fec847 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:21.056562 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499e99b-3575-47ae-82dc-16498af5ccfb None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:21.064586 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-90f83a01-d4cf-406b-a740-4ab1f1fec847 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e68c314e3d2040ca97ae138b56ab62c1', 'request_id': 'req-90f83a01-d4cf-406b-a740-4ab1f1fec847'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:21.076676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-90f83a01-d4cf-406b-a740-4ab1f1fec847 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e68c314e3d2040ca97ae138b56ab62c1', 'request_id': 'req-90f83a01-d4cf-406b-a740-4ab1f1fec847'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:21.097931 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-90f83a01-d4cf-406b-a740-4ab1f1fec847 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e68c314e3d2040ca97ae138b56ab62c1', 'request_id': 'req-90f83a01-d4cf-406b-a740-4ab1f1fec847'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:21.125909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-90f83a01-d4cf-406b-a740-4ab1f1fec847 admin admin] The token cache is being invalidate because project e68c314e3d2040ca97ae138b56ab62c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:42:21.126301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-90f83a01-d4cf-406b-a740-4ab1f1fec847 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:21.128483 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-90f83a01-d4cf-406b-a740-4ab1f1fec847 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:21.131015 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 884/1760] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:42:20 2022] DELETE /identity/v3/projects/e68c314e3d2040ca97ae138b56ab62c1 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:21.135105 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f83a01-d4cf-406b-a740-4ab1f1fec847 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:21.137783 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-90f83a01-d4cf-406b-a740-4ab1f1fec847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:21.203437 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108c40f-3d78-4028-a698-34a8a7bd3e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:21.208369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108c40f-3d78-4028-a698-34a8a7bd3e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:21.209310 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108c40f-3d78-4028-a698-34a8a7bd3e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:21.209796 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108c40f-3d78-4028-a698-34a8a7bd3e94 admin admin] PATH_INFO: `/v3/users/7bbcd6732d0c415abf28b3e33efce73d` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:21.213203 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108c40f-3d78-4028-a698-34a8a7bd3e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bbcd6732d0c415abf28b3e33efce73d)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:21.220865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108c40f-3d78-4028-a698-34a8a7bd3e94 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:21.238917 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f83a01-d4cf-406b-a740-4ab1f1fec847 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:21.244422 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5d84f-0287-401c-925e-1d7d052abfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:21.246555 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5d84f-0287-401c-925e-1d7d052abfb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:21.246853 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5d84f-0287-401c-925e-1d7d052abfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:21.247136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5d84f-0287-401c-925e-1d7d052abfb1 admin admin] PATH_INFO: `/v3/users/eb857cee9c3c4098aec777a7f319f307` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:21.248524 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5d84f-0287-401c-925e-1d7d052abfb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb857cee9c3c4098aec777a7f319f307)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:21.251335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5d84f-0287-401c-925e-1d7d052abfb1 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:21.305749 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:21.340394 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a108c40f-3d78-4028-a698-34a8a7bd3e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bbcd6732d0c415abf28b3e33efce73d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:21.342420 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a108c40f-3d78-4028-a698-34a8a7bd3e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bbcd6732d0c415abf28b3e33efce73d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:21.368931 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-b3a5d84f-0287-401c-925e-1d7d052abfb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb857cee9c3c4098aec777a7f319f307'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:21.372174 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-b3a5d84f-0287-401c-925e-1d7d052abfb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb857cee9c3c4098aec777a7f319f307'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:21.375869 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a108c40f-3d78-4028-a698-34a8a7bd3e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bbcd6732d0c415abf28b3e33efce73d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:21.392765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-b3a5d84f-0287-401c-925e-1d7d052abfb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb857cee9c3c4098aec777a7f319f307'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:21.406894 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a108c40f-3d78-4028-a698-34a8a7bd3e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bbcd6732d0c415abf28b3e33efce73d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:21.407461 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-b3a5d84f-0287-401c-925e-1d7d052abfb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb857cee9c3c4098aec777a7f319f307'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:21.411571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:21.437191 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-b3a5d84f-0287-401c-925e-1d7d052abfb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb857cee9c3c4098aec777a7f319f307'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:21.440869 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a108c40f-3d78-4028-a698-34a8a7bd3e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bbcd6732d0c415abf28b3e33efce73d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:21.452037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 885/1761] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:42:21 2022] DELETE /identity/v3/users/eb857cee9c3c4098aec777a7f319f307 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:42:21.452037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5d84f-0287-401c-925e-1d7d052abfb1 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:21.452323 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 877/1762] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:42:20 2022] DELETE /identity/v3/users/7bbcd6732d0c415abf28b3e33efce73d => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:21.452409 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b3a5d84f-0287-401c-925e-1d7d052abfb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:21.563508 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5d84f-0287-401c-925e-1d7d052abfb1 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:21.744547 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06651385-3c02-485c-a388-b90bc5295ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:21.744547 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06651385-3c02-485c-a388-b90bc5295ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:21.744547 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06651385-3c02-485c-a388-b90bc5295ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:21.744547 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06651385-3c02-485c-a388-b90bc5295ff7 admin admin] PATH_INFO: `/v3/users/c84939fc88eb43d893db6c425618d842` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:21.750548 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06651385-3c02-485c-a388-b90bc5295ff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c84939fc88eb43d893db6c425618d842)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:21.753275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06651385-3c02-485c-a388-b90bc5295ff7 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:21.852873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-06651385-3c02-485c-a388-b90bc5295ff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c84939fc88eb43d893db6c425618d842'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:21.854889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-06651385-3c02-485c-a388-b90bc5295ff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c84939fc88eb43d893db6c425618d842'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:21.873973 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-06651385-3c02-485c-a388-b90bc5295ff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c84939fc88eb43d893db6c425618d842'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:21.877687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:21.886593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-06651385-3c02-485c-a388-b90bc5295ff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c84939fc88eb43d893db6c425618d842'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:21.910758 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-06651385-3c02-485c-a388-b90bc5295ff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c84939fc88eb43d893db6c425618d842'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:21.922854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 886/1763] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:42:21 2022] DELETE /identity/v3/users/c84939fc88eb43d893db6c425618d842 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:21.924935 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ba30d-b466-46f7-a704-a7835e675969 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:21.925493 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ba30d-b466-46f7-a704-a7835e675969 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:21.925593 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ba30d-b466-46f7-a704-a7835e675969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:21.963185 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-897ba30d-b466-46f7-a704-a7835e675969 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:21.967330 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-897ba30d-b466-46f7-a704-a7835e675969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:22.150679 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 878/1764] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:22.201881 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06651385-3c02-485c-a388-b90bc5295ff7 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:22.203943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-06651385-3c02-485c-a388-b90bc5295ff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:22.363696 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06651385-3c02-485c-a388-b90bc5295ff7 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:22.374922 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba3358-1728-46aa-b2ce-c037063887e4 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:22.375211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba3358-1728-46aa-b2ce-c037063887e4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:22.376657 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba3358-1728-46aa-b2ce-c037063887e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:22.380868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a67f3-f428-46af-b8ab-ae55324c06b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:22.382297 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a67f3-f428-46af-b8ab-ae55324c06b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:22.383863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a67f3-f428-46af-b8ab-ae55324c06b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:22.385156 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a67f3-f428-46af-b8ab-ae55324c06b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:22.415345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a67f3-f428-46af-b8ab-ae55324c06b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:22.421893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a67f3-f428-46af-b8ab-ae55324c06b7 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:22.433317 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c5ba3358-1728-46aa-b2ce-c037063887e4 None None] MFA Rules not processed for user `323c51f037db4ecca2f66cb6e9879246`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:22.434779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c5ba3358-1728-46aa-b2ce-c037063887e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:22.462943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 887/1765] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:22.490776 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a67f3-f428-46af-b8ab-ae55324c06b7 service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:22.492411 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-347a67f3-f428-46af-b8ab-ae55324c06b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:22.550412 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a67f3-f428-46af-b8ab-ae55324c06b7 service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:22.563319 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7f9bb-dd3e-453c-92a0-6e1f1ab6661e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:22.564196 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7f9bb-dd3e-453c-92a0-6e1f1ab6661e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:22.564482 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7f9bb-dd3e-453c-92a0-6e1f1ab6661e admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:22.564757 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7f9bb-dd3e-453c-92a0-6e1f1ab6661e admin admin] PATH_INFO: `/v3/projects/81d1618cbce14081842afdb30404782b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:22.566997 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7f9bb-dd3e-453c-92a0-6e1f1ab6661e admin admin] RBAC: Authorizing `identity:delete_project(project_id=81d1618cbce14081842afdb30404782b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:22.571082 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb7f9bb-dd3e-453c-92a0-6e1f1ab6661e admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:22.647217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 879/1766] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:42:22.694321 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-fbb7f9bb-dd3e-453c-92a0-6e1f1ab6661e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81d1618cbce14081842afdb30404782b', 'request_id': 'req-fbb7f9bb-dd3e-453c-92a0-6e1f1ab6661e'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:22.707283 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-fbb7f9bb-dd3e-453c-92a0-6e1f1ab6661e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81d1618cbce14081842afdb30404782b', 'request_id': 'req-fbb7f9bb-dd3e-453c-92a0-6e1f1ab6661e'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:22.729413 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-fbb7f9bb-dd3e-453c-92a0-6e1f1ab6661e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81d1618cbce14081842afdb30404782b', 'request_id': 'req-fbb7f9bb-dd3e-453c-92a0-6e1f1ab6661e'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:22.750149 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-fbb7f9bb-dd3e-453c-92a0-6e1f1ab6661e admin admin] The token cache is being invalidate because project 81d1618cbce14081842afdb30404782b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:42:22.750785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-fbb7f9bb-dd3e-453c-92a0-6e1f1ab6661e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:22.753467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-fbb7f9bb-dd3e-453c-92a0-6e1f1ab6661e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:22.761043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 888/1767] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:42:22 2022] DELETE /identity/v3/projects/81d1618cbce14081842afdb30404782b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:22.766330 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585089f3-6a7e-496b-b818-4932585462cf None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:22.766623 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585089f3-6a7e-496b-b818-4932585462cf None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:22.767078 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585089f3-6a7e-496b-b818-4932585462cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:22.797785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-585089f3-6a7e-496b-b818-4932585462cf None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:22.799327 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-585089f3-6a7e-496b-b818-4932585462cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:22.991571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 880/1768] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:42:23.000748 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36d9d7-0561-483d-ab25-5613083b5d2a None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:23.001463 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36d9d7-0561-483d-ab25-5613083b5d2a None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:23.005701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36d9d7-0561-483d-ab25-5613083b5d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:23.032003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-7a36d9d7-0561-483d-ab25-5613083b5d2a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:23.033395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7a36d9d7-0561-483d-ab25-5613083b5d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:23.047875 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 889/1769] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:23.048482 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585089f3-6a7e-496b-b818-4932585462cf None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:23.060960 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585089f3-6a7e-496b-b818-4932585462cf None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:23.080962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972976f9-4ff8-4f9a-8ba5-19db605abfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:23.081883 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972976f9-4ff8-4f9a-8ba5-19db605abfa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:23.082178 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972976f9-4ff8-4f9a-8ba5-19db605abfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:23.082462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972976f9-4ff8-4f9a-8ba5-19db605abfa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:23.083208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972976f9-4ff8-4f9a-8ba5-19db605abfa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:42:23.083520 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972976f9-4ff8-4f9a-8ba5-19db605abfa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:23.091020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972976f9-4ff8-4f9a-8ba5-19db605abfa6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:23.128976 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 881/1770] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:42:23.132930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36d9d7-0561-483d-ab25-5613083b5d2a None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:23.144906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36d9d7-0561-483d-ab25-5613083b5d2a None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:23.152032 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a80132-1915-4003-87a3-9890cfd59342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:23.152983 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a80132-1915-4003-87a3-9890cfd59342 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:23.154471 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a80132-1915-4003-87a3-9890cfd59342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:23.155235 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a80132-1915-4003-87a3-9890cfd59342 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:23.156368 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a80132-1915-4003-87a3-9890cfd59342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:23.159987 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a80132-1915-4003-87a3-9890cfd59342 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:23.196136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 890/1771] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:23 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:23.201048 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972976f9-4ff8-4f9a-8ba5-19db605abfa6 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:23.212262 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972976f9-4ff8-4f9a-8ba5-19db605abfa6 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:23.257575 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:23.357326 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a80132-1915-4003-87a3-9890cfd59342 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:23.359141 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-f9a80132-1915-4003-87a3-9890cfd59342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:23.417346 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a15ae-5bfc-4258-98c3-68448946f0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:23.418385 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a15ae-5bfc-4258-98c3-68448946f0cf admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:23.418685 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a15ae-5bfc-4258-98c3-68448946f0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:23.419016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a15ae-5bfc-4258-98c3-68448946f0cf admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:23.422535 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a15ae-5bfc-4258-98c3-68448946f0cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:23.425391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a15ae-5bfc-4258-98c3-68448946f0cf admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:23.452701 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 882/1772] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:23 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:23.456375 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a15ae-5bfc-4258-98c3-68448946f0cf admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:23.468263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:23.483938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a15ae-5bfc-4258-98c3-68448946f0cf admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:23.502456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e8a16-606d-4abb-abe1-b4c9f36dbe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:23.503274 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e8a16-606d-4abb-abe1-b4c9f36dbe2d admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:23.503782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e8a16-606d-4abb-abe1-b4c9f36dbe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:23.504178 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e8a16-606d-4abb-abe1-b4c9f36dbe2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:23.505251 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e8a16-606d-4abb-abe1-b4c9f36dbe2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:23.507747 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70e8a16-606d-4abb-abe1-b4c9f36dbe2d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:23.524387 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 883/1773] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:23.531169 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e8a16-606d-4abb-abe1-b4c9f36dbe2d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:23.570409 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a80132-1915-4003-87a3-9890cfd59342 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:23.570639 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70e8a16-606d-4abb-abe1-b4c9f36dbe2d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:23.583389 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d715be-1c2f-4c10-853a-eb5b219aeaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:23.584283 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d715be-1c2f-4c10-853a-eb5b219aeaa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:23.584568 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d715be-1c2f-4c10-853a-eb5b219aeaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:23.584847 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d715be-1c2f-4c10-853a-eb5b219aeaa6 admin admin] PATH_INFO: `/v3/projects/fe3ade8cc2f34504b9062f2ed6f8561c` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:23.586102 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d715be-1c2f-4c10-853a-eb5b219aeaa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe3ade8cc2f34504b9062f2ed6f8561c)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:23.590339 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d715be-1c2f-4c10-853a-eb5b219aeaa6 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:23.593183 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d88ba4-1fdc-4dff-8c6b-bc902e6b5c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:23.594604 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d88ba4-1fdc-4dff-8c6b-bc902e6b5c9f admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:23.599781 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d88ba4-1fdc-4dff-8c6b-bc902e6b5c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:23.602619 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d88ba4-1fdc-4dff-8c6b-bc902e6b5c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:23.603721 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d88ba4-1fdc-4dff-8c6b-bc902e6b5c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:23.624447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d88ba4-1fdc-4dff-8c6b-bc902e6b5c9f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:23.670630 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 884/1774] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:23.673048 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d88ba4-1fdc-4dff-8c6b-bc902e6b5c9f admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:23.678726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b2d88ba4-1fdc-4dff-8c6b-bc902e6b5c9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:23.690779 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-87d715be-1c2f-4c10-853a-eb5b219aeaa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe3ade8cc2f34504b9062f2ed6f8561c', 'request_id': 'req-87d715be-1c2f-4c10-853a-eb5b219aeaa6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:23.708731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d88ba4-1fdc-4dff-8c6b-bc902e6b5c9f admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:23.717134 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-87d715be-1c2f-4c10-853a-eb5b219aeaa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe3ade8cc2f34504b9062f2ed6f8561c', 'request_id': 'req-87d715be-1c2f-4c10-853a-eb5b219aeaa6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:23.733306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-87d715be-1c2f-4c10-853a-eb5b219aeaa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe3ade8cc2f34504b9062f2ed6f8561c', 'request_id': 'req-87d715be-1c2f-4c10-853a-eb5b219aeaa6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:23.753956 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-87d715be-1c2f-4c10-853a-eb5b219aeaa6 admin admin] The token cache is being invalidate because project fe3ade8cc2f34504b9062f2ed6f8561c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:42:23.754815 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-87d715be-1c2f-4c10-853a-eb5b219aeaa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:23.755566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-87d715be-1c2f-4c10-853a-eb5b219aeaa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:23.760047 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 891/1775] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:42:23 2022] DELETE /identity/v3/projects/fe3ade8cc2f34504b9062f2ed6f8561c => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:23.760047 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d715be-1c2f-4c10-853a-eb5b219aeaa6 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:23.760047 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-87d715be-1c2f-4c10-853a-eb5b219aeaa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:23.904584 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3378b4c-1b89-420a-a65d-9733dcb59131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:23.918724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3378b4c-1b89-420a-a65d-9733dcb59131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:23.920380 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3378b4c-1b89-420a-a65d-9733dcb59131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:23.921404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3378b4c-1b89-420a-a65d-9733dcb59131 admin admin] PATH_INFO: `/v3/projects/55e1f5e3613c4abf9d762abf1b44cb79` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:23.925730 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3378b4c-1b89-420a-a65d-9733dcb59131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55e1f5e3613c4abf9d762abf1b44cb79)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:23.928014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: WARNING py.warnings [None req-d3378b4c-1b89-420a-a65d-9733dcb59131 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 14 19:42:23.928014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: warnings.warn(msg) Jun 14 19:42:23.928014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: Jun 14 19:42:23.932592 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3378b4c-1b89-420a-a65d-9733dcb59131 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:23.941139 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d715be-1c2f-4c10-853a-eb5b219aeaa6 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:23.954451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b892a3-51ff-468d-826a-29bede1da3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:23.956496 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b892a3-51ff-468d-826a-29bede1da3cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:23.956835 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b892a3-51ff-468d-826a-29bede1da3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:23.957861 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b892a3-51ff-468d-826a-29bede1da3cd admin admin] PATH_INFO: `/v3/projects/793968565e3e4613af858ee583a6e6e1/users/21ab21fc2a73449b8224b273f408a7d3/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:24.016666 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b892a3-51ff-468d-826a-29bede1da3cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=793968565e3e4613af858ee583a6e6e1, user_id=21ab21fc2a73449b8224b273f408a7d3, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:24.034274 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b892a3-51ff-468d-826a-29bede1da3cd admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:24.080082 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 892/1776] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:23 2022] PUT /identity/v3/projects/793968565e3e4613af858ee583a6e6e1/users/21ab21fc2a73449b8224b273f408a7d3/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:24.089900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b892a3-51ff-468d-826a-29bede1da3cd admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:24.099347 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-a7b892a3-51ff-468d-826a-29bede1da3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:24.123540 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d3378b4c-1b89-420a-a65d-9733dcb59131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55e1f5e3613c4abf9d762abf1b44cb79', 'request_id': 'req-d3378b4c-1b89-420a-a65d-9733dcb59131'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:24.152577 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d3378b4c-1b89-420a-a65d-9733dcb59131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55e1f5e3613c4abf9d762abf1b44cb79', 'request_id': 'req-d3378b4c-1b89-420a-a65d-9733dcb59131'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:24.168306 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d3378b4c-1b89-420a-a65d-9733dcb59131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55e1f5e3613c4abf9d762abf1b44cb79', 'request_id': 'req-d3378b4c-1b89-420a-a65d-9733dcb59131'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:24.210961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d3378b4c-1b89-420a-a65d-9733dcb59131 admin admin] The token cache is being invalidate because project 55e1f5e3613c4abf9d762abf1b44cb79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:42:24.211172 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d3378b4c-1b89-420a-a65d-9733dcb59131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:24.214340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:24.214989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d3378b4c-1b89-420a-a65d-9733dcb59131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:24.221914 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 885/1777] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:42:23 2022] DELETE /identity/v3/projects/55e1f5e3613c4abf9d762abf1b44cb79 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:24.221914 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75347b4a-4363-4d46-bf10-3f4e9eab0a09 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:24.221914 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75347b4a-4363-4d46-bf10-3f4e9eab0a09 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:24.222565 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75347b4a-4363-4d46-bf10-3f4e9eab0a09 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:24.228165 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 886/1778] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jun 14 19:42:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:42:24.237150 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0812b-9158-4ae4-9847-c035b39a766d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:24.238622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0812b-9158-4ae4-9847-c035b39a766d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:24.238968 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0812b-9158-4ae4-9847-c035b39a766d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:24.242602 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b892a3-51ff-468d-826a-29bede1da3cd admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:24.324150 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:24.329225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-44b0812b-9158-4ae4-9847-c035b39a766d None None] MFA Rules not processed for user `21ab21fc2a73449b8224b273f408a7d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:24.331404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-44b0812b-9158-4ae4-9847-c035b39a766d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:24.423816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca14d20-2b5a-4207-a377-ce62357b977d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:24.424828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca14d20-2b5a-4207-a377-ce62357b977d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:24.425835 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca14d20-2b5a-4207-a377-ce62357b977d admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:24.429767 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca14d20-2b5a-4207-a377-ce62357b977d admin admin] PATH_INFO: `/v3/users/782c79ba24c94bc1928c0db1a6a5d1fe` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:24.431874 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca14d20-2b5a-4207-a377-ce62357b977d admin admin] RBAC: Authorizing `identity:delete_user(user_id=782c79ba24c94bc1928c0db1a6a5d1fe)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:24.434724 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca14d20-2b5a-4207-a377-ce62357b977d admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:24.518389 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 887/1779] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:24.520003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d7f9f-f9e4-4990-b6f5-48485213591a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:24.522044 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d7f9f-f9e4-4990-b6f5-48485213591a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:24.524089 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d7f9f-f9e4-4990-b6f5-48485213591a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:24.568266 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-974d7f9f-f9e4-4990-b6f5-48485213591a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:24.570938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-974d7f9f-f9e4-4990-b6f5-48485213591a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:24.580942 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 888/1780] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:24.582648 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2af301-5bfe-49bd-8356-c7d9cdc4cfc1 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:24.583180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2af301-5bfe-49bd-8356-c7d9cdc4cfc1 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:24.583555 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2af301-5bfe-49bd-8356-c7d9cdc4cfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:24.590071 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eca14d20-2b5a-4207-a377-ce62357b977d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '782c79ba24c94bc1928c0db1a6a5d1fe'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:24.591935 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eca14d20-2b5a-4207-a377-ce62357b977d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '782c79ba24c94bc1928c0db1a6a5d1fe'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:24.612839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eca14d20-2b5a-4207-a377-ce62357b977d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '782c79ba24c94bc1928c0db1a6a5d1fe'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:24.626539 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eca14d20-2b5a-4207-a377-ce62357b977d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '782c79ba24c94bc1928c0db1a6a5d1fe'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:24.661090 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1e2af301-5bfe-49bd-8356-c7d9cdc4cfc1 None None] MFA Rules not processed for user `37c521e20aea4cad9758568a4f082fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:24.662430 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eca14d20-2b5a-4207-a377-ce62357b977d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '782c79ba24c94bc1928c0db1a6a5d1fe'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:24.667457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1e2af301-5bfe-49bd-8356-c7d9cdc4cfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:24.676161 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 893/1781] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:42:24 2022] DELETE /identity/v3/users/782c79ba24c94bc1928c0db1a6a5d1fe => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:24.677811 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca14d20-2b5a-4207-a377-ce62357b977d admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:24.681308 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-eca14d20-2b5a-4207-a377-ce62357b977d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:24.827611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 889/1782] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jun 14 19:42:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:24.828872 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1348c6-8068-4071-8684-c320c4bf02b6 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:24.829232 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1348c6-8068-4071-8684-c320c4bf02b6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:24.829818 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1348c6-8068-4071-8684-c320c4bf02b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:24.857943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca14d20-2b5a-4207-a377-ce62357b977d admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:24.865706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3704eb6-0e74-47af-b2a0-dba32b30a204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:24.866399 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3704eb6-0e74-47af-b2a0-dba32b30a204 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:24.866688 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3704eb6-0e74-47af-b2a0-dba32b30a204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:24.867097 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3704eb6-0e74-47af-b2a0-dba32b30a204 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:24.868026 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3704eb6-0e74-47af-b2a0-dba32b30a204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:24.871217 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3704eb6-0e74-47af-b2a0-dba32b30a204 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:24.878455 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ac1348c6-8068-4071-8684-c320c4bf02b6 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:24.881786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ac1348c6-8068-4071-8684-c320c4bf02b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:24.888994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:24.907738 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 890/1783] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:24.912165 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1348c6-8068-4071-8684-c320c4bf02b6 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:24.926127 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1348c6-8068-4071-8684-c320c4bf02b6 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:24.933696 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 894/1784] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:24 2022] POST /identity/v3/projects => generated 373 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:24.934942 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3704eb6-0e74-47af-b2a0-dba32b30a204 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:25.063204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3704eb6-0e74-47af-b2a0-dba32b30a204 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:25.068662 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d02c4f-306a-434d-b993-9d4f33260514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:25.069750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d02c4f-306a-434d-b993-9d4f33260514 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:25.070160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d02c4f-306a-434d-b993-9d4f33260514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:25.070456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d02c4f-306a-434d-b993-9d4f33260514 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:25.071496 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d02c4f-306a-434d-b993-9d4f33260514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:25.074466 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d02c4f-306a-434d-b993-9d4f33260514 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:25.114584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 895/1785] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:24 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:25.118939 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d02c4f-306a-434d-b993-9d4f33260514 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:25.134430 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d02c4f-306a-434d-b993-9d4f33260514 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:25.144465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4abbbc-a8c3-4dd2-8121-a0b617cb2e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:25.145366 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4abbbc-a8c3-4dd2-8121-a0b617cb2e04 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:25.145841 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4abbbc-a8c3-4dd2-8121-a0b617cb2e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:25.146227 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4abbbc-a8c3-4dd2-8121-a0b617cb2e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:25.147266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4abbbc-a8c3-4dd2-8121-a0b617cb2e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:25.149393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4abbbc-a8c3-4dd2-8121-a0b617cb2e04 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:25.166712 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 896/1786] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:25.171839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4abbbc-a8c3-4dd2-8121-a0b617cb2e04 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:25.185868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4abbbc-a8c3-4dd2-8121-a0b617cb2e04 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:25.196465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf08f0-8bbb-41db-a45a-498ccd27add6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:25.199816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf08f0-8bbb-41db-a45a-498ccd27add6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:25.199816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf08f0-8bbb-41db-a45a-498ccd27add6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:25.200313 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccf08f0-8bbb-41db-a45a-498ccd27add6 admin admin] PATH_INFO: `/v3/projects/8f01686930704e748d06e844b757c469/users/4dbd4b0914fc40b1a8a2b91003f9d5da/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:25.273316 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf08f0-8bbb-41db-a45a-498ccd27add6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f01686930704e748d06e844b757c469, user_id=4dbd4b0914fc40b1a8a2b91003f9d5da, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:25.276647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccf08f0-8bbb-41db-a45a-498ccd27add6 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:25.300749 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 897/1787] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:25 2022] PUT /identity/v3/projects/8f01686930704e748d06e844b757c469/users/4dbd4b0914fc40b1a8a2b91003f9d5da/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:25.304425 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf08f0-8bbb-41db-a45a-498ccd27add6 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:25.342834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db6f7a-703e-46cd-aa6e-99110a8c5da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:25.344239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db6f7a-703e-46cd-aa6e-99110a8c5da4 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:25.344715 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db6f7a-703e-46cd-aa6e-99110a8c5da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:25.345202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db6f7a-703e-46cd-aa6e-99110a8c5da4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:25.346304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db6f7a-703e-46cd-aa6e-99110a8c5da4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:42:25.346827 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db6f7a-703e-46cd-aa6e-99110a8c5da4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:25.348698 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28db6f7a-703e-46cd-aa6e-99110a8c5da4 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:25.367000 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 891/1788] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:42:25.368184 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db6f7a-703e-46cd-aa6e-99110a8c5da4 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:25.379339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db6f7a-703e-46cd-aa6e-99110a8c5da4 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:25.398903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:25.411768 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccf08f0-8bbb-41db-a45a-498ccd27add6 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:25.418598 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41105633-4a52-4af0-ba8a-6aa7a0fb551a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:25.419532 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41105633-4a52-4af0-ba8a-6aa7a0fb551a admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:25.419919 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41105633-4a52-4af0-ba8a-6aa7a0fb551a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:25.420298 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41105633-4a52-4af0-ba8a-6aa7a0fb551a admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:25.421714 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41105633-4a52-4af0-ba8a-6aa7a0fb551a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:25.423894 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41105633-4a52-4af0-ba8a-6aa7a0fb551a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:25.439849 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 898/1789] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:25.443752 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41105633-4a52-4af0-ba8a-6aa7a0fb551a admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:25.459732 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41105633-4a52-4af0-ba8a-6aa7a0fb551a admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:25.467264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fbe72-f7e5-40a9-a106-db82074a983f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:25.468163 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fbe72-f7e5-40a9-a106-db82074a983f admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:25.468437 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fbe72-f7e5-40a9-a106-db82074a983f admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:25.468720 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fbe72-f7e5-40a9-a106-db82074a983f admin admin] PATH_INFO: `/v3/projects/8f01686930704e748d06e844b757c469/users/4dbd4b0914fc40b1a8a2b91003f9d5da/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:25.470923 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fbe72-f7e5-40a9-a106-db82074a983f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f01686930704e748d06e844b757c469, user_id=4dbd4b0914fc40b1a8a2b91003f9d5da, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:25.474058 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fbe72-f7e5-40a9-a106-db82074a983f admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:25.482111 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb095e2-8ab8-4508-b70c-59ea63b71be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:25.482860 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb095e2-8ab8-4508-b70c-59ea63b71be6 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:25.483149 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb095e2-8ab8-4508-b70c-59ea63b71be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:25.483762 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb095e2-8ab8-4508-b70c-59ea63b71be6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:25.484505 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb095e2-8ab8-4508-b70c-59ea63b71be6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:25.486693 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb095e2-8ab8-4508-b70c-59ea63b71be6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:25.489027 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 899/1790] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:25 2022] PUT /identity/v3/projects/8f01686930704e748d06e844b757c469/users/4dbd4b0914fc40b1a8a2b91003f9d5da/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:25.502272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8ca32-8a1d-4cdd-a117-1196fd2a113a None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:25.502762 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8ca32-8a1d-4cdd-a117-1196fd2a113a None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:25.503131 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8ca32-8a1d-4cdd-a117-1196fd2a113a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:25.563632 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 892/1791] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:25 2022] POST /identity/v3/projects => generated 363 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:25.571604 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb095e2-8ab8-4508-b70c-59ea63b71be6 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:25.574130 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-d2b8ca32-8a1d-4cdd-a117-1196fd2a113a None None] MFA Rules not processed for user `4dbd4b0914fc40b1a8a2b91003f9d5da`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:25.578141 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-d2b8ca32-8a1d-4cdd-a117-1196fd2a113a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:25.629828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:25.739867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 900/1792] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:25.750227 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb095e2-8ab8-4508-b70c-59ea63b71be6 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:25.750626 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8ca32-8a1d-4cdd-a117-1196fd2a113a None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:25.755174 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-d2b8ca32-8a1d-4cdd-a117-1196fd2a113a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:25.763963 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e79bf-c6c4-4173-8ce1-384eae10a9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:25.765288 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e79bf-c6c4-4173-8ce1-384eae10a9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:25.765649 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e79bf-c6c4-4173-8ce1-384eae10a9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:25.766193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e79bf-c6c4-4173-8ce1-384eae10a9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:25.766926 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e79bf-c6c4-4173-8ce1-384eae10a9e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:25.768917 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e79bf-c6c4-4173-8ce1-384eae10a9e2 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:25.802432 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 893/1793] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:25 2022] POST /identity/v3/users => generated 282 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:25.808397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e79bf-c6c4-4173-8ce1-384eae10a9e2 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:25.839624 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e79bf-c6c4-4173-8ce1-384eae10a9e2 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:25.854093 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634b123-7f87-456f-9a1e-861e6cfcd29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:25.855112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634b123-7f87-456f-9a1e-861e6cfcd29d admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:25.855399 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634b123-7f87-456f-9a1e-861e6cfcd29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:25.855679 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634b123-7f87-456f-9a1e-861e6cfcd29d admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:25.872908 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634b123-7f87-456f-9a1e-861e6cfcd29d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:25.876685 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634b123-7f87-456f-9a1e-861e6cfcd29d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:25.907601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 894/1794] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:25.913332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634b123-7f87-456f-9a1e-861e6cfcd29d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:25.935901 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634b123-7f87-456f-9a1e-861e6cfcd29d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:25.940974 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8ca32-8a1d-4cdd-a117-1196fd2a113a None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:25.951642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e1fa8-0d8e-4e5c-a44c-7e34393fc947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:25.953624 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dfb2b-bcd8-42fb-9e0c-49a21b43a508 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:25.954317 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dfb2b-bcd8-42fb-9e0c-49a21b43a508 service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:25.954600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dfb2b-bcd8-42fb-9e0c-49a21b43a508 service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:25.954876 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dfb2b-bcd8-42fb-9e0c-49a21b43a508 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:25.955100 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e1fa8-0d8e-4e5c-a44c-7e34393fc947 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:25.955601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e1fa8-0d8e-4e5c-a44c-7e34393fc947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:25.956846 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e1fa8-0d8e-4e5c-a44c-7e34393fc947 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:25.959307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e1fa8-0d8e-4e5c-a44c-7e34393fc947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:25.963086 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e1fa8-0d8e-4e5c-a44c-7e34393fc947 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:25.984212 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dfb2b-bcd8-42fb-9e0c-49a21b43a508 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:25.985679 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dfb2b-bcd8-42fb-9e0c-49a21b43a508 service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:25.992987 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 895/1795] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:25.999536 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e1fa8-0d8e-4e5c-a44c-7e34393fc947 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:26.008472 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 901/1796] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:26.045088 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e1fa8-0d8e-4e5c-a44c-7e34393fc947 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:26.064072 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c4a4e-74c2-4123-85c4-2d9eb4232ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:26.064984 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c4a4e-74c2-4123-85c4-2d9eb4232ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:26.065271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c4a4e-74c2-4123-85c4-2d9eb4232ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:26.069476 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c4a4e-74c2-4123-85c4-2d9eb4232ae7 admin admin] PATH_INFO: `/v3/projects/b0b200c77be645dfa30c6dc295b7d72c/users/e558a73ddb894c2da06efaaa60a92c63/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:26.079038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dfb2b-bcd8-42fb-9e0c-49a21b43a508 service cinder] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:26.080985 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-3a0dfb2b-bcd8-42fb-9e0c-49a21b43a508 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:26.145726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c4a4e-74c2-4123-85c4-2d9eb4232ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b200c77be645dfa30c6dc295b7d72c, user_id=e558a73ddb894c2da06efaaa60a92c63, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:26.148412 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c4a4e-74c2-4123-85c4-2d9eb4232ae7 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:26.197527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 896/1797] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:25 2022] PUT /identity/v3/projects/b0b200c77be645dfa30c6dc295b7d72c/users/e558a73ddb894c2da06efaaa60a92c63/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:26.200026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c4a4e-74c2-4123-85c4-2d9eb4232ae7 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:26.305115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dfb2b-bcd8-42fb-9e0c-49a21b43a508 service cinder] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:26.319743 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:26.342533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c4a4e-74c2-4123-85c4-2d9eb4232ae7 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:26.359814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a67314-b881-42d0-9b53-6d352622ccf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:26.360500 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a67314-b881-42d0-9b53-6d352622ccf6 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:26.360500 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a67314-b881-42d0-9b53-6d352622ccf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:26.360671 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a67314-b881-42d0-9b53-6d352622ccf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:26.367564 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-55a67314-b881-42d0-9b53-6d352622ccf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:26.449063 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:26.472373 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef92d7-3063-4fcf-9735-6b5580801818 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:26.473036 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef92d7-3063-4fcf-9735-6b5580801818 service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:26.473321 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef92d7-3063-4fcf-9735-6b5580801818 service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:26.473796 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef92d7-3063-4fcf-9735-6b5580801818 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:26.485029 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef92d7-3063-4fcf-9735-6b5580801818 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:26.486671 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef92d7-3063-4fcf-9735-6b5580801818 service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:26.502864 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 902/1798] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:42:26.504273 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a66fd7-0e9b-4300-b9aa-102bbbf250f6 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:26.504565 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a66fd7-0e9b-4300-b9aa-102bbbf250f6 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:26.504845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a66fd7-0e9b-4300-b9aa-102bbbf250f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:26.536241 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-e0a66fd7-0e9b-4300-b9aa-102bbbf250f6 None None] MFA Rules not processed for user `e558a73ddb894c2da06efaaa60a92c63`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:26.537388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e0a66fd7-0e9b-4300-b9aa-102bbbf250f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:26.549817 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a67314-b881-42d0-9b53-6d352622ccf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:26.554889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a67314-b881-42d0-9b53-6d352622ccf6 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:26.589580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 897/1799] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:26.724912 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 903/1800] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:26 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:26.729486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a67314-b881-42d0-9b53-6d352622ccf6 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:26.873443 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a67314-b881-42d0-9b53-6d352622ccf6 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:26.881222 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368952ce-786a-4e43-bb86-002b73068cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:26.882312 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368952ce-786a-4e43-bb86-002b73068cff admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:26.882788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368952ce-786a-4e43-bb86-002b73068cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:26.883189 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368952ce-786a-4e43-bb86-002b73068cff admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:26.884163 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368952ce-786a-4e43-bb86-002b73068cff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:26.888511 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368952ce-786a-4e43-bb86-002b73068cff admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:26.946652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 898/1801] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:26 2022] POST /identity/v3/projects => generated 365 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:26.951274 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a66fd7-0e9b-4300-b9aa-102bbbf250f6 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:26.967984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a66fd7-0e9b-4300-b9aa-102bbbf250f6 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:27.106365 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fecce-6a85-48e6-96cb-1d3365211b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:27.108402 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fecce-6a85-48e6-96cb-1d3365211b35 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:27.108402 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fecce-6a85-48e6-96cb-1d3365211b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:27.108402 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221fecce-6a85-48e6-96cb-1d3365211b35 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:27.108716 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fecce-6a85-48e6-96cb-1d3365211b35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:27.110680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221fecce-6a85-48e6-96cb-1d3365211b35 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:27.146566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 904/1802] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:26 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:27.147686 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368952ce-786a-4e43-bb86-002b73068cff admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:27.162151 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fecce-6a85-48e6-96cb-1d3365211b35 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:27.168793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-221fecce-6a85-48e6-96cb-1d3365211b35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:27.172076 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368952ce-786a-4e43-bb86-002b73068cff admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:27.185691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80dacdf-a382-4355-b2c7-d60f0dd36e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:27.186535 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80dacdf-a382-4355-b2c7-d60f0dd36e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:27.187749 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80dacdf-a382-4355-b2c7-d60f0dd36e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:27.188216 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80dacdf-a382-4355-b2c7-d60f0dd36e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:27.189155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80dacdf-a382-4355-b2c7-d60f0dd36e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:27.194946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80dacdf-a382-4355-b2c7-d60f0dd36e91 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:27.224466 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 899/1803] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:27.230066 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221fecce-6a85-48e6-96cb-1d3365211b35 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:27.230796 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80dacdf-a382-4355-b2c7-d60f0dd36e91 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:27.244037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51583e7e-90cf-4153-b341-a2c1968c3d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:27.245168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51583e7e-90cf-4153-b341-a2c1968c3d78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:27.245277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51583e7e-90cf-4153-b341-a2c1968c3d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:27.245537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51583e7e-90cf-4153-b341-a2c1968c3d78 admin admin] PATH_INFO: `/v3/projects/c9f4c2a6618a4776995bf5db7ddc07e3` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:27.247488 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80dacdf-a382-4355-b2c7-d60f0dd36e91 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:27.249817 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51583e7e-90cf-4153-b341-a2c1968c3d78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f4c2a6618a4776995bf5db7ddc07e3)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:27.251826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51583e7e-90cf-4153-b341-a2c1968c3d78 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:27.253247 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1995fb-6002-457f-8054-b9e27022d0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:27.254526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1995fb-6002-457f-8054-b9e27022d0ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:27.254879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1995fb-6002-457f-8054-b9e27022d0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:27.255163 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1995fb-6002-457f-8054-b9e27022d0ac admin admin] PATH_INFO: `/v3/projects/b3de33309c6146bf8d57aaed9c4e4afe/users/fdab6cbc92c2498d9e7bf9608fe9af08/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:27.278160 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1995fb-6002-457f-8054-b9e27022d0ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3de33309c6146bf8d57aaed9c4e4afe, user_id=fdab6cbc92c2498d9e7bf9608fe9af08, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:27.282302 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1995fb-6002-457f-8054-b9e27022d0ac admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:27.309830 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 900/1804] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:27 2022] PUT /identity/v3/projects/b3de33309c6146bf8d57aaed9c4e4afe/users/fdab6cbc92c2498d9e7bf9608fe9af08/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:27.313963 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1995fb-6002-457f-8054-b9e27022d0ac admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:27.356226 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-51583e7e-90cf-4153-b341-a2c1968c3d78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f4c2a6618a4776995bf5db7ddc07e3', 'request_id': 'req-51583e7e-90cf-4153-b341-a2c1968c3d78'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:27.371682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:27.374269 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-51583e7e-90cf-4153-b341-a2c1968c3d78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f4c2a6618a4776995bf5db7ddc07e3', 'request_id': 'req-51583e7e-90cf-4153-b341-a2c1968c3d78'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:27.393011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-51583e7e-90cf-4153-b341-a2c1968c3d78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f4c2a6618a4776995bf5db7ddc07e3', 'request_id': 'req-51583e7e-90cf-4153-b341-a2c1968c3d78'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:27.476430 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:27.515239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1995fb-6002-457f-8054-b9e27022d0ac admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:27.596400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2c813-3534-48b5-ae7f-2429e4340a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:27.597890 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2c813-3534-48b5-ae7f-2429e4340a26 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:27.598320 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2c813-3534-48b5-ae7f-2429e4340a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:27.598697 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2c813-3534-48b5-ae7f-2429e4340a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:27.599593 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2c813-3534-48b5-ae7f-2429e4340a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:27.602036 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2c813-3534-48b5-ae7f-2429e4340a26 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:27.620437 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 901/1805] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:27.622775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2c813-3534-48b5-ae7f-2429e4340a26 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:27.638724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2c813-3534-48b5-ae7f-2429e4340a26 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:27.644991 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5475df-d23c-445a-97be-fb87dc8c7368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:27.646114 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5475df-d23c-445a-97be-fb87dc8c7368 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:27.646642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5475df-d23c-445a-97be-fb87dc8c7368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:27.647020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5475df-d23c-445a-97be-fb87dc8c7368 admin admin] PATH_INFO: `/v3/projects/b3de33309c6146bf8d57aaed9c4e4afe/users/fdab6cbc92c2498d9e7bf9608fe9af08/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:27.649524 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5475df-d23c-445a-97be-fb87dc8c7368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3de33309c6146bf8d57aaed9c4e4afe, user_id=fdab6cbc92c2498d9e7bf9608fe9af08, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:27.652335 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5475df-d23c-445a-97be-fb87dc8c7368 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:27.673136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-51583e7e-90cf-4153-b341-a2c1968c3d78 admin admin] The token cache is being invalidate because project c9f4c2a6618a4776995bf5db7ddc07e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:42:27.673610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-51583e7e-90cf-4153-b341-a2c1968c3d78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:27.674459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-51583e7e-90cf-4153-b341-a2c1968c3d78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:27.676433 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 905/1806] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:42:27 2022] DELETE /identity/v3/projects/c9f4c2a6618a4776995bf5db7ddc07e3 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:27.685425 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 902/1807] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:27 2022] PUT /identity/v3/projects/b3de33309c6146bf8d57aaed9c4e4afe/users/fdab6cbc92c2498d9e7bf9608fe9af08/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:27.685632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ecf3a-cbd1-4d79-8cfc-fcda3b2c50f2 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:27.685632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ecf3a-cbd1-4d79-8cfc-fcda3b2c50f2 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:27.685632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ecf3a-cbd1-4d79-8cfc-fcda3b2c50f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:27.689853 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5038e86-00e5-4a26-88bd-d8317a221930 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:27.690249 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5038e86-00e5-4a26-88bd-d8317a221930 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:27.690664 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5038e86-00e5-4a26-88bd-d8317a221930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:27.746632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-cd4ecf3a-cbd1-4d79-8cfc-fcda3b2c50f2 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:27.748323 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-cd4ecf3a-cbd1-4d79-8cfc-fcda3b2c50f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:27.770274 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f5038e86-00e5-4a26-88bd-d8317a221930 None None] MFA Rules not processed for user `fdab6cbc92c2498d9e7bf9608fe9af08`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:27.775125 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f5038e86-00e5-4a26-88bd-d8317a221930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:27.913643 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 906/1808] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:27.916619 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407464cf-4b41-4c28-833e-a83846f48656 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:27.918466 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407464cf-4b41-4c28-833e-a83846f48656 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:27.918791 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407464cf-4b41-4c28-833e-a83846f48656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:27.993123 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 903/1809] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:27 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:42:28.006629 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5038e86-00e5-4a26-88bd-d8317a221930 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:28.007805 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-407464cf-4b41-4c28-833e-a83846f48656 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:28.008251 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f5038e86-00e5-4a26-88bd-d8317a221930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:28.015055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-407464cf-4b41-4c28-833e-a83846f48656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:28.077845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 907/1810] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:28.089739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407464cf-4b41-4c28-833e-a83846f48656 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:28.115167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407464cf-4b41-4c28-833e-a83846f48656 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:28.130964 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7630ee0-d7dd-4243-bba8-ee7e3a5fb37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:28.131660 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7630ee0-d7dd-4243-bba8-ee7e3a5fb37c admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:28.131934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7630ee0-d7dd-4243-bba8-ee7e3a5fb37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:28.132320 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7630ee0-d7dd-4243-bba8-ee7e3a5fb37c admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:28.133068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7630ee0-d7dd-4243-bba8-ee7e3a5fb37c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:42:28.133577 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7630ee0-d7dd-4243-bba8-ee7e3a5fb37c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:28.135219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7630ee0-d7dd-4243-bba8-ee7e3a5fb37c admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:28.152331 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5038e86-00e5-4a26-88bd-d8317a221930 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:28.159380 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5f701-ba0e-403f-8ff5-3d1eec2dd2c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:28.160193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5f701-ba0e-403f-8ff5-3d1eec2dd2c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:28.160579 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5f701-ba0e-403f-8ff5-3d1eec2dd2c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:28.160956 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5f701-ba0e-403f-8ff5-3d1eec2dd2c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:28.181846 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5f701-ba0e-403f-8ff5-3d1eec2dd2c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:28.183446 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5f701-ba0e-403f-8ff5-3d1eec2dd2c0 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:28.194928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 908/1811] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:42:28.201263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7630ee0-d7dd-4243-bba8-ee7e3a5fb37c admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:28.211408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 904/1812] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:28 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:42:28.229195 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7630ee0-d7dd-4243-bba8-ee7e3a5fb37c admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:28.244412 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f68d0f-af79-41a0-bf1c-66f8392d4ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:28.245965 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f68d0f-af79-41a0-bf1c-66f8392d4ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:28.246231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f68d0f-af79-41a0-bf1c-66f8392d4ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:28.246510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f68d0f-af79-41a0-bf1c-66f8392d4ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:28.247211 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f68d0f-af79-41a0-bf1c-66f8392d4ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:28.251326 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f68d0f-af79-41a0-bf1c-66f8392d4ba9 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:28.357185 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 909/1813] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:28 2022] POST /identity/v3/projects => generated 375 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:28.360286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5f701-ba0e-403f-8ff5-3d1eec2dd2c0 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:28.377051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5f701-ba0e-403f-8ff5-3d1eec2dd2c0 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:28.395669 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:28.534088 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b88be-ab36-4386-b31d-1df6fd6900b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:28.534779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b88be-ab36-4386-b31d-1df6fd6900b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:28.535066 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b88be-ab36-4386-b31d-1df6fd6900b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:28.535386 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b88be-ab36-4386-b31d-1df6fd6900b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:28.538405 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b88be-ab36-4386-b31d-1df6fd6900b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:28.538405 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b88be-ab36-4386-b31d-1df6fd6900b8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:28.582393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 905/1814] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:28 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:42:28.586531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f68d0f-af79-41a0-bf1c-66f8392d4ba9 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:28.603759 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f68d0f-af79-41a0-bf1c-66f8392d4ba9 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:28.614965 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad523b81-f93e-4b59-9d99-dffa5f081a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:28.615665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad523b81-f93e-4b59-9d99-dffa5f081a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:28.615933 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad523b81-f93e-4b59-9d99-dffa5f081a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:28.616216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad523b81-f93e-4b59-9d99-dffa5f081a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:28.621160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad523b81-f93e-4b59-9d99-dffa5f081a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:28.622968 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad523b81-f93e-4b59-9d99-dffa5f081a9c admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:28.667012 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 910/1815] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:28.671552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b88be-ab36-4386-b31d-1df6fd6900b8 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:28.686509 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b88be-ab36-4386-b31d-1df6fd6900b8 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:28.699425 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69076fa-18cb-496a-8ceb-1bf4bdd2e137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:28.702676 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69076fa-18cb-496a-8ceb-1bf4bdd2e137 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:28.703237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69076fa-18cb-496a-8ceb-1bf4bdd2e137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:28.703821 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69076fa-18cb-496a-8ceb-1bf4bdd2e137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:28.709520 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69076fa-18cb-496a-8ceb-1bf4bdd2e137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:28.712482 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69076fa-18cb-496a-8ceb-1bf4bdd2e137 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:28.749945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad523b81-f93e-4b59-9d99-dffa5f081a9c admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:28.750469 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 906/1816] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:28.767089 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad523b81-f93e-4b59-9d99-dffa5f081a9c admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:28.782411 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2157e-fde4-4162-841b-9bee7441d45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:28.784332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2157e-fde4-4162-841b-9bee7441d45c admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:28.784514 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2157e-fde4-4162-841b-9bee7441d45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:28.787122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2157e-fde4-4162-841b-9bee7441d45c admin admin] PATH_INFO: `/v3/projects/3015e83b511a4f65b3246ac7a7d73c45/users/e8058628ac244e82a67c2fe2f0e30584/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:28.836803 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2157e-fde4-4162-841b-9bee7441d45c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3015e83b511a4f65b3246ac7a7d73c45, user_id=e8058628ac244e82a67c2fe2f0e30584, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:28.842213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2157e-fde4-4162-841b-9bee7441d45c admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:28.876266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 911/1817] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:28 2022] PUT /identity/v3/projects/3015e83b511a4f65b3246ac7a7d73c45/users/e8058628ac244e82a67c2fe2f0e30584/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:42:28.889288 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d9d1f-0936-4dc8-80c6-7168b8a09e8b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:28.889288 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d9d1f-0936-4dc8-80c6-7168b8a09e8b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:28.889288 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d9d1f-0936-4dc8-80c6-7168b8a09e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:28.949792 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-723d9d1f-0936-4dc8-80c6-7168b8a09e8b None None] MFA Rules not processed for user `e8058628ac244e82a67c2fe2f0e30584`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:28.952264 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-723d9d1f-0936-4dc8-80c6-7168b8a09e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:29.063834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2157e-fde4-4162-841b-9bee7441d45c admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:29.075128 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-fae2157e-fde4-4162-841b-9bee7441d45c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:29.138304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 907/1818] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:29.144058 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d9d1f-0936-4dc8-80c6-7168b8a09e8b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:29.267664 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2157e-fde4-4162-841b-9bee7441d45c admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:29.280411 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2073b7-d200-48fe-90a6-96d85eb293f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:29.282847 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2073b7-d200-48fe-90a6-96d85eb293f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:29.283134 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2073b7-d200-48fe-90a6-96d85eb293f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:29.283412 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2073b7-d200-48fe-90a6-96d85eb293f7 admin admin] PATH_INFO: `/v3/users/e558a73ddb894c2da06efaaa60a92c63` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:29.287749 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2073b7-d200-48fe-90a6-96d85eb293f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e558a73ddb894c2da06efaaa60a92c63)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:29.291009 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2073b7-d200-48fe-90a6-96d85eb293f7 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:29.319055 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d9d1f-0936-4dc8-80c6-7168b8a09e8b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:29.319212 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:29.330192 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a9e7b-5c5a-4e82-8e0f-022018943d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:29.330768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a9e7b-5c5a-4e82-8e0f-022018943d60 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:29.331199 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a9e7b-5c5a-4e82-8e0f-022018943d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:29.331489 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a9e7b-5c5a-4e82-8e0f-022018943d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:29.332218 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a9e7b-5c5a-4e82-8e0f-022018943d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:29.334351 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a9e7b-5c5a-4e82-8e0f-022018943d60 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:29.403494 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:29.413541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 908/1819] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:29 2022] POST /identity/v3/projects => generated 375 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:29.418585 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a9e7b-5c5a-4e82-8e0f-022018943d60 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:29.424767 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1c2073b7-d200-48fe-90a6-96d85eb293f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e558a73ddb894c2da06efaaa60a92c63'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:29.427452 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1c2073b7-d200-48fe-90a6-96d85eb293f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e558a73ddb894c2da06efaaa60a92c63'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:29.450374 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1c2073b7-d200-48fe-90a6-96d85eb293f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e558a73ddb894c2da06efaaa60a92c63'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:29.462824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1c2073b7-d200-48fe-90a6-96d85eb293f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e558a73ddb894c2da06efaaa60a92c63'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:29.493904 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1c2073b7-d200-48fe-90a6-96d85eb293f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e558a73ddb894c2da06efaaa60a92c63'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:29.523473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 912/1820] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:42:29 2022] DELETE /identity/v3/users/e558a73ddb894c2da06efaaa60a92c63 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:29.528790 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9500ce-22a1-4b72-a53f-4d8ad1545af7 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:29.528965 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9500ce-22a1-4b72-a53f-4d8ad1545af7 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:29.529175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9500ce-22a1-4b72-a53f-4d8ad1545af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:29.572271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-6e9500ce-22a1-4b72-a53f-4d8ad1545af7 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:29.574050 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-6e9500ce-22a1-4b72-a53f-4d8ad1545af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:29.587790 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a9e7b-5c5a-4e82-8e0f-022018943d60 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:29.697413 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 913/1821] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:29.702215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcdb39-eb2b-43c9-b0bf-9ff10246751d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:29.702914 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcdb39-eb2b-43c9-b0bf-9ff10246751d admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:29.704085 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcdb39-eb2b-43c9-b0bf-9ff10246751d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:29.704544 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcdb39-eb2b-43c9-b0bf-9ff10246751d admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:29.705755 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcdb39-eb2b-43c9-b0bf-9ff10246751d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:29.707919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcdb39-eb2b-43c9-b0bf-9ff10246751d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:29.757487 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 909/1822] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:29 2022] POST /identity/v3/users => generated 288 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:29.758992 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9500ce-22a1-4b72-a53f-4d8ad1545af7 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:29.762661 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-6e9500ce-22a1-4b72-a53f-4d8ad1545af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:29.784201 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9500ce-22a1-4b72-a53f-4d8ad1545af7 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:29.785756 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcdb39-eb2b-43c9-b0bf-9ff10246751d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:29.788081 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-70bcdb39-eb2b-43c9-b0bf-9ff10246751d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:29.810647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e67db-6b9c-4346-a122-8d7e5c927625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:29.813043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e67db-6b9c-4346-a122-8d7e5c927625 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:29.813535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e67db-6b9c-4346-a122-8d7e5c927625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:29.813893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e67db-6b9c-4346-a122-8d7e5c927625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:29.816064 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e67db-6b9c-4346-a122-8d7e5c927625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:29.819532 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e67db-6b9c-4346-a122-8d7e5c927625 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:29.841786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 914/1823] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:42:29.842522 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e67db-6b9c-4346-a122-8d7e5c927625 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:29.859214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e67db-6b9c-4346-a122-8d7e5c927625 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:29.868786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4e55a-7364-4562-ba3a-4febb00111cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:29.871009 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4e55a-7364-4562-ba3a-4febb00111cf admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:29.872298 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4e55a-7364-4562-ba3a-4febb00111cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:29.872842 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b4e55a-7364-4562-ba3a-4febb00111cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:29.873837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4e55a-7364-4562-ba3a-4febb00111cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:29.875872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b4e55a-7364-4562-ba3a-4febb00111cf admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:29.893667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 915/1824] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:29.922825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4e55a-7364-4562-ba3a-4febb00111cf admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:29.954661 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b4e55a-7364-4562-ba3a-4febb00111cf admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:29.956425 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcdb39-eb2b-43c9-b0bf-9ff10246751d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:29.964721 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3cb07-53ac-4f0b-92c0-987034fb7f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:29.966742 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3cb07-53ac-4f0b-92c0-987034fb7f67 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:29.967534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84068f-7507-4f09-bbc1-d606ed821f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:29.967926 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3cb07-53ac-4f0b-92c0-987034fb7f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:29.968310 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3cb07-53ac-4f0b-92c0-987034fb7f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:29.970376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84068f-7507-4f09-bbc1-d606ed821f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:29.971063 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84068f-7507-4f09-bbc1-d606ed821f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:29.973458 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84068f-7507-4f09-bbc1-d606ed821f90 admin admin] PATH_INFO: `/v3/projects/fe70b42ef3fe4e95af7c9143fcaa630b/users/ee6676137671480b9e5904daee3f2ff1/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:30.008181 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3cb07-53ac-4f0b-92c0-987034fb7f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:30.014261 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3cb07-53ac-4f0b-92c0-987034fb7f67 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:30.030369 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84068f-7507-4f09-bbc1-d606ed821f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe70b42ef3fe4e95af7c9143fcaa630b, user_id=ee6676137671480b9e5904daee3f2ff1, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:30.033881 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84068f-7507-4f09-bbc1-d606ed821f90 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:30.048274 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 910/1825] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:30.093493 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 916/1826] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:29 2022] PUT /identity/v3/projects/fe70b42ef3fe4e95af7c9143fcaa630b/users/ee6676137671480b9e5904daee3f2ff1/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:30.100267 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208c0b7-76f2-44ea-a9b7-1b275afca8d8 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:30.100784 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208c0b7-76f2-44ea-a9b7-1b275afca8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:30.101213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e208c0b7-76f2-44ea-a9b7-1b275afca8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:30.165220 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e208c0b7-76f2-44ea-a9b7-1b275afca8d8 None None] MFA Rules not processed for user `ee6676137671480b9e5904daee3f2ff1`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:30.166606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e208c0b7-76f2-44ea-a9b7-1b275afca8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:30.243361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:30.324961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 911/1827] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:30.329256 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84068f-7507-4f09-bbc1-d606ed821f90 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:30.376859 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:30.400428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84068f-7507-4f09-bbc1-d606ed821f90 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:30.407034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf1b07-47ab-40a4-a1ef-e7c1859caa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:30.408793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf1b07-47ab-40a4-a1ef-e7c1859caa84 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:30.409029 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf1b07-47ab-40a4-a1ef-e7c1859caa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:30.409315 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf1b07-47ab-40a4-a1ef-e7c1859caa84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:30.410998 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf1b07-47ab-40a4-a1ef-e7c1859caa84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:30.413916 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf1b07-47ab-40a4-a1ef-e7c1859caa84 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:30.452542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208c0b7-76f2-44ea-a9b7-1b275afca8d8 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:30.456637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 917/1828] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:30 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:30.468210 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e208c0b7-76f2-44ea-a9b7-1b275afca8d8 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:30.564454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccc2fd-ac4d-41a6-983c-138b31b391d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:30.565303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccc2fd-ac4d-41a6-983c-138b31b391d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:30.565766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccc2fd-ac4d-41a6-983c-138b31b391d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:30.566061 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ccc2fd-ac4d-41a6-983c-138b31b391d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:30.566778 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccc2fd-ac4d-41a6-983c-138b31b391d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:30.569830 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ccc2fd-ac4d-41a6-983c-138b31b391d7 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:30.606530 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 912/1829] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:30 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:30.610841 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf1b07-47ab-40a4-a1ef-e7c1859caa84 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:30.623348 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf1b07-47ab-40a4-a1ef-e7c1859caa84 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:30.633895 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f23ae7-0906-4471-b43f-91071d4f7c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:30.635553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f23ae7-0906-4471-b43f-91071d4f7c61 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:30.636553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f23ae7-0906-4471-b43f-91071d4f7c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:30.637014 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f23ae7-0906-4471-b43f-91071d4f7c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:30.638054 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f23ae7-0906-4471-b43f-91071d4f7c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:30.639975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f23ae7-0906-4471-b43f-91071d4f7c61 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:30.656088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 918/1830] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:30.660785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccc2fd-ac4d-41a6-983c-138b31b391d7 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:30.672734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ccc2fd-ac4d-41a6-983c-138b31b391d7 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:30.678196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1648f-0d5a-42ec-b468-434dacbc1f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:30.679100 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1648f-0d5a-42ec-b468-434dacbc1f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:30.679386 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1648f-0d5a-42ec-b468-434dacbc1f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:30.679664 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1648f-0d5a-42ec-b468-434dacbc1f32 admin admin] PATH_INFO: `/v3/projects/575b434e5e14435aa0dfc4c8c410871c/users/80825e4c3e874f06a5e34d85f31bd3ab/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:30.698262 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1648f-0d5a-42ec-b468-434dacbc1f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=575b434e5e14435aa0dfc4c8c410871c, user_id=80825e4c3e874f06a5e34d85f31bd3ab, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:30.701456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1648f-0d5a-42ec-b468-434dacbc1f32 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:30.724926 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f23ae7-0906-4471-b43f-91071d4f7c61 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:30.726109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 913/1831] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:30 2022] PUT /identity/v3/projects/575b434e5e14435aa0dfc4c8c410871c/users/80825e4c3e874f06a5e34d85f31bd3ab/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:30.739054 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f23ae7-0906-4471-b43f-91071d4f7c61 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:30.823727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dfb0a-32fe-4a27-bf05-84fe9b956e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:30.824683 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dfb0a-32fe-4a27-bf05-84fe9b956e93 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:30.825188 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dfb0a-32fe-4a27-bf05-84fe9b956e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:30.825509 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dfb0a-32fe-4a27-bf05-84fe9b956e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:30.826287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9dfb0a-32fe-4a27-bf05-84fe9b956e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:30.827938 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9dfb0a-32fe-4a27-bf05-84fe9b956e93 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:30.843521 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 919/1832] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:30 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:30.844951 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1648f-0d5a-42ec-b468-434dacbc1f32 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:30.855921 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1648f-0d5a-42ec-b468-434dacbc1f32 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:30.860665 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906524ee-1298-48c4-97da-dddf170c9944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:30.861587 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906524ee-1298-48c4-97da-dddf170c9944 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:30.861870 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906524ee-1298-48c4-97da-dddf170c9944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:30.862143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906524ee-1298-48c4-97da-dddf170c9944 admin admin] PATH_INFO: `/v3/projects/575b434e5e14435aa0dfc4c8c410871c/users/80825e4c3e874f06a5e34d85f31bd3ab/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:30.864433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906524ee-1298-48c4-97da-dddf170c9944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=575b434e5e14435aa0dfc4c8c410871c, user_id=80825e4c3e874f06a5e34d85f31bd3ab, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:30.867139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906524ee-1298-48c4-97da-dddf170c9944 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:30.878147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 914/1833] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:30 2022] PUT /identity/v3/projects/575b434e5e14435aa0dfc4c8c410871c/users/80825e4c3e874f06a5e34d85f31bd3ab/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:42:30.888677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a972574-4313-416f-a9b1-06b5cff9b396 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:30.888970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a972574-4313-416f-a9b1-06b5cff9b396 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:30.889250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a972574-4313-416f-a9b1-06b5cff9b396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:30.917928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-1a972574-4313-416f-a9b1-06b5cff9b396 None None] MFA Rules not processed for user `80825e4c3e874f06a5e34d85f31bd3ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:30.919155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-1a972574-4313-416f-a9b1-06b5cff9b396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:31.000668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 920/1834] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:31.013695 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906524ee-1298-48c4-97da-dddf170c9944 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:31.015474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-906524ee-1298-48c4-97da-dddf170c9944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:31.108491 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906524ee-1298-48c4-97da-dddf170c9944 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:31.118992 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e1317-9af2-4df9-b982-a7ca43f57bae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:31.120167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e1317-9af2-4df9-b982-a7ca43f57bae service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:31.121096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e1317-9af2-4df9-b982-a7ca43f57bae service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:31.121594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659e1317-9af2-4df9-b982-a7ca43f57bae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:31.125885 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-659e1317-9af2-4df9-b982-a7ca43f57bae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:31.224697 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:31.305216 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e1317-9af2-4df9-b982-a7ca43f57bae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:31.307860 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659e1317-9af2-4df9-b982-a7ca43f57bae service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:31.347617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 915/1835] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:31.393816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a972574-4313-416f-a9b1-06b5cff9b396 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:31.395202 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-1a972574-4313-416f-a9b1-06b5cff9b396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:31.476989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:31.525578 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a972574-4313-416f-a9b1-06b5cff9b396 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:31.531833 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2025a-a7c7-439b-8cb9-834c807c6604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:31.532786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2025a-a7c7-439b-8cb9-834c807c6604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:31.533150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2025a-a7c7-439b-8cb9-834c807c6604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:31.533535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2025a-a7c7-439b-8cb9-834c807c6604 admin admin] PATH_INFO: `/v3/projects/b0b200c77be645dfa30c6dc295b7d72c` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:31.534873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2025a-a7c7-439b-8cb9-834c807c6604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0b200c77be645dfa30c6dc295b7d72c)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:31.536932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2025a-a7c7-439b-8cb9-834c807c6604 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:31.614236 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ccc2025a-a7c7-439b-8cb9-834c807c6604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0b200c77be645dfa30c6dc295b7d72c', 'request_id': 'req-ccc2025a-a7c7-439b-8cb9-834c807c6604'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:31.629577 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ccc2025a-a7c7-439b-8cb9-834c807c6604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0b200c77be645dfa30c6dc295b7d72c', 'request_id': 'req-ccc2025a-a7c7-439b-8cb9-834c807c6604'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:31.669719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ccc2025a-a7c7-439b-8cb9-834c807c6604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0b200c77be645dfa30c6dc295b7d72c', 'request_id': 'req-ccc2025a-a7c7-439b-8cb9-834c807c6604'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:31.697745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ccc2025a-a7c7-439b-8cb9-834c807c6604 admin admin] The token cache is being invalidate because project b0b200c77be645dfa30c6dc295b7d72c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:42:31.697745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ccc2025a-a7c7-439b-8cb9-834c807c6604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:31.699113 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ccc2025a-a7c7-439b-8cb9-834c807c6604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:31.705198 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 921/1836] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:42:31 2022] DELETE /identity/v3/projects/b0b200c77be645dfa30c6dc295b7d72c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:31.710437 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e1317-9af2-4df9-b982-a7ca43f57bae service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:31.728684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659e1317-9af2-4df9-b982-a7ca43f57bae service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:31.814899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a9213-2d07-4ae2-94d0-ea9d20804fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:31.815514 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a9213-2d07-4ae2-94d0-ea9d20804fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:31.815810 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a9213-2d07-4ae2-94d0-ea9d20804fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:31.816309 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a9213-2d07-4ae2-94d0-ea9d20804fb5 admin admin] PATH_INFO: `/v3/users/fdab6cbc92c2498d9e7bf9608fe9af08` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:31.818309 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a9213-2d07-4ae2-94d0-ea9d20804fb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdab6cbc92c2498d9e7bf9608fe9af08)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:31.820275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a9213-2d07-4ae2-94d0-ea9d20804fb5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:31.927475 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b92a9213-2d07-4ae2-94d0-ea9d20804fb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdab6cbc92c2498d9e7bf9608fe9af08'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:31.928335 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b92a9213-2d07-4ae2-94d0-ea9d20804fb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdab6cbc92c2498d9e7bf9608fe9af08'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:31.940165 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b92a9213-2d07-4ae2-94d0-ea9d20804fb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdab6cbc92c2498d9e7bf9608fe9af08'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:31.951948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b92a9213-2d07-4ae2-94d0-ea9d20804fb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdab6cbc92c2498d9e7bf9608fe9af08'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:31.969146 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b92a9213-2d07-4ae2-94d0-ea9d20804fb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdab6cbc92c2498d9e7bf9608fe9af08'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:31.982007 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 916/1837] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:42:31 2022] DELETE /identity/v3/users/fdab6cbc92c2498d9e7bf9608fe9af08 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:32.520529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd6bdc-c192-4c7f-ad0b-aaff8cb37300 None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:32.521008 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd6bdc-c192-4c7f-ad0b-aaff8cb37300 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:32.521176 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd6bdc-c192-4c7f-ad0b-aaff8cb37300 None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:32.522895 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 922/1838] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jun 14 19:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:42:32.538897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05aee7a-3654-48ad-b342-5fbbf964e553 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:32.539152 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05aee7a-3654-48ad-b342-5fbbf964e553 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:32.539436 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05aee7a-3654-48ad-b342-5fbbf964e553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:32.567967 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d05aee7a-3654-48ad-b342-5fbbf964e553 None None] MFA Rules not processed for user `37c521e20aea4cad9758568a4f082fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:32.569195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d05aee7a-3654-48ad-b342-5fbbf964e553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:32.651655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:32.676037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd6bdc-c192-4c7f-ad0b-aaff8cb37300 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:32.678121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-15dd6bdc-c192-4c7f-ad0b-aaff8cb37300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:32.730314 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 917/1839] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jun 14 19:42:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:42:32.820487 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd6bdc-c192-4c7f-ad0b-aaff8cb37300 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:32.830160 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05aee7a-3654-48ad-b342-5fbbf964e553 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:32.837485 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071136ed-ca89-4809-9960-576c688f0625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:32.839088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071136ed-ca89-4809-9960-576c688f0625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:32.839630 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071136ed-ca89-4809-9960-576c688f0625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:32.840159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071136ed-ca89-4809-9960-576c688f0625 admin admin] PATH_INFO: `/v3/projects/b3de33309c6146bf8d57aaed9c4e4afe` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:32.842079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d05aee7a-3654-48ad-b342-5fbbf964e553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:32.843014 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071136ed-ca89-4809-9960-576c688f0625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3de33309c6146bf8d57aaed9c4e4afe)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:32.845144 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071136ed-ca89-4809-9960-576c688f0625 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:32.874283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05aee7a-3654-48ad-b342-5fbbf964e553 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:32.894071 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db8b01d-8da6-4177-8f34-ca1873ad88ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:32.894749 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8b01d-8da6-4177-8f34-ca1873ad88ba service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:32.895201 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8b01d-8da6-4177-8f34-ca1873ad88ba service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:32.895621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db8b01d-8da6-4177-8f34-ca1873ad88ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:32.906872 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8b01d-8da6-4177-8f34-ca1873ad88ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:32.908866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db8b01d-8da6-4177-8f34-ca1873ad88ba service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:32.933580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 918/1840] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:32.968424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-071136ed-ca89-4809-9960-576c688f0625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3de33309c6146bf8d57aaed9c4e4afe', 'request_id': 'req-071136ed-ca89-4809-9960-576c688f0625'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:32.995504 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-071136ed-ca89-4809-9960-576c688f0625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3de33309c6146bf8d57aaed9c4e4afe', 'request_id': 'req-071136ed-ca89-4809-9960-576c688f0625'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:33.008701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-071136ed-ca89-4809-9960-576c688f0625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3de33309c6146bf8d57aaed9c4e4afe', 'request_id': 'req-071136ed-ca89-4809-9960-576c688f0625'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:33.018873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:33.023924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-071136ed-ca89-4809-9960-576c688f0625 admin admin] The token cache is being invalidate because project b3de33309c6146bf8d57aaed9c4e4afe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:42:33.024323 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-071136ed-ca89-4809-9960-576c688f0625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:33.025500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-071136ed-ca89-4809-9960-576c688f0625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:33.027989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 923/1841] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:42:32 2022] DELETE /identity/v3/projects/b3de33309c6146bf8d57aaed9c4e4afe => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:33.033300 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad4202-4516-48ab-b3cf-718e6531a7f8 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:33.033837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad4202-4516-48ab-b3cf-718e6531a7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:33.034350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad4202-4516-48ab-b3cf-718e6531a7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:33.087485 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-92ad4202-4516-48ab-b3cf-718e6531a7f8 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:33.088874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-92ad4202-4516-48ab-b3cf-718e6531a7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:33.292040 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 919/1842] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:33.300052 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37435831-22c9-42a0-9125-bf5838d3e287 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:33.300748 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37435831-22c9-42a0-9125-bf5838d3e287 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:33.301263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37435831-22c9-42a0-9125-bf5838d3e287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:33.326390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-37435831-22c9-42a0-9125-bf5838d3e287 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:33.329243 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-37435831-22c9-42a0-9125-bf5838d3e287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:33.342361 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 924/1843] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:33.347254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad4202-4516-48ab-b3cf-718e6531a7f8 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:33.358566 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad4202-4516-48ab-b3cf-718e6531a7f8 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:33.363521 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137f8b0-9efd-42d1-9a8b-929633e0d55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:33.364377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137f8b0-9efd-42d1-9a8b-929633e0d55e admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:33.365215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137f8b0-9efd-42d1-9a8b-929633e0d55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:33.365215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137f8b0-9efd-42d1-9a8b-929633e0d55e admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:33.365849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137f8b0-9efd-42d1-9a8b-929633e0d55e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:42:33.366343 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137f8b0-9efd-42d1-9a8b-929633e0d55e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:33.367979 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137f8b0-9efd-42d1-9a8b-929633e0d55e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:33.388268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 920/1844] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:42:33.390290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37435831-22c9-42a0-9125-bf5838d3e287 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:33.404789 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37435831-22c9-42a0-9125-bf5838d3e287 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:33.411750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1297e-95a6-4ca2-9621-d07c9799a128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:33.412617 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1297e-95a6-4ca2-9621-d07c9799a128 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:33.412998 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1297e-95a6-4ca2-9621-d07c9799a128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:33.413563 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1297e-95a6-4ca2-9621-d07c9799a128 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:33.414591 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1297e-95a6-4ca2-9621-d07c9799a128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:33.429745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1297e-95a6-4ca2-9621-d07c9799a128 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:33.472342 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 925/1845] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:33 2022] POST /identity/v3/projects => generated 365 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:33.476505 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137f8b0-9efd-42d1-9a8b-929633e0d55e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:33.489988 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137f8b0-9efd-42d1-9a8b-929633e0d55e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:33.580052 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c259e-118f-4c3d-b96c-46939116da99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:33.581063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c259e-118f-4c3d-b96c-46939116da99 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:33.581531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c259e-118f-4c3d-b96c-46939116da99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:33.581979 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c259e-118f-4c3d-b96c-46939116da99 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:33.582811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c259e-118f-4c3d-b96c-46939116da99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:33.585060 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c259e-118f-4c3d-b96c-46939116da99 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:33.612827 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 921/1846] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:33 2022] POST /identity/v3/users => generated 283 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:33.614236 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1297e-95a6-4ca2-9621-d07c9799a128 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:33.626872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1297e-95a6-4ca2-9621-d07c9799a128 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:33.632121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917737c7-c2e4-47f2-ae5c-6bb1da2076d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:33.633403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917737c7-c2e4-47f2-ae5c-6bb1da2076d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:33.634254 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917737c7-c2e4-47f2-ae5c-6bb1da2076d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:33.634475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917737c7-c2e4-47f2-ae5c-6bb1da2076d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:33.635962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917737c7-c2e4-47f2-ae5c-6bb1da2076d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:33.638533 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917737c7-c2e4-47f2-ae5c-6bb1da2076d5 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:33.649348 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 926/1847] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:42:33.653811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c259e-118f-4c3d-b96c-46939116da99 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:33.665822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c259e-118f-4c3d-b96c-46939116da99 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:33.678046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b72477e-81c5-499a-9817-bd50ece524a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:33.678737 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72477e-81c5-499a-9817-bd50ece524a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:33.679022 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72477e-81c5-499a-9817-bd50ece524a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:33.679332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b72477e-81c5-499a-9817-bd50ece524a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:33.680069 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72477e-81c5-499a-9817-bd50ece524a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:33.681736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b72477e-81c5-499a-9817-bd50ece524a9 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:33.696808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 922/1848] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:33.701693 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917737c7-c2e4-47f2-ae5c-6bb1da2076d5 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:33.712582 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917737c7-c2e4-47f2-ae5c-6bb1da2076d5 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:33.718659 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4118a67-d053-483f-96ed-35c3d9ab5785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:33.719745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4118a67-d053-483f-96ed-35c3d9ab5785 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:33.720190 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4118a67-d053-483f-96ed-35c3d9ab5785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:33.720806 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4118a67-d053-483f-96ed-35c3d9ab5785 admin admin] PATH_INFO: `/v3/projects/6ead542517674682b8520c3238c6a4cf/users/291a9a734dfd45c0b37a02aab1f25b4d/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:33.738989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4118a67-d053-483f-96ed-35c3d9ab5785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ead542517674682b8520c3238c6a4cf, user_id=291a9a734dfd45c0b37a02aab1f25b4d, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:33.741978 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4118a67-d053-483f-96ed-35c3d9ab5785 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:33.765713 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 927/1849] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:33 2022] PUT /identity/v3/projects/6ead542517674682b8520c3238c6a4cf/users/291a9a734dfd45c0b37a02aab1f25b4d/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:33.772196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f454df-adb2-43e1-8fd3-ee04c797b292 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:33.772582 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f454df-adb2-43e1-8fd3-ee04c797b292 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:33.772756 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f454df-adb2-43e1-8fd3-ee04c797b292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:33.823172 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c5f454df-adb2-43e1-8fd3-ee04c797b292 None None] MFA Rules not processed for user `291a9a734dfd45c0b37a02aab1f25b4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:33.826008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c5f454df-adb2-43e1-8fd3-ee04c797b292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:33.871081 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:33.942460 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4118a67-d053-483f-96ed-35c3d9ab5785 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:33.945057 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 923/1850] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:34.070283 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4118a67-d053-483f-96ed-35c3d9ab5785 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:34.082583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a15eb-2fdb-4455-9b87-9dfa8027c6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:34.083723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a15eb-2fdb-4455-9b87-9dfa8027c6bb admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:34.084343 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a15eb-2fdb-4455-9b87-9dfa8027c6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:34.084767 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a15eb-2fdb-4455-9b87-9dfa8027c6bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:34.085651 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a15eb-2fdb-4455-9b87-9dfa8027c6bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:34.087905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a15eb-2fdb-4455-9b87-9dfa8027c6bb admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:34.143290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 928/1851] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:33 2022] POST /identity/v3/projects => generated 365 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:42:34.147725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f454df-adb2-43e1-8fd3-ee04c797b292 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:34.168290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f454df-adb2-43e1-8fd3-ee04c797b292 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:34.334973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54994397-313f-48c6-b3d2-990ef2d40216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:34.336112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54994397-313f-48c6-b3d2-990ef2d40216 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:34.339343 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54994397-313f-48c6-b3d2-990ef2d40216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:34.341252 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54994397-313f-48c6-b3d2-990ef2d40216 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:34.342279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54994397-313f-48c6-b3d2-990ef2d40216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:34.345115 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54994397-313f-48c6-b3d2-990ef2d40216 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:34.413108 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 924/1852] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:34 2022] POST /identity/v3/users => generated 289 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:42:34.414608 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a15eb-2fdb-4455-9b87-9dfa8027c6bb admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:34.433660 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a15eb-2fdb-4455-9b87-9dfa8027c6bb admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:34.445234 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d87c99-ed2f-4acd-b48c-377c3644b15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:34.446042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d87c99-ed2f-4acd-b48c-377c3644b15e admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:34.446232 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d87c99-ed2f-4acd-b48c-377c3644b15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:34.446476 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d87c99-ed2f-4acd-b48c-377c3644b15e admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:34.447184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d87c99-ed2f-4acd-b48c-377c3644b15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:34.449854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d87c99-ed2f-4acd-b48c-377c3644b15e admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:34.489411 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 929/1853] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:34.493408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54994397-313f-48c6-b3d2-990ef2d40216 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:34.516626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54994397-313f-48c6-b3d2-990ef2d40216 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:34.529689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e9823-c4e2-4ef1-86eb-e7afac58836f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:34.530658 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e9823-c4e2-4ef1-86eb-e7afac58836f admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:34.530894 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e9823-c4e2-4ef1-86eb-e7afac58836f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:34.531176 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e9823-c4e2-4ef1-86eb-e7afac58836f admin admin] PATH_INFO: `/v3/projects/9bdd6afa745f4e61a22c245b26f4a9f7/users/08eee738bab34f7a923a6c901a2faad0/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:34.578911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e9823-c4e2-4ef1-86eb-e7afac58836f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bdd6afa745f4e61a22c245b26f4a9f7, user_id=08eee738bab34f7a923a6c901a2faad0, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:34.581909 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e9823-c4e2-4ef1-86eb-e7afac58836f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:34.610594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 925/1854] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:34 2022] PUT /identity/v3/projects/9bdd6afa745f4e61a22c245b26f4a9f7/users/08eee738bab34f7a923a6c901a2faad0/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:34.614941 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d87c99-ed2f-4acd-b48c-377c3644b15e admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:34.631674 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d87c99-ed2f-4acd-b48c-377c3644b15e admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:34.761538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9640d2-0184-448b-8220-75a39fc113fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:34.762289 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9640d2-0184-448b-8220-75a39fc113fe admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:34.762643 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9640d2-0184-448b-8220-75a39fc113fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:34.763267 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9640d2-0184-448b-8220-75a39fc113fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:34.764120 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9640d2-0184-448b-8220-75a39fc113fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:34.766358 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9640d2-0184-448b-8220-75a39fc113fe admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:34.778479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 930/1855] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:34.783109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e9823-c4e2-4ef1-86eb-e7afac58836f admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:34.797488 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e9823-c4e2-4ef1-86eb-e7afac58836f admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:34.803716 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a40a5-cf80-4bfe-a57d-257b549b717a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:34.805785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a40a5-cf80-4bfe-a57d-257b549b717a admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:34.806367 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a40a5-cf80-4bfe-a57d-257b549b717a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:34.807695 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a40a5-cf80-4bfe-a57d-257b549b717a admin admin] PATH_INFO: `/v3/projects/9bdd6afa745f4e61a22c245b26f4a9f7/users/08eee738bab34f7a923a6c901a2faad0/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:34.811055 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a40a5-cf80-4bfe-a57d-257b549b717a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bdd6afa745f4e61a22c245b26f4a9f7, user_id=08eee738bab34f7a923a6c901a2faad0, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:34.814558 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a40a5-cf80-4bfe-a57d-257b549b717a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:34.820632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9640d2-0184-448b-8220-75a39fc113fe admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:34.823749 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-2f9640d2-0184-448b-8220-75a39fc113fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:34.833362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:34.869699 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 926/1856] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:34 2022] PUT /identity/v3/projects/9bdd6afa745f4e61a22c245b26f4a9f7/users/08eee738bab34f7a923a6c901a2faad0/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:42:34.877155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609155b-c7af-4c5c-8d4b-724a0d1de0d0 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:34.877544 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609155b-c7af-4c5c-8d4b-724a0d1de0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:34.878339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609155b-c7af-4c5c-8d4b-724a0d1de0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:34.911267 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9640d2-0184-448b-8220-75a39fc113fe admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:34.915262 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a609155b-c7af-4c5c-8d4b-724a0d1de0d0 None None] MFA Rules not processed for user `08eee738bab34f7a923a6c901a2faad0`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:34.917025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a609155b-c7af-4c5c-8d4b-724a0d1de0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:34.991649 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e3dc5-46c2-42b3-8d24-eaf57dc44417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:34.992434 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e3dc5-46c2-42b3-8d24-eaf57dc44417 service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:34.992811 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e3dc5-46c2-42b3-8d24-eaf57dc44417 service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:34.993309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e3dc5-46c2-42b3-8d24-eaf57dc44417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:34.995667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7c5e3dc5-46c2-42b3-8d24-eaf57dc44417 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:35.040831 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 927/1857] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:34 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:35.083059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e3dc5-46c2-42b3-8d24-eaf57dc44417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:35.084715 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e3dc5-46c2-42b3-8d24-eaf57dc44417 service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:35.097598 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 931/1858] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:35.286969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609155b-c7af-4c5c-8d4b-724a0d1de0d0 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:35.288765 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a609155b-c7af-4c5c-8d4b-724a0d1de0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:35.329832 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609155b-c7af-4c5c-8d4b-724a0d1de0d0 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:35.335839 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cd169-4978-4548-b6ca-01496308f4f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:35.336530 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cd169-4978-4548-b6ca-01496308f4f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:35.336834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cd169-4978-4548-b6ca-01496308f4f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:35.337200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6cd169-4978-4548-b6ca-01496308f4f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:35.350236 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:35.358751 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6cd169-4978-4548-b6ca-01496308f4f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:35.365332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6cd169-4978-4548-b6ca-01496308f4f7 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:35.392444 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 928/1859] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:35.605466 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e3dc5-46c2-42b3-8d24-eaf57dc44417 service cinder] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:35.620790 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e3dc5-46c2-42b3-8d24-eaf57dc44417 service cinder] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:35.625092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbbd6a-c090-46e0-8fea-f40b90c75c93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:35.626819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbbd6a-c090-46e0-8fea-f40b90c75c93 service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:35.627350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbbd6a-c090-46e0-8fea-f40b90c75c93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:35.628228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbbd6a-c090-46e0-8fea-f40b90c75c93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:35.725321 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbbd6a-c090-46e0-8fea-f40b90c75c93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:35.727729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fbbd6a-c090-46e0-8fea-f40b90c75c93 service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:35.745246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 932/1860] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:35 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:36.043158 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cd169-4978-4548-b6ca-01496308f4f7 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:36.052395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6cd169-4978-4548-b6ca-01496308f4f7 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:36.059250 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa821557-abd3-4a78-a699-c522417c6a44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:36.059892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa821557-abd3-4a78-a699-c522417c6a44 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:36.060176 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa821557-abd3-4a78-a699-c522417c6a44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:36.060453 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa821557-abd3-4a78-a699-c522417c6a44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:36.062246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-aa821557-abd3-4a78-a699-c522417c6a44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:36.127462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa821557-abd3-4a78-a699-c522417c6a44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:36.128901 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa821557-abd3-4a78-a699-c522417c6a44 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:36.138971 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 929/1861] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:43.663389 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbbd6a-c090-46e0-8fea-f40b90c75c93 service cinder] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:43.665049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-27fbbd6a-c090-46e0-8fea-f40b90c75c93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:43.686380 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:43.749214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbbd6a-c090-46e0-8fea-f40b90c75c93 service cinder] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:43.753839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cc3f5-fbbd-4c30-b02b-ab8944385962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:43.754774 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cc3f5-fbbd-4c30-b02b-ab8944385962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:43.755061 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cc3f5-fbbd-4c30-b02b-ab8944385962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:43.755342 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cc3f5-fbbd-4c30-b02b-ab8944385962 admin admin] PATH_INFO: `/v3/users/e8058628ac244e82a67c2fe2f0e30584` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:43.756538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cc3f5-fbbd-4c30-b02b-ab8944385962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8058628ac244e82a67c2fe2f0e30584)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:43.758514 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cc3f5-fbbd-4c30-b02b-ab8944385962 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:43.826991 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-510cc3f5-fbbd-4c30-b02b-ab8944385962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8058628ac244e82a67c2fe2f0e30584'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:43.827528 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-510cc3f5-fbbd-4c30-b02b-ab8944385962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8058628ac244e82a67c2fe2f0e30584'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:43.835621 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-510cc3f5-fbbd-4c30-b02b-ab8944385962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8058628ac244e82a67c2fe2f0e30584'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:43.843612 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-510cc3f5-fbbd-4c30-b02b-ab8944385962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8058628ac244e82a67c2fe2f0e30584'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:43.857642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-510cc3f5-fbbd-4c30-b02b-ab8944385962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8058628ac244e82a67c2fe2f0e30584'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:43.863878 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 933/1862] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:42:43 2022] DELETE /identity/v3/users/e8058628ac244e82a67c2fe2f0e30584 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:43.868421 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260f688-7c18-491c-a5a1-4c4547c14fa4 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:43.868896 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260f688-7c18-491c-a5a1-4c4547c14fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:43.868994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260f688-7c18-491c-a5a1-4c4547c14fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:43.889318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-5260f688-7c18-491c-a5a1-4c4547c14fa4 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:43.890834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5260f688-7c18-491c-a5a1-4c4547c14fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:43.995501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 930/1863] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:44.006849 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cc3f5-fbbd-4c30-b02b-ab8944385962 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:44.009359 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-510cc3f5-fbbd-4c30-b02b-ab8944385962 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:44.111760 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cc3f5-fbbd-4c30-b02b-ab8944385962 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:44.111760 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da82e40-229a-4194-98af-16d56da414ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:44.111760 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da82e40-229a-4194-98af-16d56da414ff service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:44.111760 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da82e40-229a-4194-98af-16d56da414ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:44.112110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da82e40-229a-4194-98af-16d56da414ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:44.118880 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da82e40-229a-4194-98af-16d56da414ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:44.121039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da82e40-229a-4194-98af-16d56da414ff service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:44.132959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 934/1864] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:42:44.560119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260f688-7c18-491c-a5a1-4c4547c14fa4 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:44.564324 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5260f688-7c18-491c-a5a1-4c4547c14fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:44.594184 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260f688-7c18-491c-a5a1-4c4547c14fa4 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:44.608813 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9704115-dd3e-40b5-ac55-685aa1dbf41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:44.611036 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9704115-dd3e-40b5-ac55-685aa1dbf41d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:44.611426 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9704115-dd3e-40b5-ac55-685aa1dbf41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:44.611874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9704115-dd3e-40b5-ac55-685aa1dbf41d admin admin] PATH_INFO: `/v3/projects/3015e83b511a4f65b3246ac7a7d73c45` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:44.617365 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9704115-dd3e-40b5-ac55-685aa1dbf41d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3015e83b511a4f65b3246ac7a7d73c45)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:44.619664 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9704115-dd3e-40b5-ac55-685aa1dbf41d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:44.723559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f9704115-dd3e-40b5-ac55-685aa1dbf41d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3015e83b511a4f65b3246ac7a7d73c45', 'request_id': 'req-f9704115-dd3e-40b5-ac55-685aa1dbf41d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:44.730514 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f9704115-dd3e-40b5-ac55-685aa1dbf41d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3015e83b511a4f65b3246ac7a7d73c45', 'request_id': 'req-f9704115-dd3e-40b5-ac55-685aa1dbf41d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:44.738723 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f9704115-dd3e-40b5-ac55-685aa1dbf41d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3015e83b511a4f65b3246ac7a7d73c45', 'request_id': 'req-f9704115-dd3e-40b5-ac55-685aa1dbf41d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:44.753537 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f9704115-dd3e-40b5-ac55-685aa1dbf41d admin admin] The token cache is being invalidate because project 3015e83b511a4f65b3246ac7a7d73c45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:42:44.753835 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f9704115-dd3e-40b5-ac55-685aa1dbf41d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:44.754499 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f9704115-dd3e-40b5-ac55-685aa1dbf41d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:44.756241 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 931/1865] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:42:44 2022] DELETE /identity/v3/projects/3015e83b511a4f65b3246ac7a7d73c45 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:44.760725 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da82e40-229a-4194-98af-16d56da414ff service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:44.770592 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da82e40-229a-4194-98af-16d56da414ff service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:44.805031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:44.842729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356479e1-8451-4901-8fe4-175f410871d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:44.843972 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356479e1-8451-4901-8fe4-175f410871d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:44.843972 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356479e1-8451-4901-8fe4-175f410871d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:44.844222 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356479e1-8451-4901-8fe4-175f410871d4 admin admin] PATH_INFO: `/v3/users/ee6676137671480b9e5904daee3f2ff1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:44.845356 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356479e1-8451-4901-8fe4-175f410871d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee6676137671480b9e5904daee3f2ff1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:44.847296 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356479e1-8451-4901-8fe4-175f410871d4 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:44.936169 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-356479e1-8451-4901-8fe4-175f410871d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee6676137671480b9e5904daee3f2ff1'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:44.937206 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-356479e1-8451-4901-8fe4-175f410871d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee6676137671480b9e5904daee3f2ff1'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:44.950025 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-356479e1-8451-4901-8fe4-175f410871d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee6676137671480b9e5904daee3f2ff1'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:44.959065 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-356479e1-8451-4901-8fe4-175f410871d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee6676137671480b9e5904daee3f2ff1'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:44.973404 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-356479e1-8451-4901-8fe4-175f410871d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee6676137671480b9e5904daee3f2ff1'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:44.982461 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 935/1866] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:42:44 2022] DELETE /identity/v3/users/ee6676137671480b9e5904daee3f2ff1 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:45.361167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9704115-dd3e-40b5-ac55-685aa1dbf41d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:45.364634 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f9704115-dd3e-40b5-ac55-685aa1dbf41d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:45.402887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9704115-dd3e-40b5-ac55-685aa1dbf41d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:45.412271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:45.490569 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff9b0d-6988-45be-a661-7a0928426f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:45.493499 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff9b0d-6988-45be-a661-7a0928426f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:45.494996 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff9b0d-6988-45be-a661-7a0928426f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:45.495466 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff9b0d-6988-45be-a661-7a0928426f38 admin admin] PATH_INFO: `/v3/projects/fe70b42ef3fe4e95af7c9143fcaa630b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:45.496790 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff9b0d-6988-45be-a661-7a0928426f38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe70b42ef3fe4e95af7c9143fcaa630b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:45.498927 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff9b0d-6988-45be-a661-7a0928426f38 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:45.557572 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-18ff9b0d-6988-45be-a661-7a0928426f38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe70b42ef3fe4e95af7c9143fcaa630b', 'request_id': 'req-18ff9b0d-6988-45be-a661-7a0928426f38'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:45.563868 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-18ff9b0d-6988-45be-a661-7a0928426f38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe70b42ef3fe4e95af7c9143fcaa630b', 'request_id': 'req-18ff9b0d-6988-45be-a661-7a0928426f38'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:45.571412 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-18ff9b0d-6988-45be-a661-7a0928426f38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe70b42ef3fe4e95af7c9143fcaa630b', 'request_id': 'req-18ff9b0d-6988-45be-a661-7a0928426f38'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:45.583854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-18ff9b0d-6988-45be-a661-7a0928426f38 admin admin] The token cache is being invalidate because project fe70b42ef3fe4e95af7c9143fcaa630b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:42:45.584151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-18ff9b0d-6988-45be-a661-7a0928426f38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:45.584937 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-18ff9b0d-6988-45be-a661-7a0928426f38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:45.586380 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 932/1867] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:42:45 2022] DELETE /identity/v3/projects/fe70b42ef3fe4e95af7c9143fcaa630b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:45.590347 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356479e1-8451-4901-8fe4-175f410871d4 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:45.591819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-356479e1-8451-4901-8fe4-175f410871d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:45.606059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356479e1-8451-4901-8fe4-175f410871d4 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:45.669135 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce3008-b331-47c9-8b04-078a19370452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:45.670106 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce3008-b331-47c9-8b04-078a19370452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:45.670484 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce3008-b331-47c9-8b04-078a19370452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:45.670731 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce3008-b331-47c9-8b04-078a19370452 admin admin] PATH_INFO: `/v3/users/80825e4c3e874f06a5e34d85f31bd3ab` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:45.672059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce3008-b331-47c9-8b04-078a19370452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80825e4c3e874f06a5e34d85f31bd3ab)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:45.674080 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce3008-b331-47c9-8b04-078a19370452 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:45.740618 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-58ce3008-b331-47c9-8b04-078a19370452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80825e4c3e874f06a5e34d85f31bd3ab'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:45.741730 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-58ce3008-b331-47c9-8b04-078a19370452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80825e4c3e874f06a5e34d85f31bd3ab'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:45.763852 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-58ce3008-b331-47c9-8b04-078a19370452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80825e4c3e874f06a5e34d85f31bd3ab'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:45.766403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:45.773579 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-58ce3008-b331-47c9-8b04-078a19370452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80825e4c3e874f06a5e34d85f31bd3ab'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:45.792608 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-58ce3008-b331-47c9-8b04-078a19370452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80825e4c3e874f06a5e34d85f31bd3ab'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:45.803368 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 936/1868] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:42:45 2022] DELETE /identity/v3/users/80825e4c3e874f06a5e34d85f31bd3ab => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:46.120757 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff9b0d-6988-45be-a661-7a0928426f38 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:46.122302 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-18ff9b0d-6988-45be-a661-7a0928426f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:46.146308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff9b0d-6988-45be-a661-7a0928426f38 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:46.209976 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72dfdde-7f42-4419-be49-c0a92a7fa117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:46.210755 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dfdde-7f42-4419-be49-c0a92a7fa117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:46.211039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dfdde-7f42-4419-be49-c0a92a7fa117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:46.211308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72dfdde-7f42-4419-be49-c0a92a7fa117 admin admin] PATH_INFO: `/v3/projects/575b434e5e14435aa0dfc4c8c410871c` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:46.212544 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72dfdde-7f42-4419-be49-c0a92a7fa117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=575b434e5e14435aa0dfc4c8c410871c)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:46.214511 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72dfdde-7f42-4419-be49-c0a92a7fa117 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:46.258554 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:46.260815 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c72dfdde-7f42-4419-be49-c0a92a7fa117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '575b434e5e14435aa0dfc4c8c410871c', 'request_id': 'req-c72dfdde-7f42-4419-be49-c0a92a7fa117'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:46.267564 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c72dfdde-7f42-4419-be49-c0a92a7fa117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '575b434e5e14435aa0dfc4c8c410871c', 'request_id': 'req-c72dfdde-7f42-4419-be49-c0a92a7fa117'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:46.275204 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c72dfdde-7f42-4419-be49-c0a92a7fa117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '575b434e5e14435aa0dfc4c8c410871c', 'request_id': 'req-c72dfdde-7f42-4419-be49-c0a92a7fa117'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:46.287242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c72dfdde-7f42-4419-be49-c0a92a7fa117 admin admin] The token cache is being invalidate because project 575b434e5e14435aa0dfc4c8c410871c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:42:46.287530 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c72dfdde-7f42-4419-be49-c0a92a7fa117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:46.288169 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c72dfdde-7f42-4419-be49-c0a92a7fa117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:46.289767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 933/1869] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:42:46 2022] DELETE /identity/v3/projects/575b434e5e14435aa0dfc4c8c410871c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:46.295766 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0befd8-439c-4f8a-9315-78a53107cc68 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:46.296054 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0befd8-439c-4f8a-9315-78a53107cc68 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:46.296332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0befd8-439c-4f8a-9315-78a53107cc68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:46.315021 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-ad0befd8-439c-4f8a-9315-78a53107cc68 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:46.316234 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-ad0befd8-439c-4f8a-9315-78a53107cc68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:46.379067 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 937/1870] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:42:46.387636 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa6cb6-b404-4a16-b84b-df9c81a719cb None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:46.388143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa6cb6-b404-4a16-b84b-df9c81a719cb None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:46.388236 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa6cb6-b404-4a16-b84b-df9c81a719cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:46.407651 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f5aa6cb6-b404-4a16-b84b-df9c81a719cb None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:46.408865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f5aa6cb6-b404-4a16-b84b-df9c81a719cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:46.417465 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 934/1871] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:46.422029 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0befd8-439c-4f8a-9315-78a53107cc68 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:46.435122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0befd8-439c-4f8a-9315-78a53107cc68 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:46.440141 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e11382-491e-4daf-a5c2-b60203f30209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:46.440811 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e11382-491e-4daf-a5c2-b60203f30209 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:46.441096 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e11382-491e-4daf-a5c2-b60203f30209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:46.441564 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e11382-491e-4daf-a5c2-b60203f30209 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:46.442225 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e11382-491e-4daf-a5c2-b60203f30209 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:42:46.442521 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e11382-491e-4daf-a5c2-b60203f30209 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:46.444164 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e11382-491e-4daf-a5c2-b60203f30209 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:46.457279 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 938/1872] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:42:46.461734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa6cb6-b404-4a16-b84b-df9c81a719cb None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:46.472307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa6cb6-b404-4a16-b84b-df9c81a719cb None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:46.484994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d1bec-2c9c-48dd-9a52-6d3091c3c2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:46.485747 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d1bec-2c9c-48dd-9a52-6d3091c3c2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:46.486038 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d1bec-2c9c-48dd-9a52-6d3091c3c2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:46.486319 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d1bec-2c9c-48dd-9a52-6d3091c3c2d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:46.487028 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d1bec-2c9c-48dd-9a52-6d3091c3c2d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:46.489088 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d1bec-2c9c-48dd-9a52-6d3091c3c2d0 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:46.521501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 935/1873] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:46 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:46.524120 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e11382-491e-4daf-a5c2-b60203f30209 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:46.535395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e11382-491e-4daf-a5c2-b60203f30209 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:46.616764 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632190e1-9117-4085-9fd1-cd59e7187b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:46.617495 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632190e1-9117-4085-9fd1-cd59e7187b01 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:46.617791 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632190e1-9117-4085-9fd1-cd59e7187b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:46.618076 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632190e1-9117-4085-9fd1-cd59e7187b01 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:46.618789 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632190e1-9117-4085-9fd1-cd59e7187b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:46.620806 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632190e1-9117-4085-9fd1-cd59e7187b01 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:46.653958 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 939/1874] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:46 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:46.660054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d1bec-2c9c-48dd-9a52-6d3091c3c2d0 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:46.689640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d1bec-2c9c-48dd-9a52-6d3091c3c2d0 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:46.710053 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632190e1-9117-4085-9fd1-cd59e7187b01 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:46.712226 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-632190e1-9117-4085-9fd1-cd59e7187b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:46.716793 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff5788-0a7d-414f-9640-693a9d20a0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:46.718067 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff5788-0a7d-414f-9640-693a9d20a0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:46.718365 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff5788-0a7d-414f-9640-693a9d20a0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:46.718648 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff5788-0a7d-414f-9640-693a9d20a0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:46.719402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff5788-0a7d-414f-9640-693a9d20a0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:46.721025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff5788-0a7d-414f-9640-693a9d20a0a3 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:46.725666 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632190e1-9117-4085-9fd1-cd59e7187b01 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:46.730726 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594e9ef-b7da-45c9-8dbd-545f0d31e95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:46.731620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594e9ef-b7da-45c9-8dbd-545f0d31e95a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:46.732098 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594e9ef-b7da-45c9-8dbd-545f0d31e95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:46.732389 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594e9ef-b7da-45c9-8dbd-545f0d31e95a admin admin] PATH_INFO: `/v3/users/291a9a734dfd45c0b37a02aab1f25b4d` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:46.733665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594e9ef-b7da-45c9-8dbd-545f0d31e95a admin admin] RBAC: Authorizing `identity:delete_user(user_id=291a9a734dfd45c0b37a02aab1f25b4d)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:46.735595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594e9ef-b7da-45c9-8dbd-545f0d31e95a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:46.738532 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 936/1875] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:42:46.739716 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff5788-0a7d-414f-9640-693a9d20a0a3 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:46.753520 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff5788-0a7d-414f-9640-693a9d20a0a3 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:46.758554 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a51aa-d57b-4e7c-addd-2f0521f9cd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:46.759069 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a51aa-d57b-4e7c-addd-2f0521f9cd04 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:46.759400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a51aa-d57b-4e7c-addd-2f0521f9cd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:46.759936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a51aa-d57b-4e7c-addd-2f0521f9cd04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:46.760918 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a51aa-d57b-4e7c-addd-2f0521f9cd04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:46.762431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55a51aa-d57b-4e7c-addd-2f0521f9cd04 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:46.783716 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 937/1876] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:46.784583 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a51aa-d57b-4e7c-addd-2f0521f9cd04 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:46.806763 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a51aa-d57b-4e7c-addd-2f0521f9cd04 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:46.815775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c65073-0f90-4a6a-817f-60d3cb273753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:46.816683 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c65073-0f90-4a6a-817f-60d3cb273753 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:46.817822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c65073-0f90-4a6a-817f-60d3cb273753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:46.818109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c65073-0f90-4a6a-817f-60d3cb273753 admin admin] PATH_INFO: `/v3/projects/002317b3056246b0b003d9b3762c41eb/users/1b8d1506bd0c47de8dbd4a07fd852f8f/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:46.849194 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:46.852129 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6594e9ef-b7da-45c9-8dbd-545f0d31e95a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '291a9a734dfd45c0b37a02aab1f25b4d'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:46.852928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6594e9ef-b7da-45c9-8dbd-545f0d31e95a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '291a9a734dfd45c0b37a02aab1f25b4d'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:46.859362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c65073-0f90-4a6a-817f-60d3cb273753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=002317b3056246b0b003d9b3762c41eb, user_id=1b8d1506bd0c47de8dbd4a07fd852f8f, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:46.862661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c65073-0f90-4a6a-817f-60d3cb273753 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:46.870176 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6594e9ef-b7da-45c9-8dbd-545f0d31e95a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '291a9a734dfd45c0b37a02aab1f25b4d'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:46.881394 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6594e9ef-b7da-45c9-8dbd-545f0d31e95a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '291a9a734dfd45c0b37a02aab1f25b4d'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:46.895721 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 938/1877] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:46 2022] PUT /identity/v3/projects/002317b3056246b0b003d9b3762c41eb/users/1b8d1506bd0c47de8dbd4a07fd852f8f/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:46.908877 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472292f-2c41-4bf9-95fc-a96c2f3ebd76 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:46.910777 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472292f-2c41-4bf9-95fc-a96c2f3ebd76 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:46.911782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472292f-2c41-4bf9-95fc-a96c2f3ebd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:46.923970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6594e9ef-b7da-45c9-8dbd-545f0d31e95a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '291a9a734dfd45c0b37a02aab1f25b4d'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:46.940671 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 940/1878] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:42:46 2022] DELETE /identity/v3/users/291a9a734dfd45c0b37a02aab1f25b4d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:46.944969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b32b3-f63e-4d9f-8acc-46209c00aa39 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:46.946297 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b32b3-f63e-4d9f-8acc-46209c00aa39 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:46.946728 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b32b3-f63e-4d9f-8acc-46209c00aa39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:46.966063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-8472292f-2c41-4bf9-95fc-a96c2f3ebd76 None None] MFA Rules not processed for user `1b8d1506bd0c47de8dbd4a07fd852f8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:46.967550 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8472292f-2c41-4bf9-95fc-a96c2f3ebd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:46.986752 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-058b32b3-f63e-4d9f-8acc-46209c00aa39 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:46.988118 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-058b32b3-f63e-4d9f-8acc-46209c00aa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:47.077503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 939/1879] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:47.078618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472292f-2c41-4bf9-95fc-a96c2f3ebd76 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:47.080012 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8472292f-2c41-4bf9-95fc-a96c2f3ebd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:47.124105 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 941/1880] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:47.144170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b32b3-f63e-4d9f-8acc-46209c00aa39 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:47.148669 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-058b32b3-f63e-4d9f-8acc-46209c00aa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:47.169464 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:47.209014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472292f-2c41-4bf9-95fc-a96c2f3ebd76 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:47.214444 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075db80-b680-4c51-ba21-3dc65b313d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:47.215316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075db80-b680-4c51-ba21-3dc65b313d87 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:47.216827 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075db80-b680-4c51-ba21-3dc65b313d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:47.218998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075db80-b680-4c51-ba21-3dc65b313d87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:47.218998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075db80-b680-4c51-ba21-3dc65b313d87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:47.220620 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075db80-b680-4c51-ba21-3dc65b313d87 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:47.261704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 940/1881] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:47 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:47.262685 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075db80-b680-4c51-ba21-3dc65b313d87 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:47.263328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b32b3-f63e-4d9f-8acc-46209c00aa39 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:47.355278 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075db80-b680-4c51-ba21-3dc65b313d87 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:47.357929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a36a72-3034-4c9b-82cd-b0dd1397fbf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:47.358844 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a36a72-3034-4c9b-82cd-b0dd1397fbf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:47.359317 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a36a72-3034-4c9b-82cd-b0dd1397fbf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:47.359761 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a36a72-3034-4c9b-82cd-b0dd1397fbf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:47.361690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531d450-2515-407e-b094-2fcf186e5369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:47.362857 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531d450-2515-407e-b094-2fcf186e5369 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:47.363294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531d450-2515-407e-b094-2fcf186e5369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:47.363744 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531d450-2515-407e-b094-2fcf186e5369 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:47.364757 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531d450-2515-407e-b094-2fcf186e5369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:47.366881 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3531d450-2515-407e-b094-2fcf186e5369 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:47.371290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a36a72-3034-4c9b-82cd-b0dd1397fbf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:47.372734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a36a72-3034-4c9b-82cd-b0dd1397fbf2 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:47.385770 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 942/1882] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:42:47.397773 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 941/1883] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:47 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:47.402456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a36a72-3034-4c9b-82cd-b0dd1397fbf2 service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:47.414007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a36a72-3034-4c9b-82cd-b0dd1397fbf2 service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:47.418933 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a38cf-5346-4c33-bc34-5984e31b576c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:47.419608 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a38cf-5346-4c33-bc34-5984e31b576c admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:47.419895 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a38cf-5346-4c33-bc34-5984e31b576c admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:47.420176 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a38cf-5346-4c33-bc34-5984e31b576c admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:47.420906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a38cf-5346-4c33-bc34-5984e31b576c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:47.422553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a38cf-5346-4c33-bc34-5984e31b576c admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:47.437747 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 943/1884] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:47.439113 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531d450-2515-407e-b094-2fcf186e5369 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:47.455623 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531d450-2515-407e-b094-2fcf186e5369 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:47.462332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65841c-293b-4567-bd68-df57f1ab3dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:47.464342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65841c-293b-4567-bd68-df57f1ab3dac admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:47.464980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65841c-293b-4567-bd68-df57f1ab3dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:47.465500 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65841c-293b-4567-bd68-df57f1ab3dac admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:47.466551 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65841c-293b-4567-bd68-df57f1ab3dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:47.469318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65841c-293b-4567-bd68-df57f1ab3dac admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:47.495994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 942/1885] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:47.500142 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a38cf-5346-4c33-bc34-5984e31b576c admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:47.510523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a38cf-5346-4c33-bc34-5984e31b576c admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:47.515290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac1df4-6fba-4553-86ec-842419a25a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:47.516182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac1df4-6fba-4553-86ec-842419a25a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:47.516470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac1df4-6fba-4553-86ec-842419a25a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:47.516747 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac1df4-6fba-4553-86ec-842419a25a5a admin admin] PATH_INFO: `/v3/projects/f9e8477bcde84672870a89b2cea8888a/users/7df599086e394ae4a7b18f8529071a86/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:47.526492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:47.535058 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac1df4-6fba-4553-86ec-842419a25a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e8477bcde84672870a89b2cea8888a, user_id=7df599086e394ae4a7b18f8529071a86, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:47.538132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac1df4-6fba-4553-86ec-842419a25a5a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:47.553129 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 944/1886] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:47 2022] PUT /identity/v3/projects/f9e8477bcde84672870a89b2cea8888a/users/7df599086e394ae4a7b18f8529071a86/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:47.564037 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e529aa-bd58-45a7-986f-b9eef44712f2 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:47.564347 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e529aa-bd58-45a7-986f-b9eef44712f2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:47.564627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e529aa-bd58-45a7-986f-b9eef44712f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:47.591781 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-62e529aa-bd58-45a7-986f-b9eef44712f2 None None] MFA Rules not processed for user `7df599086e394ae4a7b18f8529071a86`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:47.593282 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-62e529aa-bd58-45a7-986f-b9eef44712f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:47.669588 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 943/1887] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:47.674135 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac1df4-6fba-4553-86ec-842419a25a5a admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:47.741309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac1df4-6fba-4553-86ec-842419a25a5a admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:47.746858 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfffc96-17c4-4277-97d2-12b34592e1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:47.747530 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfffc96-17c4-4277-97d2-12b34592e1d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:47.747819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfffc96-17c4-4277-97d2-12b34592e1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:47.748104 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfffc96-17c4-4277-97d2-12b34592e1d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:47.748805 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfffc96-17c4-4277-97d2-12b34592e1d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:47.750753 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfffc96-17c4-4277-97d2-12b34592e1d0 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:47.777269 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 945/1888] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:47 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:47.782076 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e529aa-bd58-45a7-986f-b9eef44712f2 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:47.795131 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e529aa-bd58-45a7-986f-b9eef44712f2 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:47.851859 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:47.879991 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477cded-2080-4804-8d03-1583bd1a5119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:47.880900 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477cded-2080-4804-8d03-1583bd1a5119 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:47.881191 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477cded-2080-4804-8d03-1583bd1a5119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:47.881702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477cded-2080-4804-8d03-1583bd1a5119 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:47.883685 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477cded-2080-4804-8d03-1583bd1a5119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:47.884511 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477cded-2080-4804-8d03-1583bd1a5119 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:47.919746 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 944/1889] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:47 2022] POST /identity/v3/users => generated 298 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:42:47.921098 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfffc96-17c4-4277-97d2-12b34592e1d0 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:47.940322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfffc96-17c4-4277-97d2-12b34592e1d0 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:47.950478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20972e-79b0-4f19-9e99-3883b84f229e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:47.951213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20972e-79b0-4f19-9e99-3883b84f229e admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:47.951507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20972e-79b0-4f19-9e99-3883b84f229e admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:47.951791 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d20972e-79b0-4f19-9e99-3883b84f229e admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:47.952547 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20972e-79b0-4f19-9e99-3883b84f229e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:47.954273 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d20972e-79b0-4f19-9e99-3883b84f229e admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:47.980510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 946/1890] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:47.985127 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477cded-2080-4804-8d03-1583bd1a5119 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:48.002340 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477cded-2080-4804-8d03-1583bd1a5119 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:48.012745 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57bd1f-1444-4d9b-aa4a-967cc9629e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:48.014559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57bd1f-1444-4d9b-aa4a-967cc9629e2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:48.014959 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57bd1f-1444-4d9b-aa4a-967cc9629e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:48.015477 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d57bd1f-1444-4d9b-aa4a-967cc9629e2e admin admin] PATH_INFO: `/v3/projects/d32a601e205a4b2a9de9c9ebefffdbe7/users/04ff1c53d52447f8af1f2662a0477382/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:48.039591 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57bd1f-1444-4d9b-aa4a-967cc9629e2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32a601e205a4b2a9de9c9ebefffdbe7, user_id=04ff1c53d52447f8af1f2662a0477382, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:48.044834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d57bd1f-1444-4d9b-aa4a-967cc9629e2e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:48.087836 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 945/1891] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:47 2022] PUT /identity/v3/projects/d32a601e205a4b2a9de9c9ebefffdbe7/users/04ff1c53d52447f8af1f2662a0477382/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:48.092185 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20972e-79b0-4f19-9e99-3883b84f229e admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:48.109127 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d20972e-79b0-4f19-9e99-3883b84f229e admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:48.209224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb7dd5-7db2-42e0-b405-950b016f4520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:48.210696 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb7dd5-7db2-42e0-b405-950b016f4520 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:48.211067 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb7dd5-7db2-42e0-b405-950b016f4520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:48.211425 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb7dd5-7db2-42e0-b405-950b016f4520 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:48.213463 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb7dd5-7db2-42e0-b405-950b016f4520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:48.215529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb7dd5-7db2-42e0-b405-950b016f4520 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:48.231597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 947/1892] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:48.235498 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57bd1f-1444-4d9b-aa4a-967cc9629e2e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:48.252406 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d57bd1f-1444-4d9b-aa4a-967cc9629e2e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:48.258833 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aea326-00bf-43c5-afad-2af5c317fb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:48.270752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aea326-00bf-43c5-afad-2af5c317fb2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:48.271196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aea326-00bf-43c5-afad-2af5c317fb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:48.272269 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aea326-00bf-43c5-afad-2af5c317fb2c admin admin] PATH_INFO: `/v3/projects/d32a601e205a4b2a9de9c9ebefffdbe7/users/04ff1c53d52447f8af1f2662a0477382/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:48.276812 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aea326-00bf-43c5-afad-2af5c317fb2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32a601e205a4b2a9de9c9ebefffdbe7, user_id=04ff1c53d52447f8af1f2662a0477382, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:48.281397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aea326-00bf-43c5-afad-2af5c317fb2c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:48.294900 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 946/1893] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:48 2022] PUT /identity/v3/projects/d32a601e205a4b2a9de9c9ebefffdbe7/users/04ff1c53d52447f8af1f2662a0477382/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:48.306523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa80d4a-1247-49c4-ac11-3046f93621be None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:48.306833 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa80d4a-1247-49c4-ac11-3046f93621be None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:48.307277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa80d4a-1247-49c4-ac11-3046f93621be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:48.352310 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-caa80d4a-1247-49c4-ac11-3046f93621be None None] MFA Rules not processed for user `04ff1c53d52447f8af1f2662a0477382`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:48.354567 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-caa80d4a-1247-49c4-ac11-3046f93621be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:48.432885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:48.475629 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 948/1894] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:48.489547 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aea326-00bf-43c5-afad-2af5c317fb2c admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:48.491516 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e3aea326-00bf-43c5-afad-2af5c317fb2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:48.595376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aea326-00bf-43c5-afad-2af5c317fb2c admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:48.606823 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b7118-ca09-4d2b-a13c-19d2d48c9e4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:48.607503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b7118-ca09-4d2b-a13c-19d2d48c9e4f service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:48.607791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b7118-ca09-4d2b-a13c-19d2d48c9e4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:48.609419 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b7118-ca09-4d2b-a13c-19d2d48c9e4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:48.698385 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa80d4a-1247-49c4-ac11-3046f93621be None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:48.700602 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-caa80d4a-1247-49c4-ac11-3046f93621be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:48.716270 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b7118-ca09-4d2b-a13c-19d2d48c9e4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:48.718434 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b7118-ca09-4d2b-a13c-19d2d48c9e4f service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:48.754325 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 947/1895] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:48.852993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa80d4a-1247-49c4-ac11-3046f93621be None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:48.859641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d83d0-2f2b-4c18-85f9-2b61c17a8460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:48.860548 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d83d0-2f2b-4c18-85f9-2b61c17a8460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:48.860920 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d83d0-2f2b-4c18-85f9-2b61c17a8460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:48.861104 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d83d0-2f2b-4c18-85f9-2b61c17a8460 admin admin] PATH_INFO: `/v3/projects/6ead542517674682b8520c3238c6a4cf` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:48.862364 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d83d0-2f2b-4c18-85f9-2b61c17a8460 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ead542517674682b8520c3238c6a4cf)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:48.864711 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d83d0-2f2b-4c18-85f9-2b61c17a8460 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:48.961143 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-c40d83d0-2f2b-4c18-85f9-2b61c17a8460 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ead542517674682b8520c3238c6a4cf', 'request_id': 'req-c40d83d0-2f2b-4c18-85f9-2b61c17a8460'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:48.969307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-c40d83d0-2f2b-4c18-85f9-2b61c17a8460 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ead542517674682b8520c3238c6a4cf', 'request_id': 'req-c40d83d0-2f2b-4c18-85f9-2b61c17a8460'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:48.979803 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-c40d83d0-2f2b-4c18-85f9-2b61c17a8460 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ead542517674682b8520c3238c6a4cf', 'request_id': 'req-c40d83d0-2f2b-4c18-85f9-2b61c17a8460'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:48.992879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-c40d83d0-2f2b-4c18-85f9-2b61c17a8460 admin admin] The token cache is being invalidate because project 6ead542517674682b8520c3238c6a4cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:42:48.993200 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-c40d83d0-2f2b-4c18-85f9-2b61c17a8460 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:48.994383 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-c40d83d0-2f2b-4c18-85f9-2b61c17a8460 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:48.996281 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 949/1896] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:42:48 2022] DELETE /identity/v3/projects/6ead542517674682b8520c3238c6a4cf => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:49.001601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b7118-ca09-4d2b-a13c-19d2d48c9e4f service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:49.019076 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b7118-ca09-4d2b-a13c-19d2d48c9e4f service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:49.088280 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:49.112374 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9acd1b-d7af-4363-b675-1e5b838c016a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:49.114267 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9acd1b-d7af-4363-b675-1e5b838c016a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:49.114548 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9acd1b-d7af-4363-b675-1e5b838c016a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:49.114933 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9acd1b-d7af-4363-b675-1e5b838c016a admin admin] PATH_INFO: `/v3/users/08eee738bab34f7a923a6c901a2faad0` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:49.116447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9acd1b-d7af-4363-b675-1e5b838c016a admin admin] RBAC: Authorizing `identity:delete_user(user_id=08eee738bab34f7a923a6c901a2faad0)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:49.121179 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9acd1b-d7af-4363-b675-1e5b838c016a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:49.226269 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-1f9acd1b-d7af-4363-b675-1e5b838c016a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08eee738bab34f7a923a6c901a2faad0'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:49.226951 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-1f9acd1b-d7af-4363-b675-1e5b838c016a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08eee738bab34f7a923a6c901a2faad0'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:49.234853 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-1f9acd1b-d7af-4363-b675-1e5b838c016a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08eee738bab34f7a923a6c901a2faad0'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:49.242176 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-1f9acd1b-d7af-4363-b675-1e5b838c016a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08eee738bab34f7a923a6c901a2faad0'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:49.255097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-1f9acd1b-d7af-4363-b675-1e5b838c016a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08eee738bab34f7a923a6c901a2faad0'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:49.261808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 948/1897] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:42:48 2022] DELETE /identity/v3/users/08eee738bab34f7a923a6c901a2faad0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:49.583887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d83d0-2f2b-4c18-85f9-2b61c17a8460 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:49.586537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c40d83d0-2f2b-4c18-85f9-2b61c17a8460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:49.612226 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d83d0-2f2b-4c18-85f9-2b61c17a8460 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:49.722908 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45298c51-6e78-46e5-a65f-cbd2b204b31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:49.724510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45298c51-6e78-46e5-a65f-cbd2b204b31f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:49.725193 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45298c51-6e78-46e5-a65f-cbd2b204b31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:49.725898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45298c51-6e78-46e5-a65f-cbd2b204b31f admin admin] PATH_INFO: `/v3/projects/9bdd6afa745f4e61a22c245b26f4a9f7` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:49.727218 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45298c51-6e78-46e5-a65f-cbd2b204b31f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bdd6afa745f4e61a22c245b26f4a9f7)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:49.730758 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45298c51-6e78-46e5-a65f-cbd2b204b31f admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:49.768385 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:49.866848 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-45298c51-6e78-46e5-a65f-cbd2b204b31f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bdd6afa745f4e61a22c245b26f4a9f7', 'request_id': 'req-45298c51-6e78-46e5-a65f-cbd2b204b31f'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:49.874998 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-45298c51-6e78-46e5-a65f-cbd2b204b31f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bdd6afa745f4e61a22c245b26f4a9f7', 'request_id': 'req-45298c51-6e78-46e5-a65f-cbd2b204b31f'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:49.889418 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-45298c51-6e78-46e5-a65f-cbd2b204b31f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bdd6afa745f4e61a22c245b26f4a9f7', 'request_id': 'req-45298c51-6e78-46e5-a65f-cbd2b204b31f'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:49.921407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-45298c51-6e78-46e5-a65f-cbd2b204b31f admin admin] The token cache is being invalidate because project 9bdd6afa745f4e61a22c245b26f4a9f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:42:49.922028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-45298c51-6e78-46e5-a65f-cbd2b204b31f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:49.922875 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-45298c51-6e78-46e5-a65f-cbd2b204b31f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:49.925751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 950/1898] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:42:49 2022] DELETE /identity/v3/projects/9bdd6afa745f4e61a22c245b26f4a9f7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:49.932000 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490d937-78b6-4e91-b025-bf053ab37515 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:49.932520 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490d937-78b6-4e91-b025-bf053ab37515 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:49.932802 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490d937-78b6-4e91-b025-bf053ab37515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:49.983015 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0490d937-78b6-4e91-b025-bf053ab37515 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:49.984262 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0490d937-78b6-4e91-b025-bf053ab37515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:50.095100 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 949/1899] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:50.102544 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966e5f5-c9e6-462a-9cd7-f208d737f050 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:50.103532 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966e5f5-c9e6-462a-9cd7-f208d737f050 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:50.103816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966e5f5-c9e6-462a-9cd7-f208d737f050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:50.124091 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-2966e5f5-c9e6-462a-9cd7-f208d737f050 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:50.125319 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-2966e5f5-c9e6-462a-9cd7-f208d737f050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:50.133358 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 951/1900] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:50.137711 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490d937-78b6-4e91-b025-bf053ab37515 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:50.148866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490d937-78b6-4e91-b025-bf053ab37515 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:50.154795 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fbe8b-a51c-4801-80a0-57710d673a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:50.155483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fbe8b-a51c-4801-80a0-57710d673a72 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:50.155836 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fbe8b-a51c-4801-80a0-57710d673a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:50.156300 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fbe8b-a51c-4801-80a0-57710d673a72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:50.157221 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fbe8b-a51c-4801-80a0-57710d673a72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:42:50.158177 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fbe8b-a51c-4801-80a0-57710d673a72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:50.159489 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fbe8b-a51c-4801-80a0-57710d673a72 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:50.179513 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 950/1901] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:42:50.184576 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966e5f5-c9e6-462a-9cd7-f208d737f050 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:50.200099 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966e5f5-c9e6-462a-9cd7-f208d737f050 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:50.207035 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2d969-350d-403a-a8f9-9e776ea68fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:50.207796 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2d969-350d-403a-a8f9-9e776ea68fc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:50.208152 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2d969-350d-403a-a8f9-9e776ea68fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:50.208503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2d969-350d-403a-a8f9-9e776ea68fc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:50.209646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2d969-350d-403a-a8f9-9e776ea68fc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:50.212601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2d969-350d-403a-a8f9-9e776ea68fc5 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:50.255869 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 952/1902] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:50 2022] POST /identity/v3/projects => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:50.265779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fbe8b-a51c-4801-80a0-57710d673a72 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:50.278533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fbe8b-a51c-4801-80a0-57710d673a72 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:50.369588 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:50.371463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5def6f5-5739-49b6-b2fb-8c8caec2f0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:50.372163 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5def6f5-5739-49b6-b2fb-8c8caec2f0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:50.372678 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5def6f5-5739-49b6-b2fb-8c8caec2f0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:50.372963 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5def6f5-5739-49b6-b2fb-8c8caec2f0b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:50.373753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5def6f5-5739-49b6-b2fb-8c8caec2f0b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:50.375710 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5def6f5-5739-49b6-b2fb-8c8caec2f0b6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:50.407132 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 951/1903] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:50 2022] POST /identity/v3/users => generated 284 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:50.407221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2d969-350d-403a-a8f9-9e776ea68fc5 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:50.424843 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2d969-350d-403a-a8f9-9e776ea68fc5 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:50.432361 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358a49d-e4ef-4dec-ab11-907870f923f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:50.433228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358a49d-e4ef-4dec-ab11-907870f923f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:50.433683 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358a49d-e4ef-4dec-ab11-907870f923f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:50.434125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358a49d-e4ef-4dec-ab11-907870f923f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:50.442221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358a49d-e4ef-4dec-ab11-907870f923f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:50.442400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5def6f5-5739-49b6-b2fb-8c8caec2f0b6 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:50.444054 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358a49d-e4ef-4dec-ab11-907870f923f0 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:50.444238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b5def6f5-5739-49b6-b2fb-8c8caec2f0b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:50.461505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 953/1904] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:50.465736 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358a49d-e4ef-4dec-ab11-907870f923f0 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:50.482754 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358a49d-e4ef-4dec-ab11-907870f923f0 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:50.488315 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f90105-6f17-497c-992d-4082ef9c05f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:50.489705 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f90105-6f17-497c-992d-4082ef9c05f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:50.489994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f90105-6f17-497c-992d-4082ef9c05f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:50.490278 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f90105-6f17-497c-992d-4082ef9c05f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:50.491165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f90105-6f17-497c-992d-4082ef9c05f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:50.492925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f90105-6f17-497c-992d-4082ef9c05f3 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:50.508706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 954/1905] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:50.513646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f90105-6f17-497c-992d-4082ef9c05f3 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:50.520299 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5def6f5-5739-49b6-b2fb-8c8caec2f0b6 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:50.524160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f90105-6f17-497c-992d-4082ef9c05f3 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:50.530358 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46152d70-8a08-476b-90b0-def116fb104e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:50.530523 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5905b3a-3c0b-4681-957f-3335a39d4240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:50.531467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5905b3a-3c0b-4681-957f-3335a39d4240 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:50.531824 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5905b3a-3c0b-4681-957f-3335a39d4240 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:50.532175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5905b3a-3c0b-4681-957f-3335a39d4240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:50.532630 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46152d70-8a08-476b-90b0-def116fb104e admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:50.533577 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46152d70-8a08-476b-90b0-def116fb104e admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:50.534002 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46152d70-8a08-476b-90b0-def116fb104e admin admin] PATH_INFO: `/v3/projects/f1897072e7084be4894b385cb933418b/users/f44ac231687040488e90d77d81a58917/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:50.534699 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e5905b3a-3c0b-4681-957f-3335a39d4240 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:50.553602 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46152d70-8a08-476b-90b0-def116fb104e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1897072e7084be4894b385cb933418b, user_id=f44ac231687040488e90d77d81a58917, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:50.559083 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46152d70-8a08-476b-90b0-def116fb104e admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:50.592740 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 955/1906] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:50 2022] PUT /identity/v3/projects/f1897072e7084be4894b385cb933418b/users/f44ac231687040488e90d77d81a58917/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:50.603600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28db286-6db4-412f-bc5e-9c5052d46d44 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:50.603894 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28db286-6db4-412f-bc5e-9c5052d46d44 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:50.604366 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28db286-6db4-412f-bc5e-9c5052d46d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:50.626494 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5905b3a-3c0b-4681-957f-3335a39d4240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:50.628229 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5905b3a-3c0b-4681-957f-3335a39d4240 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:50.650666 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 952/1907] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:50.655559 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-d28db286-6db4-412f-bc5e-9c5052d46d44 None None] MFA Rules not processed for user `f44ac231687040488e90d77d81a58917`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:50.657333 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-d28db286-6db4-412f-bc5e-9c5052d46d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:50.738903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 956/1908] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:42:50.743373 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5905b3a-3c0b-4681-957f-3335a39d4240 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:50.758199 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5905b3a-3c0b-4681-957f-3335a39d4240 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:50.845754 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2b21b-7225-43d7-b8ff-7c2fd3086198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:50.846942 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2b21b-7225-43d7-b8ff-7c2fd3086198 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:50.846942 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2b21b-7225-43d7-b8ff-7c2fd3086198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:50.847143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2b21b-7225-43d7-b8ff-7c2fd3086198 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:50.847890 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2b21b-7225-43d7-b8ff-7c2fd3086198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:50.849988 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2b21b-7225-43d7-b8ff-7c2fd3086198 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:50.879349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 953/1909] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:50 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:50.883323 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28db286-6db4-412f-bc5e-9c5052d46d44 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:50.895366 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28db286-6db4-412f-bc5e-9c5052d46d44 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:50.911522 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:51.002695 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7db59-a559-4aa1-8aea-312e0df8ecf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:51.003564 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7db59-a559-4aa1-8aea-312e0df8ecf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:51.003957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7db59-a559-4aa1-8aea-312e0df8ecf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:51.004135 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7db59-a559-4aa1-8aea-312e0df8ecf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:51.005027 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7db59-a559-4aa1-8aea-312e0df8ecf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:51.007246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7db59-a559-4aa1-8aea-312e0df8ecf5 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:51.048973 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 957/1910] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:50 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:51.053786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2b21b-7225-43d7-b8ff-7c2fd3086198 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:51.071544 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2b21b-7225-43d7-b8ff-7c2fd3086198 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:51.078466 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74013f05-4396-48b8-b189-ad308dda1914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:51.080872 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74013f05-4396-48b8-b189-ad308dda1914 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:51.081418 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74013f05-4396-48b8-b189-ad308dda1914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:51.081902 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74013f05-4396-48b8-b189-ad308dda1914 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:51.082825 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74013f05-4396-48b8-b189-ad308dda1914 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:51.085023 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74013f05-4396-48b8-b189-ad308dda1914 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:51.099494 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 954/1911] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:51.104915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7db59-a559-4aa1-8aea-312e0df8ecf5 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:51.117938 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7db59-a559-4aa1-8aea-312e0df8ecf5 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:51.123461 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0f9d3-ca4a-483a-9f1d-5177d59144a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:51.124363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0f9d3-ca4a-483a-9f1d-5177d59144a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:51.124650 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0f9d3-ca4a-483a-9f1d-5177d59144a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:51.124957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0f9d3-ca4a-483a-9f1d-5177d59144a4 admin admin] PATH_INFO: `/v3/projects/b871ca5ea4ee47c29a232b26bd707bbf/users/0305f9f675514f57bfd3af733f9b23fb/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:51.141891 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0f9d3-ca4a-483a-9f1d-5177d59144a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b871ca5ea4ee47c29a232b26bd707bbf, user_id=0305f9f675514f57bfd3af733f9b23fb, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:51.144664 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0f9d3-ca4a-483a-9f1d-5177d59144a4 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:51.160958 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 958/1912] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:51 2022] PUT /identity/v3/projects/b871ca5ea4ee47c29a232b26bd707bbf/users/0305f9f675514f57bfd3af733f9b23fb/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:42:51.164724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74013f05-4396-48b8-b189-ad308dda1914 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:51.177033 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74013f05-4396-48b8-b189-ad308dda1914 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:51.186655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:51.249402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a8be5-9684-4372-b89d-c99ba171b0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:51.250091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a8be5-9684-4372-b89d-c99ba171b0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:51.250379 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a8be5-9684-4372-b89d-c99ba171b0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:51.250658 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a8be5-9684-4372-b89d-c99ba171b0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:51.251390 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a8be5-9684-4372-b89d-c99ba171b0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:51.253009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a8be5-9684-4372-b89d-c99ba171b0e8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:51.263749 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 955/1913] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:51.268136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0f9d3-ca4a-483a-9f1d-5177d59144a4 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:51.279312 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0f9d3-ca4a-483a-9f1d-5177d59144a4 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:51.285404 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b9597-66e5-47bb-919e-85f13311f3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:51.286299 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b9597-66e5-47bb-919e-85f13311f3c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:51.286588 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b9597-66e5-47bb-919e-85f13311f3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:51.286871 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b9597-66e5-47bb-919e-85f13311f3c6 admin admin] PATH_INFO: `/v3/projects/b871ca5ea4ee47c29a232b26bd707bbf/users/0305f9f675514f57bfd3af733f9b23fb/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:51.288920 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b9597-66e5-47bb-919e-85f13311f3c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b871ca5ea4ee47c29a232b26bd707bbf, user_id=0305f9f675514f57bfd3af733f9b23fb, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:51.291661 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b9597-66e5-47bb-919e-85f13311f3c6 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:51.302069 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 959/1914] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:51 2022] PUT /identity/v3/projects/b871ca5ea4ee47c29a232b26bd707bbf/users/0305f9f675514f57bfd3af733f9b23fb/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:51.314322 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfffae7-66c5-46d9-b1ff-eae4e6b56530 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:51.315680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfffae7-66c5-46d9-b1ff-eae4e6b56530 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:51.315680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfffae7-66c5-46d9-b1ff-eae4e6b56530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:51.341546 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-fbfffae7-66c5-46d9-b1ff-eae4e6b56530 None None] MFA Rules not processed for user `0305f9f675514f57bfd3af733f9b23fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:51.342888 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-fbfffae7-66c5-46d9-b1ff-eae4e6b56530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:51.432100 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 956/1915] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:51 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:51.443720 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b9597-66e5-47bb-919e-85f13311f3c6 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:51.445365 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-564b9597-66e5-47bb-919e-85f13311f3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:51.512155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b9597-66e5-47bb-919e-85f13311f3c6 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:51.515727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6434c9-b6e7-4117-9dd2-e1910a56b9df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:51.516373 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6434c9-b6e7-4117-9dd2-e1910a56b9df service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:51.516653 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6434c9-b6e7-4117-9dd2-e1910a56b9df service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:51.516929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6434c9-b6e7-4117-9dd2-e1910a56b9df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:51.526544 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6434c9-b6e7-4117-9dd2-e1910a56b9df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:51.527954 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6434c9-b6e7-4117-9dd2-e1910a56b9df service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:51.537788 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 960/1916] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:51 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:52.308445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfffae7-66c5-46d9-b1ff-eae4e6b56530 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:52.323311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfffae7-66c5-46d9-b1ff-eae4e6b56530 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:52.329452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b7c81-efa8-4ce7-86dc-8c03bb41a270 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:52.330114 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b7c81-efa8-4ce7-86dc-8c03bb41a270 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:52.330447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b7c81-efa8-4ce7-86dc-8c03bb41a270 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:52.330726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b7c81-efa8-4ce7-86dc-8c03bb41a270 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:52.342736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f59b7c81-efa8-4ce7-86dc-8c03bb41a270 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:52.464209 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b7c81-efa8-4ce7-86dc-8c03bb41a270 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:52.466257 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b7c81-efa8-4ce7-86dc-8c03bb41a270 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:52.477671 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 957/1917] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:53.254801 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6434c9-b6e7-4117-9dd2-e1910a56b9df service cinder] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:53.331688 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6434c9-b6e7-4117-9dd2-e1910a56b9df service cinder] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:53.336413 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3d301-5c17-4265-86a4-8fa5ac3652e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:53.338083 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3d301-5c17-4265-86a4-8fa5ac3652e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:53.338372 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3d301-5c17-4265-86a4-8fa5ac3652e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:53.338653 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3d301-5c17-4265-86a4-8fa5ac3652e8 admin admin] PATH_INFO: `/v3/users/f44ac231687040488e90d77d81a58917` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:53.339938 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3d301-5c17-4265-86a4-8fa5ac3652e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f44ac231687040488e90d77d81a58917)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:53.341932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3d301-5c17-4265-86a4-8fa5ac3652e8 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:53.360386 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:53.400648 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-11b3d301-5c17-4265-86a4-8fa5ac3652e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f44ac231687040488e90d77d81a58917'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:53.401087 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-11b3d301-5c17-4265-86a4-8fa5ac3652e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f44ac231687040488e90d77d81a58917'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:53.413913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-11b3d301-5c17-4265-86a4-8fa5ac3652e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f44ac231687040488e90d77d81a58917'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:53.423965 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-11b3d301-5c17-4265-86a4-8fa5ac3652e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f44ac231687040488e90d77d81a58917'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:53.444864 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-11b3d301-5c17-4265-86a4-8fa5ac3652e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f44ac231687040488e90d77d81a58917'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:53.463435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 961/1918] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:42:53 2022] DELETE /identity/v3/users/f44ac231687040488e90d77d81a58917 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:53.464344 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297bb05-12c7-44a3-9029-459c8d5969b5 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:53.464831 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297bb05-12c7-44a3-9029-459c8d5969b5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:53.464930 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297bb05-12c7-44a3-9029-459c8d5969b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:53.490263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6297bb05-12c7-44a3-9029-459c8d5969b5 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:53.492534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6297bb05-12c7-44a3-9029-459c8d5969b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:53.516559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:53.577264 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 958/1919] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:53.586975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3d301-5c17-4265-86a4-8fa5ac3652e8 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:53.590264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-11b3d301-5c17-4265-86a4-8fa5ac3652e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:53.711182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3d301-5c17-4265-86a4-8fa5ac3652e8 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:53.716861 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406238c-9dba-4b4e-af36-296e194b3f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:53.718115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406238c-9dba-4b4e-af36-296e194b3f04 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:53.718943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406238c-9dba-4b4e-af36-296e194b3f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:53.719400 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0406238c-9dba-4b4e-af36-296e194b3f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:53.736735 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406238c-9dba-4b4e-af36-296e194b3f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:53.739722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0406238c-9dba-4b4e-af36-296e194b3f04 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:53.767655 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 962/1920] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:54.127724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297bb05-12c7-44a3-9029-459c8d5969b5 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:54.130302 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6297bb05-12c7-44a3-9029-459c8d5969b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:54.147255 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297bb05-12c7-44a3-9029-459c8d5969b5 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:54.156164 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33aab77-5e22-40b7-86c1-eff75cfe736f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:54.157528 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33aab77-5e22-40b7-86c1-eff75cfe736f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:54.158041 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33aab77-5e22-40b7-86c1-eff75cfe736f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:54.158323 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33aab77-5e22-40b7-86c1-eff75cfe736f admin admin] PATH_INFO: `/v3/projects/f1897072e7084be4894b385cb933418b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:54.159569 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33aab77-5e22-40b7-86c1-eff75cfe736f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1897072e7084be4894b385cb933418b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:54.169296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33aab77-5e22-40b7-86c1-eff75cfe736f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:54.222999 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f33aab77-5e22-40b7-86c1-eff75cfe736f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1897072e7084be4894b385cb933418b', 'request_id': 'req-f33aab77-5e22-40b7-86c1-eff75cfe736f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:54.229539 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f33aab77-5e22-40b7-86c1-eff75cfe736f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1897072e7084be4894b385cb933418b', 'request_id': 'req-f33aab77-5e22-40b7-86c1-eff75cfe736f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:54.243118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f33aab77-5e22-40b7-86c1-eff75cfe736f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1897072e7084be4894b385cb933418b', 'request_id': 'req-f33aab77-5e22-40b7-86c1-eff75cfe736f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:54.257039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f33aab77-5e22-40b7-86c1-eff75cfe736f admin admin] The token cache is being invalidate because project f1897072e7084be4894b385cb933418b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:42:54.257327 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f33aab77-5e22-40b7-86c1-eff75cfe736f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:54.258028 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f33aab77-5e22-40b7-86c1-eff75cfe736f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:54.260147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 959/1921] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:42:54 2022] DELETE /identity/v3/projects/f1897072e7084be4894b385cb933418b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:54.264074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406238c-9dba-4b4e-af36-296e194b3f04 service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:54.273654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0406238c-9dba-4b4e-af36-296e194b3f04 service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:54.334636 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021470da-7961-41db-9c8b-9f2e6e6b027b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:54.335465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021470da-7961-41db-9c8b-9f2e6e6b027b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:54.335745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021470da-7961-41db-9c8b-9f2e6e6b027b admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:54.336149 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021470da-7961-41db-9c8b-9f2e6e6b027b admin admin] PATH_INFO: `/v3/users/0305f9f675514f57bfd3af733f9b23fb` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:54.337442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021470da-7961-41db-9c8b-9f2e6e6b027b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0305f9f675514f57bfd3af733f9b23fb)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:54.339382 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021470da-7961-41db-9c8b-9f2e6e6b027b admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:54.379813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:54.389918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-021470da-7961-41db-9c8b-9f2e6e6b027b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0305f9f675514f57bfd3af733f9b23fb'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:54.390914 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-021470da-7961-41db-9c8b-9f2e6e6b027b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0305f9f675514f57bfd3af733f9b23fb'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:54.398195 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-021470da-7961-41db-9c8b-9f2e6e6b027b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0305f9f675514f57bfd3af733f9b23fb'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:54.405583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-021470da-7961-41db-9c8b-9f2e6e6b027b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0305f9f675514f57bfd3af733f9b23fb'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:54.417166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-021470da-7961-41db-9c8b-9f2e6e6b027b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0305f9f675514f57bfd3af733f9b23fb'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:54.423105 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 963/1922] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:42:54 2022] DELETE /identity/v3/users/0305f9f675514f57bfd3af733f9b23fb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:42:54.725392 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33aab77-5e22-40b7-86c1-eff75cfe736f admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:54.727091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f33aab77-5e22-40b7-86c1-eff75cfe736f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:54.741021 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33aab77-5e22-40b7-86c1-eff75cfe736f admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:54.806442 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1622e-1fba-4b06-910e-d1521a6a1aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:54.807319 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1622e-1fba-4b06-910e-d1521a6a1aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:54.807602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1622e-1fba-4b06-910e-d1521a6a1aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:54.807884 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1622e-1fba-4b06-910e-d1521a6a1aec admin admin] PATH_INFO: `/v3/projects/b871ca5ea4ee47c29a232b26bd707bbf` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:54.809092 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1622e-1fba-4b06-910e-d1521a6a1aec admin admin] RBAC: Authorizing `identity:delete_project(project_id=b871ca5ea4ee47c29a232b26bd707bbf)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:54.811080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1622e-1fba-4b06-910e-d1521a6a1aec admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:54.859233 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6af1622e-1fba-4b06-910e-d1521a6a1aec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b871ca5ea4ee47c29a232b26bd707bbf', 'request_id': 'req-6af1622e-1fba-4b06-910e-d1521a6a1aec'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:54.861072 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:54.865991 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6af1622e-1fba-4b06-910e-d1521a6a1aec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b871ca5ea4ee47c29a232b26bd707bbf', 'request_id': 'req-6af1622e-1fba-4b06-910e-d1521a6a1aec'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:54.874755 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6af1622e-1fba-4b06-910e-d1521a6a1aec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b871ca5ea4ee47c29a232b26bd707bbf', 'request_id': 'req-6af1622e-1fba-4b06-910e-d1521a6a1aec'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:54.886589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6af1622e-1fba-4b06-910e-d1521a6a1aec admin admin] The token cache is being invalidate because project b871ca5ea4ee47c29a232b26bd707bbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:42:54.886878 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6af1622e-1fba-4b06-910e-d1521a6a1aec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:54.887516 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6af1622e-1fba-4b06-910e-d1521a6a1aec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:54.889050 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 960/1923] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:42:54 2022] DELETE /identity/v3/projects/b871ca5ea4ee47c29a232b26bd707bbf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:54.894551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b415b-3498-4fd2-9e70-260703ddec5b None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:54.894954 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b415b-3498-4fd2-9e70-260703ddec5b None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:54.895254 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b415b-3498-4fd2-9e70-260703ddec5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:54.913106 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-3d7b415b-3498-4fd2-9e70-260703ddec5b None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:54.914324 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-3d7b415b-3498-4fd2-9e70-260703ddec5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:54.974058 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 964/1924] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:54.981995 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779359b-9e30-4786-9d61-50f52741bb9a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:54.982293 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779359b-9e30-4786-9d61-50f52741bb9a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:54.982576 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779359b-9e30-4786-9d61-50f52741bb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:55.000980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1779359b-9e30-4786-9d61-50f52741bb9a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:55.002232 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1779359b-9e30-4786-9d61-50f52741bb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:55.010316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 961/1925] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:55.014411 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b415b-3498-4fd2-9e70-260703ddec5b None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:55.024181 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b415b-3498-4fd2-9e70-260703ddec5b None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:55.029584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ceabd-c929-41c4-abd2-65a0b502a294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:55.030245 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ceabd-c929-41c4-abd2-65a0b502a294 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:55.030556 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ceabd-c929-41c4-abd2-65a0b502a294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:55.031089 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ceabd-c929-41c4-abd2-65a0b502a294 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:55.031824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ceabd-c929-41c4-abd2-65a0b502a294 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:42:55.032134 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ceabd-c929-41c4-abd2-65a0b502a294 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:55.033768 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ceabd-c929-41c4-abd2-65a0b502a294 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:55.046765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 965/1926] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:42:55.051196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779359b-9e30-4786-9d61-50f52741bb9a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:55.060680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779359b-9e30-4786-9d61-50f52741bb9a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:55.065341 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997b934-b502-47e6-9521-c9f1a7aaf2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:55.066033 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997b934-b502-47e6-9521-c9f1a7aaf2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:55.066319 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997b934-b502-47e6-9521-c9f1a7aaf2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:55.066595 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997b934-b502-47e6-9521-c9f1a7aaf2d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:55.067287 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997b934-b502-47e6-9521-c9f1a7aaf2d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:55.069179 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0997b934-b502-47e6-9521-c9f1a7aaf2d8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:55.094394 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 962/1927] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:55 2022] POST /identity/v3/projects => generated 401 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:55.098413 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ceabd-c929-41c4-abd2-65a0b502a294 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:55.108454 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ceabd-c929-41c4-abd2-65a0b502a294 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:55.165399 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b25b2-735f-4638-a419-74d6d57c67f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:55.166008 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b25b2-735f-4638-a419-74d6d57c67f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:55.166322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b25b2-735f-4638-a419-74d6d57c67f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:55.166601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b25b2-735f-4638-a419-74d6d57c67f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:55.167297 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b25b2-735f-4638-a419-74d6d57c67f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:55.169229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b25b2-735f-4638-a419-74d6d57c67f1 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:55.190175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 966/1928] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:55 2022] POST /identity/v3/users => generated 301 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:42:55.194387 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997b934-b502-47e6-9521-c9f1a7aaf2d8 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:55.206326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997b934-b502-47e6-9521-c9f1a7aaf2d8 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:55.210903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8534a-e51f-4eee-8d98-e5cb7ca65e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:55.211562 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8534a-e51f-4eee-8d98-e5cb7ca65e32 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:55.211843 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8534a-e51f-4eee-8d98-e5cb7ca65e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:55.212215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8534a-e51f-4eee-8d98-e5cb7ca65e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:55.213091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8534a-e51f-4eee-8d98-e5cb7ca65e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:55.214729 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8534a-e51f-4eee-8d98-e5cb7ca65e32 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:55.227302 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 963/1929] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:55.231378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b25b2-735f-4638-a419-74d6d57c67f1 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:55.241473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b25b2-735f-4638-a419-74d6d57c67f1 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:55.246685 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f61b7a-fd85-44f7-90c6-59a8c789f442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:55.247340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f61b7a-fd85-44f7-90c6-59a8c789f442 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:55.247628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f61b7a-fd85-44f7-90c6-59a8c789f442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:55.247911 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f61b7a-fd85-44f7-90c6-59a8c789f442 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:55.248635 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f61b7a-fd85-44f7-90c6-59a8c789f442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:55.250261 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f61b7a-fd85-44f7-90c6-59a8c789f442 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:55.260302 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 967/1930] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:55.264571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8534a-e51f-4eee-8d98-e5cb7ca65e32 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:55.274456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8534a-e51f-4eee-8d98-e5cb7ca65e32 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:55.279096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05af1e9-87ab-43c1-924c-4c791127d16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:55.279964 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05af1e9-87ab-43c1-924c-4c791127d16b admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:55.280250 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05af1e9-87ab-43c1-924c-4c791127d16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:55.280529 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05af1e9-87ab-43c1-924c-4c791127d16b admin admin] PATH_INFO: `/v3/projects/7effc9954bc34c01ae72cbffe54daf7c/users/e832ae2d4e344403aec0768fdd186a17/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:55.296026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05af1e9-87ab-43c1-924c-4c791127d16b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7effc9954bc34c01ae72cbffe54daf7c, user_id=e832ae2d4e344403aec0768fdd186a17, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:55.298722 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05af1e9-87ab-43c1-924c-4c791127d16b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:55.311963 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 964/1931] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:55 2022] PUT /identity/v3/projects/7effc9954bc34c01ae72cbffe54daf7c/users/e832ae2d4e344403aec0768fdd186a17/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:55.323169 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266ebd2-26ae-43bc-bef6-990e21116955 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:55.323648 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266ebd2-26ae-43bc-bef6-990e21116955 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:55.323738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266ebd2-26ae-43bc-bef6-990e21116955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:55.349435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-6266ebd2-26ae-43bc-bef6-990e21116955 None None] MFA Rules not processed for user `e832ae2d4e344403aec0768fdd186a17`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:55.350628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-6266ebd2-26ae-43bc-bef6-990e21116955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:55.359601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:55.419188 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 968/1932] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:42:55.423666 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05af1e9-87ab-43c1-924c-4c791127d16b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:55.485427 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05af1e9-87ab-43c1-924c-4c791127d16b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:55.490057 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba6b9a-9939-4a8e-b049-fb8a5eb0aaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:55.490706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba6b9a-9939-4a8e-b049-fb8a5eb0aaa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:55.490993 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba6b9a-9939-4a8e-b049-fb8a5eb0aaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:55.491293 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba6b9a-9939-4a8e-b049-fb8a5eb0aaa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:55.491988 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba6b9a-9939-4a8e-b049-fb8a5eb0aaa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:55.494054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba6b9a-9939-4a8e-b049-fb8a5eb0aaa4 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:55.518861 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 965/1933] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:42:55 2022] POST /identity/v3/projects => generated 397 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:55.522957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266ebd2-26ae-43bc-bef6-990e21116955 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:55.534474 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266ebd2-26ae-43bc-bef6-990e21116955 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:55.591068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288fecf-ff06-4735-a5da-13237f11d242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:55.591731 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288fecf-ff06-4735-a5da-13237f11d242 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:55.592016 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288fecf-ff06-4735-a5da-13237f11d242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:55.592291 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288fecf-ff06-4735-a5da-13237f11d242 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:55.592971 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288fecf-ff06-4735-a5da-13237f11d242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:55.594925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5288fecf-ff06-4735-a5da-13237f11d242 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:55.614898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 969/1934] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:42:55 2022] POST /identity/v3/users => generated 305 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:42:55.618951 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba6b9a-9939-4a8e-b049-fb8a5eb0aaa4 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:55.629091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba6b9a-9939-4a8e-b049-fb8a5eb0aaa4 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:55.633681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64567e0b-4d0a-45a0-9513-0056ebbee3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:55.634839 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64567e0b-4d0a-45a0-9513-0056ebbee3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:55.635096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64567e0b-4d0a-45a0-9513-0056ebbee3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:55.635367 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64567e0b-4d0a-45a0-9513-0056ebbee3c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:55.636437 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64567e0b-4d0a-45a0-9513-0056ebbee3c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:55.638735 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64567e0b-4d0a-45a0-9513-0056ebbee3c5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:55.649480 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 966/1935] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:55.654329 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288fecf-ff06-4735-a5da-13237f11d242 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:55.665134 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5288fecf-ff06-4735-a5da-13237f11d242 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:55.670171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec84409-6846-40a5-8381-d2bc08d275d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:55.670976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec84409-6846-40a5-8381-d2bc08d275d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:55.671262 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec84409-6846-40a5-8381-d2bc08d275d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:55.671537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec84409-6846-40a5-8381-d2bc08d275d4 admin admin] PATH_INFO: `/v3/projects/dd8fa6d18cca46f0a01bdc714032acbd/users/2d87916b889f4c64a3f8b6594b4da436/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:55.688269 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec84409-6846-40a5-8381-d2bc08d275d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8fa6d18cca46f0a01bdc714032acbd, user_id=2d87916b889f4c64a3f8b6594b4da436, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:55.691019 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec84409-6846-40a5-8381-d2bc08d275d4 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:55.704772 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 970/1936] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:55 2022] PUT /identity/v3/projects/dd8fa6d18cca46f0a01bdc714032acbd/users/2d87916b889f4c64a3f8b6594b4da436/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:55.708712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64567e0b-4d0a-45a0-9513-0056ebbee3c5 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:55.719326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64567e0b-4d0a-45a0-9513-0056ebbee3c5 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:55.767197 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:55.779472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15cf3f5-1fc2-4848-8a10-920cb6af4a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:55.780148 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cf3f5-1fc2-4848-8a10-920cb6af4a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:55.780435 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cf3f5-1fc2-4848-8a10-920cb6af4a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:55.780708 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15cf3f5-1fc2-4848-8a10-920cb6af4a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:55.781725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cf3f5-1fc2-4848-8a10-920cb6af4a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:55.783340 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15cf3f5-1fc2-4848-8a10-920cb6af4a94 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:55.794556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 967/1937] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:42:55.798639 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec84409-6846-40a5-8381-d2bc08d275d4 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:55.809979 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec84409-6846-40a5-8381-d2bc08d275d4 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:55.814606 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ded7fb-6715-4b9f-ab78-46fd8211a4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:55.815495 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ded7fb-6715-4b9f-ab78-46fd8211a4d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:55.815787 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ded7fb-6715-4b9f-ab78-46fd8211a4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:55.816067 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ded7fb-6715-4b9f-ab78-46fd8211a4d4 admin admin] PATH_INFO: `/v3/projects/dd8fa6d18cca46f0a01bdc714032acbd/users/2d87916b889f4c64a3f8b6594b4da436/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:55.818105 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ded7fb-6715-4b9f-ab78-46fd8211a4d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8fa6d18cca46f0a01bdc714032acbd, user_id=2d87916b889f4c64a3f8b6594b4da436, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:55.820742 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ded7fb-6715-4b9f-ab78-46fd8211a4d4 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:55.832398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 971/1938] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:42:55 2022] PUT /identity/v3/projects/dd8fa6d18cca46f0a01bdc714032acbd/users/2d87916b889f4c64a3f8b6594b4da436/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:55.842834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91db7af-1312-47eb-89c4-70fd6f1198ef None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:55.843125 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91db7af-1312-47eb-89c4-70fd6f1198ef None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:55.843405 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91db7af-1312-47eb-89c4-70fd6f1198ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:55.870127 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b91db7af-1312-47eb-89c4-70fd6f1198ef None None] MFA Rules not processed for user `2d87916b889f4c64a3f8b6594b4da436`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:55.871355 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b91db7af-1312-47eb-89c4-70fd6f1198ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:55.941015 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 968/1939] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:55 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:55.952647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ded7fb-6715-4b9f-ab78-46fd8211a4d4 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:55.954519 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-83ded7fb-6715-4b9f-ab78-46fd8211a4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:56.015149 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ded7fb-6715-4b9f-ab78-46fd8211a4d4 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:56.019019 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc570e-8441-4533-9a25-c4bc6e822acc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:56.019663 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc570e-8441-4533-9a25-c4bc6e822acc service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:56.019945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc570e-8441-4533-9a25-c4bc6e822acc service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:56.020219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc570e-8441-4533-9a25-c4bc6e822acc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:56.030719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc570e-8441-4533-9a25-c4bc6e822acc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:56.032375 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc570e-8441-4533-9a25-c4bc6e822acc service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:56.043273 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 972/1940] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:55 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:56.119572 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91db7af-1312-47eb-89c4-70fd6f1198ef None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:56.129443 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91db7af-1312-47eb-89c4-70fd6f1198ef None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:56.133011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408add3-cd5b-4a66-bd00-d1554fb7973b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:56.133691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408add3-cd5b-4a66-bd00-d1554fb7973b service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:56.134056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408add3-cd5b-4a66-bd00-d1554fb7973b service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:56.134337 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408add3-cd5b-4a66-bd00-d1554fb7973b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:56.200995 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408add3-cd5b-4a66-bd00-d1554fb7973b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:56.202413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408add3-cd5b-4a66-bd00-d1554fb7973b service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:56.212008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 969/1941] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:56 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:58.663095 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc570e-8441-4533-9a25-c4bc6e822acc service cinder] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:58.664506 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-eccc570e-8441-4533-9a25-c4bc6e822acc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:58.672523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:58.787532 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc570e-8441-4533-9a25-c4bc6e822acc service cinder] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:58.813208 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1690ee7-e6fe-48c2-9b33-2b2af855ecdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:58.814145 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1690ee7-e6fe-48c2-9b33-2b2af855ecdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:58.814433 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1690ee7-e6fe-48c2-9b33-2b2af855ecdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:58.814716 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1690ee7-e6fe-48c2-9b33-2b2af855ecdb admin admin] PATH_INFO: `/v3/users/1b8d1506bd0c47de8dbd4a07fd852f8f` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:58.816100 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1690ee7-e6fe-48c2-9b33-2b2af855ecdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b8d1506bd0c47de8dbd4a07fd852f8f)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:58.817956 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1690ee7-e6fe-48c2-9b33-2b2af855ecdb admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:58.894071 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-c1690ee7-e6fe-48c2-9b33-2b2af855ecdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b8d1506bd0c47de8dbd4a07fd852f8f'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:58.895122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-c1690ee7-e6fe-48c2-9b33-2b2af855ecdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b8d1506bd0c47de8dbd4a07fd852f8f'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:58.910635 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-c1690ee7-e6fe-48c2-9b33-2b2af855ecdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b8d1506bd0c47de8dbd4a07fd852f8f'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:58.924420 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-c1690ee7-e6fe-48c2-9b33-2b2af855ecdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b8d1506bd0c47de8dbd4a07fd852f8f'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:58.949102 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-c1690ee7-e6fe-48c2-9b33-2b2af855ecdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b8d1506bd0c47de8dbd4a07fd852f8f'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:58.961427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 973/1942] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:42:58 2022] DELETE /identity/v3/users/1b8d1506bd0c47de8dbd4a07fd852f8f => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:58.965091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fcc27-d8ef-4768-8f3e-29c09b45ee4a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:58.965987 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fcc27-d8ef-4768-8f3e-29c09b45ee4a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:58.966258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6fcc27-d8ef-4768-8f3e-29c09b45ee4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:58.988613 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-eb6fcc27-d8ef-4768-8f3e-29c09b45ee4a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:42:58.990164 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-eb6fcc27-d8ef-4768-8f3e-29c09b45ee4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:59.070504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 970/1943] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:42:59.080618 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1690ee7-e6fe-48c2-9b33-2b2af855ecdb admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:59.082509 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c1690ee7-e6fe-48c2-9b33-2b2af855ecdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:59.171250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1690ee7-e6fe-48c2-9b33-2b2af855ecdb admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:59.175064 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af957b97-47c0-4272-beb9-ab7764fad951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:59.175862 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af957b97-47c0-4272-beb9-ab7764fad951 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:59.176151 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af957b97-47c0-4272-beb9-ab7764fad951 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:59.176427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af957b97-47c0-4272-beb9-ab7764fad951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:59.198171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af957b97-47c0-4272-beb9-ab7764fad951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:59.199832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af957b97-47c0-4272-beb9-ab7764fad951 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:59.212756 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 974/1944] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:42:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:42:59.623163 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fcc27-d8ef-4768-8f3e-29c09b45ee4a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:59.625005 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-eb6fcc27-d8ef-4768-8f3e-29c09b45ee4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:42:59.644691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6fcc27-d8ef-4768-8f3e-29c09b45ee4a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:59.654174 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0aed3-d4f0-41f7-bcb1-0c929deb8622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:59.658051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0aed3-d4f0-41f7-bcb1-0c929deb8622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:59.658051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0aed3-d4f0-41f7-bcb1-0c929deb8622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:59.658051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a0aed3-d4f0-41f7-bcb1-0c929deb8622 admin admin] PATH_INFO: `/v3/projects/002317b3056246b0b003d9b3762c41eb` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:59.663136 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0aed3-d4f0-41f7-bcb1-0c929deb8622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=002317b3056246b0b003d9b3762c41eb)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:59.666358 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a0aed3-d4f0-41f7-bcb1-0c929deb8622 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:59.675274 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:59.723342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a9a0aed3-d4f0-41f7-bcb1-0c929deb8622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '002317b3056246b0b003d9b3762c41eb', 'request_id': 'req-a9a0aed3-d4f0-41f7-bcb1-0c929deb8622'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:59.730688 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a9a0aed3-d4f0-41f7-bcb1-0c929deb8622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '002317b3056246b0b003d9b3762c41eb', 'request_id': 'req-a9a0aed3-d4f0-41f7-bcb1-0c929deb8622'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:59.738525 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a9a0aed3-d4f0-41f7-bcb1-0c929deb8622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '002317b3056246b0b003d9b3762c41eb', 'request_id': 'req-a9a0aed3-d4f0-41f7-bcb1-0c929deb8622'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:59.753856 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a9a0aed3-d4f0-41f7-bcb1-0c929deb8622 admin admin] The token cache is being invalidate because project 002317b3056246b0b003d9b3762c41eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:42:59.754153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a9a0aed3-d4f0-41f7-bcb1-0c929deb8622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:59.754972 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a9a0aed3-d4f0-41f7-bcb1-0c929deb8622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:59.757028 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 971/1945] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:42:59 2022] DELETE /identity/v3/projects/002317b3056246b0b003d9b3762c41eb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:42:59.761660 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af957b97-47c0-4272-beb9-ab7764fad951 service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:42:59.771867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af957b97-47c0-4272-beb9-ab7764fad951 service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:42:59.798945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:42:59.836657 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d738e-1bc7-42d9-b5ff-2d3b24b22bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:42:59.838156 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d738e-1bc7-42d9-b5ff-2d3b24b22bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:42:59.838441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d738e-1bc7-42d9-b5ff-2d3b24b22bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:42:59.838719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d738e-1bc7-42d9-b5ff-2d3b24b22bd9 admin admin] PATH_INFO: `/v3/users/7df599086e394ae4a7b18f8529071a86` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:42:59.839915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d738e-1bc7-42d9-b5ff-2d3b24b22bd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7df599086e394ae4a7b18f8529071a86)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:42:59.841881 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d738e-1bc7-42d9-b5ff-2d3b24b22bd9 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:42:59.891377 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-3e8d738e-1bc7-42d9-b5ff-2d3b24b22bd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7df599086e394ae4a7b18f8529071a86'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:59.892099 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-3e8d738e-1bc7-42d9-b5ff-2d3b24b22bd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7df599086e394ae4a7b18f8529071a86'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:59.899183 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-3e8d738e-1bc7-42d9-b5ff-2d3b24b22bd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7df599086e394ae4a7b18f8529071a86'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:59.907487 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-3e8d738e-1bc7-42d9-b5ff-2d3b24b22bd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7df599086e394ae4a7b18f8529071a86'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:59.920325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-3e8d738e-1bc7-42d9-b5ff-2d3b24b22bd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7df599086e394ae4a7b18f8529071a86'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:42:59.926557 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 975/1946] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:42:59 2022] DELETE /identity/v3/users/7df599086e394ae4a7b18f8529071a86 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:00.204889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0aed3-d4f0-41f7-bcb1-0c929deb8622 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:00.206590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a9a0aed3-d4f0-41f7-bcb1-0c929deb8622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:00.221981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a0aed3-d4f0-41f7-bcb1-0c929deb8622 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:00.289475 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933aa2a4-1ed3-4317-ad82-35d98eac437d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:00.290938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933aa2a4-1ed3-4317-ad82-35d98eac437d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:00.291312 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933aa2a4-1ed3-4317-ad82-35d98eac437d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:00.291593 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933aa2a4-1ed3-4317-ad82-35d98eac437d admin admin] PATH_INFO: `/v3/projects/f9e8477bcde84672870a89b2cea8888a` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:00.292845 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933aa2a4-1ed3-4317-ad82-35d98eac437d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e8477bcde84672870a89b2cea8888a)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:00.294790 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933aa2a4-1ed3-4317-ad82-35d98eac437d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:00.349530 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-933aa2a4-1ed3-4317-ad82-35d98eac437d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e8477bcde84672870a89b2cea8888a', 'request_id': 'req-933aa2a4-1ed3-4317-ad82-35d98eac437d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:00.355706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-933aa2a4-1ed3-4317-ad82-35d98eac437d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e8477bcde84672870a89b2cea8888a', 'request_id': 'req-933aa2a4-1ed3-4317-ad82-35d98eac437d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:00.363662 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-933aa2a4-1ed3-4317-ad82-35d98eac437d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e8477bcde84672870a89b2cea8888a', 'request_id': 'req-933aa2a4-1ed3-4317-ad82-35d98eac437d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:00.376360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-933aa2a4-1ed3-4317-ad82-35d98eac437d admin admin] The token cache is being invalidate because project f9e8477bcde84672870a89b2cea8888a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:00.376873 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-933aa2a4-1ed3-4317-ad82-35d98eac437d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:00.377619 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-933aa2a4-1ed3-4317-ad82-35d98eac437d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:00.379573 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 972/1947] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:00 2022] DELETE /identity/v3/projects/f9e8477bcde84672870a89b2cea8888a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:00.383304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d738e-1bc7-42d9-b5ff-2d3b24b22bd9 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:00.385601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-3e8d738e-1bc7-42d9-b5ff-2d3b24b22bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:00.398385 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d738e-1bc7-42d9-b5ff-2d3b24b22bd9 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:00.464901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003eebe1-a110-4dfa-bf28-d5e5858406c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:00.466026 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eebe1-a110-4dfa-bf28-d5e5858406c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:00.466378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eebe1-a110-4dfa-bf28-d5e5858406c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:00.466894 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eebe1-a110-4dfa-bf28-d5e5858406c6 admin admin] PATH_INFO: `/v3/users/04ff1c53d52447f8af1f2662a0477382` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:00.484721 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003eebe1-a110-4dfa-bf28-d5e5858406c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04ff1c53d52447f8af1f2662a0477382)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:00.493274 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003eebe1-a110-4dfa-bf28-d5e5858406c6 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:00.562396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-003eebe1-a110-4dfa-bf28-d5e5858406c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ff1c53d52447f8af1f2662a0477382'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:00.563733 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-003eebe1-a110-4dfa-bf28-d5e5858406c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ff1c53d52447f8af1f2662a0477382'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:00.565806 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:00.574362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-003eebe1-a110-4dfa-bf28-d5e5858406c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ff1c53d52447f8af1f2662a0477382'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:00.586522 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-003eebe1-a110-4dfa-bf28-d5e5858406c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ff1c53d52447f8af1f2662a0477382'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:00.608377 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-003eebe1-a110-4dfa-bf28-d5e5858406c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ff1c53d52447f8af1f2662a0477382'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:00.615972 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 976/1948] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:00 2022] DELETE /identity/v3/users/04ff1c53d52447f8af1f2662a0477382 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:00.685158 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933aa2a4-1ed3-4317-ad82-35d98eac437d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:00.686910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-933aa2a4-1ed3-4317-ad82-35d98eac437d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:00.701594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933aa2a4-1ed3-4317-ad82-35d98eac437d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:00.725194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:00.787037 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bda64a-9e65-447d-8a47-4d28b96630ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:00.787937 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bda64a-9e65-447d-8a47-4d28b96630ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:00.788225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bda64a-9e65-447d-8a47-4d28b96630ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:00.788504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bda64a-9e65-447d-8a47-4d28b96630ac admin admin] PATH_INFO: `/v3/users/e832ae2d4e344403aec0768fdd186a17` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:00.789771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bda64a-9e65-447d-8a47-4d28b96630ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e832ae2d4e344403aec0768fdd186a17)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:00.792544 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bda64a-9e65-447d-8a47-4d28b96630ac admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:00.855231 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-23bda64a-9e65-447d-8a47-4d28b96630ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e832ae2d4e344403aec0768fdd186a17'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:00.856110 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-23bda64a-9e65-447d-8a47-4d28b96630ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e832ae2d4e344403aec0768fdd186a17'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:00.865873 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-23bda64a-9e65-447d-8a47-4d28b96630ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e832ae2d4e344403aec0768fdd186a17'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:00.874649 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-23bda64a-9e65-447d-8a47-4d28b96630ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e832ae2d4e344403aec0768fdd186a17'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:00.892012 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-23bda64a-9e65-447d-8a47-4d28b96630ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e832ae2d4e344403aec0768fdd186a17'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:00.901431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 973/1949] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:00 2022] DELETE /identity/v3/users/e832ae2d4e344403aec0768fdd186a17 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:00.906424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90314b0b-0b6e-4be6-b3ea-d350e88c66dd None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:00.906891 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90314b0b-0b6e-4be6-b3ea-d350e88c66dd None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:00.906989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90314b0b-0b6e-4be6-b3ea-d350e88c66dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:00.930343 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-90314b0b-0b6e-4be6-b3ea-d350e88c66dd None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:00.932214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-90314b0b-0b6e-4be6-b3ea-d350e88c66dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:00.943225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bda64a-9e65-447d-8a47-4d28b96630ac admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:00.944926 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-23bda64a-9e65-447d-8a47-4d28b96630ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:01.021723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 977/1950] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:01.029350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90314b0b-0b6e-4be6-b3ea-d350e88c66dd None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:01.031539 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-90314b0b-0b6e-4be6-b3ea-d350e88c66dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:01.035606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bda64a-9e65-447d-8a47-4d28b96630ac admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:01.048550 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11786b67-3162-4dee-8968-dfe36b8f9ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:01.049480 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11786b67-3162-4dee-8968-dfe36b8f9ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:01.049771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11786b67-3162-4dee-8968-dfe36b8f9ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:01.050199 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11786b67-3162-4dee-8968-dfe36b8f9ec8 admin admin] PATH_INFO: `/v3/projects/d32a601e205a4b2a9de9c9ebefffdbe7` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:01.051579 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11786b67-3162-4dee-8968-dfe36b8f9ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d32a601e205a4b2a9de9c9ebefffdbe7)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:01.054014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11786b67-3162-4dee-8968-dfe36b8f9ec8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:01.104686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90314b0b-0b6e-4be6-b3ea-d350e88c66dd None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:01.106991 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:01.110652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-11786b67-3162-4dee-8968-dfe36b8f9ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd32a601e205a4b2a9de9c9ebefffdbe7', 'request_id': 'req-11786b67-3162-4dee-8968-dfe36b8f9ec8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:01.120136 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-11786b67-3162-4dee-8968-dfe36b8f9ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd32a601e205a4b2a9de9c9ebefffdbe7', 'request_id': 'req-11786b67-3162-4dee-8968-dfe36b8f9ec8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:01.131121 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-11786b67-3162-4dee-8968-dfe36b8f9ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd32a601e205a4b2a9de9c9ebefffdbe7', 'request_id': 'req-11786b67-3162-4dee-8968-dfe36b8f9ec8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:01.143983 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-11786b67-3162-4dee-8968-dfe36b8f9ec8 admin admin] The token cache is being invalidate because project d32a601e205a4b2a9de9c9ebefffdbe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:01.144453 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-11786b67-3162-4dee-8968-dfe36b8f9ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:01.145228 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-11786b67-3162-4dee-8968-dfe36b8f9ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:01.149798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 974/1951] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:00 2022] DELETE /identity/v3/projects/d32a601e205a4b2a9de9c9ebefffdbe7 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:01.153501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0b63d-4d80-42ab-8ce3-7817f64f504f None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:01.153958 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0b63d-4d80-42ab-8ce3-7817f64f504f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:01.154276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0b63d-4d80-42ab-8ce3-7817f64f504f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:01.162759 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a37bb0-55ee-4d04-9239-28a46e107592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:01.163420 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a37bb0-55ee-4d04-9239-28a46e107592 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:01.163704 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a37bb0-55ee-4d04-9239-28a46e107592 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:01.163985 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a37bb0-55ee-4d04-9239-28a46e107592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:01.166881 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c4a37bb0-55ee-4d04-9239-28a46e107592 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:01.174276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a0a0b63d-4d80-42ab-8ce3-7817f64f504f None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:01.175476 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a0a0b63d-4d80-42ab-8ce3-7817f64f504f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:01.208769 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:01.242641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a37bb0-55ee-4d04-9239-28a46e107592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:01.244193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 975/1952] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:43:01.244745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a37bb0-55ee-4d04-9239-28a46e107592 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:01.252216 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0d139-01be-45fa-aaee-78a30ed8641e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:01.252737 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0d139-01be-45fa-aaee-78a30ed8641e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:01.253023 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0d139-01be-45fa-aaee-78a30ed8641e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:01.254989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 978/1953] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:43:01.271523 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d2d0d139-01be-45fa-aaee-78a30ed8641e None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:01.272823 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d2d0d139-01be-45fa-aaee-78a30ed8641e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:01.282788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 976/1954] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:01.286997 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a37bb0-55ee-4d04-9239-28a46e107592 service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:01.297957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a37bb0-55ee-4d04-9239-28a46e107592 service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:01.302605 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01662ad-897f-48ba-86ca-538cf00c5064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:01.303271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01662ad-897f-48ba-86ca-538cf00c5064 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:01.303554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01662ad-897f-48ba-86ca-538cf00c5064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:01.303825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01662ad-897f-48ba-86ca-538cf00c5064 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:01.304670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01662ad-897f-48ba-86ca-538cf00c5064 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:43:01.304995 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01662ad-897f-48ba-86ca-538cf00c5064 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:01.307152 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01662ad-897f-48ba-86ca-538cf00c5064 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:01.324510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 979/1955] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:43:01.326186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0d139-01be-45fa-aaee-78a30ed8641e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:01.336990 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0d139-01be-45fa-aaee-78a30ed8641e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:01.344948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44778929-52a0-401b-b3bb-96ece6336d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:01.345899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44778929-52a0-401b-b3bb-96ece6336d0c admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:01.346189 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44778929-52a0-401b-b3bb-96ece6336d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:01.346469 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44778929-52a0-401b-b3bb-96ece6336d0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:01.347168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44778929-52a0-401b-b3bb-96ece6336d0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:01.349273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44778929-52a0-401b-b3bb-96ece6336d0c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:01.376954 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 977/1956] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:43:01 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:01.381629 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01662ad-897f-48ba-86ca-538cf00c5064 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:01.395964 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01662ad-897f-48ba-86ca-538cf00c5064 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:01.403887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44778929-52a0-401b-b3bb-96ece6336d0c admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:01.406465 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-44778929-52a0-401b-b3bb-96ece6336d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:01.472718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2a13d-28f9-4843-b68d-85131ad47dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:01.473530 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2a13d-28f9-4843-b68d-85131ad47dae admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:01.474012 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2a13d-28f9-4843-b68d-85131ad47dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:01.474370 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2a13d-28f9-4843-b68d-85131ad47dae admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:01.475138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2a13d-28f9-4843-b68d-85131ad47dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:01.477159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2a13d-28f9-4843-b68d-85131ad47dae admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:01.486417 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44778929-52a0-401b-b3bb-96ece6336d0c admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:01.492447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9f9d8-3d4d-4ada-92bd-80da363e2449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:01.493678 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9f9d8-3d4d-4ada-92bd-80da363e2449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:01.493977 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9f9d8-3d4d-4ada-92bd-80da363e2449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:01.494255 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9f9d8-3d4d-4ada-92bd-80da363e2449 admin admin] PATH_INFO: `/v3/users/54575b28e7ec4f04a9884a35d5feec2e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:01.495858 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9f9d8-3d4d-4ada-92bd-80da363e2449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54575b28e7ec4f04a9884a35d5feec2e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:01.498088 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9f9d8-3d4d-4ada-92bd-80da363e2449 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:01.505434 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 980/1957] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:43:01 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:01.509868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2a13d-28f9-4843-b68d-85131ad47dae admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:01.525448 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2a13d-28f9-4843-b68d-85131ad47dae admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:01.530903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d884ca-0d3e-4ad2-a315-3a13ab7b6871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:01.531590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d884ca-0d3e-4ad2-a315-3a13ab7b6871 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:01.531877 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d884ca-0d3e-4ad2-a315-3a13ab7b6871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:01.532155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d884ca-0d3e-4ad2-a315-3a13ab7b6871 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:01.533006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d884ca-0d3e-4ad2-a315-3a13ab7b6871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:01.534784 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d884ca-0d3e-4ad2-a315-3a13ab7b6871 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:01.550898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 981/1958] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:01.554797 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d884ca-0d3e-4ad2-a315-3a13ab7b6871 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:01.574313 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d884ca-0d3e-4ad2-a315-3a13ab7b6871 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:01.579813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e971d-0f57-4fa1-b89b-5f9259cffe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:01.580862 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e971d-0f57-4fa1-b89b-5f9259cffe7a admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:01.581153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e971d-0f57-4fa1-b89b-5f9259cffe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:01.581463 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e971d-0f57-4fa1-b89b-5f9259cffe7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:01.582202 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e971d-0f57-4fa1-b89b-5f9259cffe7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:01.585189 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e971d-0f57-4fa1-b89b-5f9259cffe7a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:01.596834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-49f9f9d8-3d4d-4ada-92bd-80da363e2449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54575b28e7ec4f04a9884a35d5feec2e'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:01.597572 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-49f9f9d8-3d4d-4ada-92bd-80da363e2449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54575b28e7ec4f04a9884a35d5feec2e'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:01.600404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:01.603527 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 982/1959] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:43:01.608367 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e971d-0f57-4fa1-b89b-5f9259cffe7a admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:01.616608 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-49f9f9d8-3d4d-4ada-92bd-80da363e2449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54575b28e7ec4f04a9884a35d5feec2e'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:01.623773 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e971d-0f57-4fa1-b89b-5f9259cffe7a admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:01.630060 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-49f9f9d8-3d4d-4ada-92bd-80da363e2449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54575b28e7ec4f04a9884a35d5feec2e'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:01.635031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed14ab-ff27-47a3-bdf4-73f38406796c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:01.636859 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed14ab-ff27-47a3-bdf4-73f38406796c admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:01.637153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed14ab-ff27-47a3-bdf4-73f38406796c admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:01.637700 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed14ab-ff27-47a3-bdf4-73f38406796c admin admin] PATH_INFO: `/v3/projects/cbf704ce7bfd49f5b83ca2e7e0120c91/users/de843beff4dd401fb34b34ab83f6f7f3/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:01.656319 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-49f9f9d8-3d4d-4ada-92bd-80da363e2449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54575b28e7ec4f04a9884a35d5feec2e'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:01.664874 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed14ab-ff27-47a3-bdf4-73f38406796c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf704ce7bfd49f5b83ca2e7e0120c91, user_id=de843beff4dd401fb34b34ab83f6f7f3, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:01.668678 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 978/1960] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:01 2022] DELETE /identity/v3/users/54575b28e7ec4f04a9884a35d5feec2e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:01.670297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9f9d8-3d4d-4ada-92bd-80da363e2449 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:01.671907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed14ab-ff27-47a3-bdf4-73f38406796c admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:01.673808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-49f9f9d8-3d4d-4ada-92bd-80da363e2449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:01.696789 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 983/1961] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:01 2022] PUT /identity/v3/projects/cbf704ce7bfd49f5b83ca2e7e0120c91/users/de843beff4dd401fb34b34ab83f6f7f3/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:01.703087 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d527ab-c5d1-4b86-901a-6308e46fc764 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:01.703380 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d527ab-c5d1-4b86-901a-6308e46fc764 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:01.703663 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d527ab-c5d1-4b86-901a-6308e46fc764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:01.731942 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-57d527ab-c5d1-4b86-901a-6308e46fc764 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:01.733295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-57d527ab-c5d1-4b86-901a-6308e46fc764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:01.803006 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9f9d8-3d4d-4ada-92bd-80da363e2449 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:01.824065 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 984/1962] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:01.834507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d527ab-c5d1-4b86-901a-6308e46fc764 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:01.836126 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-57d527ab-c5d1-4b86-901a-6308e46fc764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:01.850878 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:01.910207 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db9e3c-8e1a-4831-a6a5-adce9833e137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:01.911547 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db9e3c-8e1a-4831-a6a5-adce9833e137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:01.911958 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db9e3c-8e1a-4831-a6a5-adce9833e137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:01.912345 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db9e3c-8e1a-4831-a6a5-adce9833e137 admin admin] PATH_INFO: `/v3/projects/7effc9954bc34c01ae72cbffe54daf7c` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:01.913864 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db9e3c-8e1a-4831-a6a5-adce9833e137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7effc9954bc34c01ae72cbffe54daf7c)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:01.916537 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db9e3c-8e1a-4831-a6a5-adce9833e137 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:01.954573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d527ab-c5d1-4b86-901a-6308e46fc764 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:01.964308 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a7d97-0608-4096-a05a-8dde623615c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:01.965605 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a7d97-0608-4096-a05a-8dde623615c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:01.965897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a7d97-0608-4096-a05a-8dde623615c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:01.966173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a7d97-0608-4096-a05a-8dde623615c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:01.978154 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a7d97-0608-4096-a05a-8dde623615c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:01.979591 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a7d97-0608-4096-a05a-8dde623615c5 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:02.003755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 985/1963] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:43:02.011667 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-31db9e3c-8e1a-4831-a6a5-adce9833e137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7effc9954bc34c01ae72cbffe54daf7c', 'request_id': 'req-31db9e3c-8e1a-4831-a6a5-adce9833e137'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:02.020848 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a7d97-0608-4096-a05a-8dde623615c5 service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:02.022297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-31db9e3c-8e1a-4831-a6a5-adce9833e137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7effc9954bc34c01ae72cbffe54daf7c', 'request_id': 'req-31db9e3c-8e1a-4831-a6a5-adce9833e137'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:02.022583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b45a7d97-0608-4096-a05a-8dde623615c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:02.044371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-31db9e3c-8e1a-4831-a6a5-adce9833e137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7effc9954bc34c01ae72cbffe54daf7c', 'request_id': 'req-31db9e3c-8e1a-4831-a6a5-adce9833e137'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:02.046988 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a7d97-0608-4096-a05a-8dde623615c5 service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:02.089619 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-31db9e3c-8e1a-4831-a6a5-adce9833e137 admin admin] The token cache is being invalidate because project 7effc9954bc34c01ae72cbffe54daf7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:02.090223 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-31db9e3c-8e1a-4831-a6a5-adce9833e137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:02.091383 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-31db9e3c-8e1a-4831-a6a5-adce9833e137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:02.093774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 979/1964] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:01 2022] DELETE /identity/v3/projects/7effc9954bc34c01ae72cbffe54daf7c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:02.097575 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db9e3c-8e1a-4831-a6a5-adce9833e137 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:02.099235 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-31db9e3c-8e1a-4831-a6a5-adce9833e137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:02.105999 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:02.140918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7965f0-8e8a-4106-9531-69ff79176755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:02.141915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7965f0-8e8a-4106-9531-69ff79176755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:02.142205 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7965f0-8e8a-4106-9531-69ff79176755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:02.142495 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7965f0-8e8a-4106-9531-69ff79176755 admin admin] PATH_INFO: `/v3/projects/58bb3d02c5c043d39785a31a7ee33b35` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:02.143946 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7965f0-8e8a-4106-9531-69ff79176755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58bb3d02c5c043d39785a31a7ee33b35)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:02.146132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7965f0-8e8a-4106-9531-69ff79176755 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:02.192690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db9e3c-8e1a-4831-a6a5-adce9833e137 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:02.207989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-9d7965f0-8e8a-4106-9531-69ff79176755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58bb3d02c5c043d39785a31a7ee33b35', 'request_id': 'req-9d7965f0-8e8a-4106-9531-69ff79176755'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:02.215576 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-9d7965f0-8e8a-4106-9531-69ff79176755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58bb3d02c5c043d39785a31a7ee33b35', 'request_id': 'req-9d7965f0-8e8a-4106-9531-69ff79176755'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:02.225447 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-9d7965f0-8e8a-4106-9531-69ff79176755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58bb3d02c5c043d39785a31a7ee33b35', 'request_id': 'req-9d7965f0-8e8a-4106-9531-69ff79176755'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:02.240713 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-9d7965f0-8e8a-4106-9531-69ff79176755 admin admin] The token cache is being invalidate because project 58bb3d02c5c043d39785a31a7ee33b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:02.241010 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-9d7965f0-8e8a-4106-9531-69ff79176755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:02.241819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-9d7965f0-8e8a-4106-9531-69ff79176755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:02.245746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 986/1965] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:02 2022] DELETE /identity/v3/projects/58bb3d02c5c043d39785a31a7ee33b35 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:02.251359 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5fbfc-1e9c-4f00-b217-f28971caa5e4 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:02.251359 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5fbfc-1e9c-4f00-b217-f28971caa5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:02.251359 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5fbfc-1e9c-4f00-b217-f28971caa5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:02.272187 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550f8c2-fde6-4d80-877f-6a245b501489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:02.273055 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550f8c2-fde6-4d80-877f-6a245b501489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:02.273400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550f8c2-fde6-4d80-877f-6a245b501489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:02.273707 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550f8c2-fde6-4d80-877f-6a245b501489 admin admin] PATH_INFO: `/v3/users/2d87916b889f4c64a3f8b6594b4da436` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:02.273904 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-bdf5fbfc-1e9c-4f00-b217-f28971caa5e4 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:02.275202 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-bdf5fbfc-1e9c-4f00-b217-f28971caa5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:02.275786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550f8c2-fde6-4d80-877f-6a245b501489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d87916b889f4c64a3f8b6594b4da436)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:02.277830 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550f8c2-fde6-4d80-877f-6a245b501489 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:02.293498 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 987/1966] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:02.296338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222bc28-e9ed-4c85-8a35-32878da3c4ef None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:02.296810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222bc28-e9ed-4c85-8a35-32878da3c4ef None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:02.297481 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222bc28-e9ed-4c85-8a35-32878da3c4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:02.321696 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-4222bc28-e9ed-4c85-8a35-32878da3c4ef None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:02.323077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-4222bc28-e9ed-4c85-8a35-32878da3c4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:02.332851 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 988/1967] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:43:02.336588 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222bc28-e9ed-4c85-8a35-32878da3c4ef None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:02.338271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6550f8c2-fde6-4d80-877f-6a245b501489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d87916b889f4c64a3f8b6594b4da436'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:02.339506 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6550f8c2-fde6-4d80-877f-6a245b501489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d87916b889f4c64a3f8b6594b4da436'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:02.347830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222bc28-e9ed-4c85-8a35-32878da3c4ef None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:02.351587 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6550f8c2-fde6-4d80-877f-6a245b501489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d87916b889f4c64a3f8b6594b4da436'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:02.355399 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057e116-e7ae-4bbe-8ade-e9ed85a94f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:02.356600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057e116-e7ae-4bbe-8ade-e9ed85a94f24 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:02.357486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057e116-e7ae-4bbe-8ade-e9ed85a94f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:02.358118 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057e116-e7ae-4bbe-8ade-e9ed85a94f24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:02.359457 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057e116-e7ae-4bbe-8ade-e9ed85a94f24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:43:02.359966 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057e116-e7ae-4bbe-8ade-e9ed85a94f24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:02.362840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057e116-e7ae-4bbe-8ade-e9ed85a94f24 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:02.363408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6550f8c2-fde6-4d80-877f-6a245b501489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d87916b889f4c64a3f8b6594b4da436'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:02.379594 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 989/1968] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:43:02.384372 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057e116-e7ae-4bbe-8ade-e9ed85a94f24 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:02.387985 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6550f8c2-fde6-4d80-877f-6a245b501489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d87916b889f4c64a3f8b6594b4da436'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:02.396155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057e116-e7ae-4bbe-8ade-e9ed85a94f24 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:02.396709 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 980/1969] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:02 2022] DELETE /identity/v3/users/2d87916b889f4c64a3f8b6594b4da436 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:02.404928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:02.466595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc66ff-44ee-4e10-bb24-031d98b6c9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:02.467410 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc66ff-44ee-4e10-bb24-031d98b6c9f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:02.467543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc66ff-44ee-4e10-bb24-031d98b6c9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:02.467724 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acc66ff-44ee-4e10-bb24-031d98b6c9f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:02.468447 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc66ff-44ee-4e10-bb24-031d98b6c9f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:02.470415 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acc66ff-44ee-4e10-bb24-031d98b6c9f8 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:02.509293 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 990/1970] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:43:02 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:43:02.510702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550f8c2-fde6-4d80-877f-6a245b501489 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:02.512321 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6550f8c2-fde6-4d80-877f-6a245b501489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:02.525597 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550f8c2-fde6-4d80-877f-6a245b501489 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:02.556551 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:02.591347 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d8888-eb54-4a73-a605-e4b91038a461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:02.592018 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d8888-eb54-4a73-a605-e4b91038a461 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:02.592305 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d8888-eb54-4a73-a605-e4b91038a461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:02.592594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d8888-eb54-4a73-a605-e4b91038a461 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:02.593273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d8888-eb54-4a73-a605-e4b91038a461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:02.595225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d8888-eb54-4a73-a605-e4b91038a461 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:02.620700 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 981/1971] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:43:02 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:02.621971 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc66ff-44ee-4e10-bb24-031d98b6c9f8 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:02.632164 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acc66ff-44ee-4e10-bb24-031d98b6c9f8 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:02.637468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6f071-3d1f-4b2a-8d45-e66f383e1805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:02.638156 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6f071-3d1f-4b2a-8d45-e66f383e1805 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:02.638441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6f071-3d1f-4b2a-8d45-e66f383e1805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:02.638803 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6f071-3d1f-4b2a-8d45-e66f383e1805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:02.639533 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6f071-3d1f-4b2a-8d45-e66f383e1805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:02.641115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6f071-3d1f-4b2a-8d45-e66f383e1805 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:02.651707 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 991/1972] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:02.656067 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d8888-eb54-4a73-a605-e4b91038a461 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:02.666813 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d8888-eb54-4a73-a605-e4b91038a461 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:02.671898 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117aa798-a82e-4fee-8803-896395a99efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:02.672564 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aa798-a82e-4fee-8803-896395a99efc admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:02.672900 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aa798-a82e-4fee-8803-896395a99efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:02.673188 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117aa798-a82e-4fee-8803-896395a99efc admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:02.674477 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117aa798-a82e-4fee-8803-896395a99efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:02.676144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117aa798-a82e-4fee-8803-896395a99efc admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:02.690482 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 982/1973] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:02.691625 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6f071-3d1f-4b2a-8d45-e66f383e1805 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:02.716567 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6f071-3d1f-4b2a-8d45-e66f383e1805 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:02.721705 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70651805-6b45-4ac3-9472-54d9bc8188bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:02.722598 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70651805-6b45-4ac3-9472-54d9bc8188bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:02.722885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70651805-6b45-4ac3-9472-54d9bc8188bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:02.723158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70651805-6b45-4ac3-9472-54d9bc8188bc admin admin] PATH_INFO: `/v3/projects/19b9a8086b7f49a8b9f04f8c213cafc4/users/76746afb22ed454bab30765e961db2ea/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:02.740078 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70651805-6b45-4ac3-9472-54d9bc8188bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b9a8086b7f49a8b9f04f8c213cafc4, user_id=76746afb22ed454bab30765e961db2ea, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:02.742676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70651805-6b45-4ac3-9472-54d9bc8188bc admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:02.760194 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 992/1974] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:02 2022] PUT /identity/v3/projects/19b9a8086b7f49a8b9f04f8c213cafc4/users/76746afb22ed454bab30765e961db2ea/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:02.770645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d7395-dad0-4ff4-b58a-f5500148168d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:02.770938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d7395-dad0-4ff4-b58a-f5500148168d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:02.771226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d7395-dad0-4ff4-b58a-f5500148168d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:02.800022 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9e9d7395-dad0-4ff4-b58a-f5500148168d None None] MFA Rules not processed for user `76746afb22ed454bab30765e961db2ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:02.801248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9e9d7395-dad0-4ff4-b58a-f5500148168d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:02.872895 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70651805-6b45-4ac3-9472-54d9bc8188bc admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:02.876518 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-70651805-6b45-4ac3-9472-54d9bc8188bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:02.908578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 983/1975] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:43:02.910173 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929bb6a-e101-4015-917a-772d9951bb5b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:02.910727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929bb6a-e101-4015-917a-772d9951bb5b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:02.911188 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929bb6a-e101-4015-917a-772d9951bb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:02.947146 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b929bb6a-e101-4015-917a-772d9951bb5b None None] MFA Rules not processed for user `de843beff4dd401fb34b34ab83f6f7f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:02.948463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b929bb6a-e101-4015-917a-772d9951bb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:02.965318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70651805-6b45-4ac3-9472-54d9bc8188bc admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:02.972230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8f3d1-ff92-4f09-9075-834cd434e5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:02.973334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8f3d1-ff92-4f09-9075-834cd434e5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:02.973833 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8f3d1-ff92-4f09-9075-834cd434e5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:02.974294 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8f3d1-ff92-4f09-9075-834cd434e5ff admin admin] PATH_INFO: `/v3/projects/dd8fa6d18cca46f0a01bdc714032acbd` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:02.975709 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d8f3d1-ff92-4f09-9075-834cd434e5ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd8fa6d18cca46f0a01bdc714032acbd)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:02.978612 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d8f3d1-ff92-4f09-9075-834cd434e5ff admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:03.048867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f9d8f3d1-ff92-4f09-9075-834cd434e5ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd8fa6d18cca46f0a01bdc714032acbd', 'request_id': 'req-f9d8f3d1-ff92-4f09-9075-834cd434e5ff'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:03.057048 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f9d8f3d1-ff92-4f09-9075-834cd434e5ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd8fa6d18cca46f0a01bdc714032acbd', 'request_id': 'req-f9d8f3d1-ff92-4f09-9075-834cd434e5ff'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:03.060703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:03.069708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f9d8f3d1-ff92-4f09-9075-834cd434e5ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd8fa6d18cca46f0a01bdc714032acbd', 'request_id': 'req-f9d8f3d1-ff92-4f09-9075-834cd434e5ff'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:03.075790 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 984/1976] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:03.075790 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929bb6a-e101-4015-917a-772d9951bb5b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:03.090029 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929bb6a-e101-4015-917a-772d9951bb5b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:03.099956 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f9d8f3d1-ff92-4f09-9075-834cd434e5ff admin admin] The token cache is being invalidate because project dd8fa6d18cca46f0a01bdc714032acbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:03.100311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f9d8f3d1-ff92-4f09-9075-834cd434e5ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:03.101172 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f9d8f3d1-ff92-4f09-9075-834cd434e5ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:03.105048 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 993/1977] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:02 2022] DELETE /identity/v3/projects/dd8fa6d18cca46f0a01bdc714032acbd => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:03.106230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8f3d1-ff92-4f09-9075-834cd434e5ff admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:03.108529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-f9d8f3d1-ff92-4f09-9075-834cd434e5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:03.119881 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:03.162828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6998ee5-f393-4193-81b0-47e7943a842c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:03.164026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6998ee5-f393-4193-81b0-47e7943a842c admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:03.164145 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6998ee5-f393-4193-81b0-47e7943a842c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:03.164401 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6998ee5-f393-4193-81b0-47e7943a842c admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:03.173426 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6998ee5-f393-4193-81b0-47e7943a842c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:03.173426 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6998ee5-f393-4193-81b0-47e7943a842c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:03.198245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 985/1978] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:43:03 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:03.205889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d5659-3f61-4b4e-8d88-ba548a6ad8f3 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:03.206392 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d5659-3f61-4b4e-8d88-ba548a6ad8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:03.206870 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d5659-3f61-4b4e-8d88-ba548a6ad8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:03.229602 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8f3d1-ff92-4f09-9075-834cd434e5ff admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:03.230264 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-df6d5659-3f61-4b4e-8d88-ba548a6ad8f3 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:03.231671 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-df6d5659-3f61-4b4e-8d88-ba548a6ad8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:03.288339 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac168e5-0b59-4570-82a7-45a33711350b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:03.289031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac168e5-0b59-4570-82a7-45a33711350b service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:03.289319 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac168e5-0b59-4570-82a7-45a33711350b service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:03.289722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac168e5-0b59-4570-82a7-45a33711350b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:03.292179 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-4ac168e5-0b59-4570-82a7-45a33711350b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:03.312217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 986/1979] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:03.314552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d5659-3f61-4b4e-8d88-ba548a6ad8f3 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:03.315752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-df6d5659-3f61-4b4e-8d88-ba548a6ad8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:03.327906 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d5659-3f61-4b4e-8d88-ba548a6ad8f3 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:03.333070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bea966-071a-426b-85c4-1ff26f171229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:03.334097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bea966-071a-426b-85c4-1ff26f171229 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:03.334097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bea966-071a-426b-85c4-1ff26f171229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:03.334366 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bea966-071a-426b-85c4-1ff26f171229 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:03.335062 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bea966-071a-426b-85c4-1ff26f171229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:03.337567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bea966-071a-426b-85c4-1ff26f171229 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:03.364325 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 987/1980] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:43:03 2022] POST /identity/v3/users => generated 300 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:03.364522 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac168e5-0b59-4570-82a7-45a33711350b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:03.364722 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c4ee0-ca39-4448-b181-e98272944dea None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:03.364722 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c4ee0-ca39-4448-b181-e98272944dea None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:03.364722 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c4ee0-ca39-4448-b181-e98272944dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:03.364994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac168e5-0b59-4570-82a7-45a33711350b service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:03.379937 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 994/1981] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:43:03.379937 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac168e5-0b59-4570-82a7-45a33711350b service cinder] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:03.384352 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-da8c4ee0-ca39-4448-b181-e98272944dea None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:03.385738 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-da8c4ee0-ca39-4448-b181-e98272944dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:03.392262 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac168e5-0b59-4570-82a7-45a33711350b service cinder] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:03.397761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 988/1982] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:03.403379 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c4ee0-ca39-4448-b181-e98272944dea None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:03.414221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4d4d6-f3a1-4e05-9839-796098ff8687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:03.415773 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4d4d6-f3a1-4e05-9839-796098ff8687 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:03.415947 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4d4d6-f3a1-4e05-9839-796098ff8687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:03.416444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4d4d6-f3a1-4e05-9839-796098ff8687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:03.417018 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c4ee0-ca39-4448-b181-e98272944dea None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:03.418111 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4d4d6-f3a1-4e05-9839-796098ff8687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:03.419691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b4d4d6-f3a1-4e05-9839-796098ff8687 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:03.422555 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1681ba-aaa4-4162-aa28-419a3a215f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:03.423315 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1681ba-aaa4-4162-aa28-419a3a215f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:03.423739 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1681ba-aaa4-4162-aa28-419a3a215f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:03.424099 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1681ba-aaa4-4162-aa28-419a3a215f51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:03.424908 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1681ba-aaa4-4162-aa28-419a3a215f51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:43:03.425289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1681ba-aaa4-4162-aa28-419a3a215f51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:03.427194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1681ba-aaa4-4162-aa28-419a3a215f51 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:03.430458 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 995/1983] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:03.434696 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4d4d6-f3a1-4e05-9839-796098ff8687 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:03.440690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 989/1984] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:43:03.444649 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1681ba-aaa4-4162-aa28-419a3a215f51 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:03.445187 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4d4d6-f3a1-4e05-9839-796098ff8687 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:03.449949 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343d501-850e-4272-ae70-62380297a191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:03.450867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343d501-850e-4272-ae70-62380297a191 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:03.451153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343d501-850e-4272-ae70-62380297a191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:03.451470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8343d501-850e-4272-ae70-62380297a191 admin admin] PATH_INFO: `/v3/projects/78c679613cf04a5c94c3006f0214ed35/users/e167bef0faf447a0a1cf7ab60ce7e2bb/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:03.457222 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1681ba-aaa4-4162-aa28-419a3a215f51 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:03.463378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35ae33-b993-4867-81b6-cea7b5ed60ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:03.464036 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35ae33-b993-4867-81b6-cea7b5ed60ac admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:03.464328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35ae33-b993-4867-81b6-cea7b5ed60ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:03.464607 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35ae33-b993-4867-81b6-cea7b5ed60ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:03.465368 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35ae33-b993-4867-81b6-cea7b5ed60ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:03.467495 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea35ae33-b993-4867-81b6-cea7b5ed60ac admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:03.468960 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343d501-850e-4272-ae70-62380297a191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c679613cf04a5c94c3006f0214ed35, user_id=e167bef0faf447a0a1cf7ab60ce7e2bb, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:03.471679 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8343d501-850e-4272-ae70-62380297a191 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:03.489516 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 996/1985] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:03 2022] PUT /identity/v3/projects/78c679613cf04a5c94c3006f0214ed35/users/e167bef0faf447a0a1cf7ab60ce7e2bb/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:03.490465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343d501-850e-4272-ae70-62380297a191 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:03.507682 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 990/1986] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:43:03 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:43:03.509647 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35ae33-b993-4867-81b6-cea7b5ed60ac admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:03.518731 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:03.565236 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8343d501-850e-4272-ae70-62380297a191 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:03.578763 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:03.595279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35ae33-b993-4867-81b6-cea7b5ed60ac admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:03.600623 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21565a8c-bd27-405d-bf3c-aaae9e341c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:03.601304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21565a8c-bd27-405d-bf3c-aaae9e341c6a admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:03.601623 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21565a8c-bd27-405d-bf3c-aaae9e341c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:03.601907 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21565a8c-bd27-405d-bf3c-aaae9e341c6a admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:03.602662 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21565a8c-bd27-405d-bf3c-aaae9e341c6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:03.604889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21565a8c-bd27-405d-bf3c-aaae9e341c6a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:03.628385 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 991/1987] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:43:03 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:03.634856 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21565a8c-bd27-405d-bf3c-aaae9e341c6a admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:03.643167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f6683-abee-4220-9500-9ee1233b9f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:03.644191 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f6683-abee-4220-9500-9ee1233b9f34 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:03.644764 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f6683-abee-4220-9500-9ee1233b9f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:03.645446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f6683-abee-4220-9500-9ee1233b9f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:03.646216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f6683-abee-4220-9500-9ee1233b9f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:03.647810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f6683-abee-4220-9500-9ee1233b9f34 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:03.648029 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21565a8c-bd27-405d-bf3c-aaae9e341c6a admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:03.655269 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966d44e-70be-484b-a236-8d3a877a1647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:03.656357 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966d44e-70be-484b-a236-8d3a877a1647 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:03.656615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966d44e-70be-484b-a236-8d3a877a1647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:03.656916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966d44e-70be-484b-a236-8d3a877a1647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:03.657749 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966d44e-70be-484b-a236-8d3a877a1647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:03.659397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966d44e-70be-484b-a236-8d3a877a1647 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:03.663535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 997/1988] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:03.667270 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f6683-abee-4220-9500-9ee1233b9f34 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:03.672940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 992/1989] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:03.680431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966d44e-70be-484b-a236-8d3a877a1647 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:03.687224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f6683-abee-4220-9500-9ee1233b9f34 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:03.693403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af996b-e962-4961-a1ab-b767e8fb59a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:03.694301 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966d44e-70be-484b-a236-8d3a877a1647 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:03.694414 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af996b-e962-4961-a1ab-b767e8fb59a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:03.694602 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af996b-e962-4961-a1ab-b767e8fb59a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:03.695294 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af996b-e962-4961-a1ab-b767e8fb59a8 admin admin] PATH_INFO: `/v3/projects/78c679613cf04a5c94c3006f0214ed35/users/e167bef0faf447a0a1cf7ab60ce7e2bb/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:03.697563 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af996b-e962-4961-a1ab-b767e8fb59a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c679613cf04a5c94c3006f0214ed35, user_id=e167bef0faf447a0a1cf7ab60ce7e2bb, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:03.700202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bff1bd-8142-4b5f-9c25-f894e407515a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:03.700325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af996b-e962-4961-a1ab-b767e8fb59a8 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:03.700863 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bff1bd-8142-4b5f-9c25-f894e407515a admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:03.701197 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bff1bd-8142-4b5f-9c25-f894e407515a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:03.701510 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bff1bd-8142-4b5f-9c25-f894e407515a admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:03.702237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bff1bd-8142-4b5f-9c25-f894e407515a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:03.704170 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bff1bd-8142-4b5f-9c25-f894e407515a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:03.724068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 998/1990] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:03 2022] PUT /identity/v3/projects/78c679613cf04a5c94c3006f0214ed35/users/e167bef0faf447a0a1cf7ab60ce7e2bb/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:03.724404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 993/1991] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:43:03.724482 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af996b-e962-4961-a1ab-b767e8fb59a8 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:03.725740 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353fa11-e6ff-4f90-a413-eff3351396e2 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:03.726017 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353fa11-e6ff-4f90-a413-eff3351396e2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:03.726538 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353fa11-e6ff-4f90-a413-eff3351396e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:03.768162 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9353fa11-e6ff-4f90-a413-eff3351396e2 None None] MFA Rules not processed for user `e167bef0faf447a0a1cf7ab60ce7e2bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:03.769407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9353fa11-e6ff-4f90-a413-eff3351396e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:03.802593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af996b-e962-4961-a1ab-b767e8fb59a8 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:03.808255 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25fba0-6bbe-4033-be91-0bf1a05d6322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:03.809148 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25fba0-6bbe-4033-be91-0bf1a05d6322 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:03.809506 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25fba0-6bbe-4033-be91-0bf1a05d6322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:03.809786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25fba0-6bbe-4033-be91-0bf1a05d6322 admin admin] PATH_INFO: `/v3/projects/e359b46e90f64d0baee4cfcb43173075/users/063c123ea7cf40d0acc9f46901f2fcb1/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:03.830903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25fba0-6bbe-4033-be91-0bf1a05d6322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e359b46e90f64d0baee4cfcb43173075, user_id=063c123ea7cf40d0acc9f46901f2fcb1, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:03.833668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25fba0-6bbe-4033-be91-0bf1a05d6322 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:03.847688 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 999/1992] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:03 2022] PUT /identity/v3/projects/e359b46e90f64d0baee4cfcb43173075/users/063c123ea7cf40d0acc9f46901f2fcb1/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:03.857157 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 994/1993] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:43:03.862613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f1049-667b-47d3-bfb7-4738e1abfebf None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:03.862903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f1049-667b-47d3-bfb7-4738e1abfebf None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:03.863183 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f1049-667b-47d3-bfb7-4738e1abfebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:03.870657 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353fa11-e6ff-4f90-a413-eff3351396e2 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:03.900362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-d34f1049-667b-47d3-bfb7-4738e1abfebf None None] MFA Rules not processed for user `063c123ea7cf40d0acc9f46901f2fcb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:03.901621 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-d34f1049-667b-47d3-bfb7-4738e1abfebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:03.928173 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353fa11-e6ff-4f90-a413-eff3351396e2 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:03.928908 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:03.970133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1000/1994] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:03.974593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f1049-667b-47d3-bfb7-4738e1abfebf None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:03.982644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9708e-6842-4736-b58f-f5b51d22609f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:03.983279 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9708e-6842-4736-b58f-f5b51d22609f service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:03.983567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9708e-6842-4736-b58f-f5b51d22609f service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:03.983874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9708e-6842-4736-b58f-f5b51d22609f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:03.997511 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:04.037770 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f1049-667b-47d3-bfb7-4738e1abfebf None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:04.042530 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c722038-116a-47d7-92a9-995b0dd02d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:04.043185 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c722038-116a-47d7-92a9-995b0dd02d40 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:04.043464 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c722038-116a-47d7-92a9-995b0dd02d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:04.043739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c722038-116a-47d7-92a9-995b0dd02d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:04.044420 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c722038-116a-47d7-92a9-995b0dd02d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:04.046354 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c722038-116a-47d7-92a9-995b0dd02d40 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:04.048980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9708e-6842-4736-b58f-f5b51d22609f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:04.050462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9708e-6842-4736-b58f-f5b51d22609f service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:04.061457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 995/1995] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:43:04.076948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1001/1996] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:43:03 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:43:04.078103 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9708e-6842-4736-b58f-f5b51d22609f service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:04.089827 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9708e-6842-4736-b58f-f5b51d22609f service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:04.129436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c722038-116a-47d7-92a9-995b0dd02d40 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:04.150720 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb7071-c4b9-42dd-b639-6bd520cbc741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:04.151391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb7071-c4b9-42dd-b639-6bd520cbc741 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:04.151678 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb7071-c4b9-42dd-b639-6bd520cbc741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:04.151961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb7071-c4b9-42dd-b639-6bd520cbc741 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:04.152648 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb7071-c4b9-42dd-b639-6bd520cbc741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:04.154678 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb7071-c4b9-42dd-b639-6bd520cbc741 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:04.179175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 996/1997] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:43:04 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:43:04.180224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb7071-c4b9-42dd-b639-6bd520cbc741 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:04.192262 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb7071-c4b9-42dd-b639-6bd520cbc741 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:04.199181 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443d7ab-eb8d-4865-91b3-757df85261e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:04.200146 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443d7ab-eb8d-4865-91b3-757df85261e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:04.200433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443d7ab-eb8d-4865-91b3-757df85261e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:04.200711 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443d7ab-eb8d-4865-91b3-757df85261e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:04.201462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443d7ab-eb8d-4865-91b3-757df85261e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:04.203055 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443d7ab-eb8d-4865-91b3-757df85261e5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:04.204135 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c722038-116a-47d7-92a9-995b0dd02d40 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:04.210727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21572b4-f3da-4ed4-8181-6d9aa44fadfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:04.211650 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21572b4-f3da-4ed4-8181-6d9aa44fadfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:04.211935 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21572b4-f3da-4ed4-8181-6d9aa44fadfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:04.212214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21572b4-f3da-4ed4-8181-6d9aa44fadfe admin admin] PATH_INFO: `/v3/users/76746afb22ed454bab30765e961db2ea` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:04.213605 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21572b4-f3da-4ed4-8181-6d9aa44fadfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=76746afb22ed454bab30765e961db2ea)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:04.217425 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 997/1998] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:43:04.217559 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21572b4-f3da-4ed4-8181-6d9aa44fadfe admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:04.218882 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443d7ab-eb8d-4865-91b3-757df85261e5 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:04.230240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443d7ab-eb8d-4865-91b3-757df85261e5 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:04.235982 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cf707-40dc-47ea-a532-a098a025d70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:04.236787 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cf707-40dc-47ea-a532-a098a025d70e admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:04.237084 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cf707-40dc-47ea-a532-a098a025d70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:04.237357 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cf707-40dc-47ea-a532-a098a025d70e admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:04.238108 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2cf707-40dc-47ea-a532-a098a025d70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:04.240216 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2cf707-40dc-47ea-a532-a098a025d70e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:04.253492 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 998/1999] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:43:04.257411 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cf707-40dc-47ea-a532-a098a025d70e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:04.268445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cf707-40dc-47ea-a532-a098a025d70e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:04.273629 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f444b920-55d9-4453-b44d-52460bdf1553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:04.274896 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-e21572b4-f3da-4ed4-8181-6d9aa44fadfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76746afb22ed454bab30765e961db2ea'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:04.275138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-e21572b4-f3da-4ed4-8181-6d9aa44fadfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76746afb22ed454bab30765e961db2ea'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:04.275250 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444b920-55d9-4453-b44d-52460bdf1553 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:04.275431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444b920-55d9-4453-b44d-52460bdf1553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:04.275710 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f444b920-55d9-4453-b44d-52460bdf1553 admin admin] PATH_INFO: `/v3/projects/d45798f4e757408198ac20ae6c64d860/users/be1b091823b044d6b88b24718088e315/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:04.284206 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-e21572b4-f3da-4ed4-8181-6d9aa44fadfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76746afb22ed454bab30765e961db2ea'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:04.285794 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:04.294059 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444b920-55d9-4453-b44d-52460bdf1553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d45798f4e757408198ac20ae6c64d860, user_id=be1b091823b044d6b88b24718088e315, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:04.296854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-e21572b4-f3da-4ed4-8181-6d9aa44fadfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76746afb22ed454bab30765e961db2ea'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:04.297011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f444b920-55d9-4453-b44d-52460bdf1553 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:04.312421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-e21572b4-f3da-4ed4-8181-6d9aa44fadfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76746afb22ed454bab30765e961db2ea'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:04.318229 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 999/2000] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:04 2022] PUT /identity/v3/projects/d45798f4e757408198ac20ae6c64d860/users/be1b091823b044d6b88b24718088e315/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:04.322042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1002/2001] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:04 2022] DELETE /identity/v3/users/76746afb22ed454bab30765e961db2ea => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:04.327148 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f657a5-837b-4fb4-a3fe-78469039b5a7 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:04.327444 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f657a5-837b-4fb4-a3fe-78469039b5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:04.327725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f657a5-837b-4fb4-a3fe-78469039b5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:04.328744 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20d70d-a837-47c6-be7a-631528b90394 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:04.329047 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20d70d-a837-47c6-be7a-631528b90394 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:04.329336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20d70d-a837-47c6-be7a-631528b90394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:04.345966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d5f657a5-837b-4fb4-a3fe-78469039b5a7 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:04.347309 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d5f657a5-837b-4fb4-a3fe-78469039b5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:04.361115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-7c20d70d-a837-47c6-be7a-631528b90394 None None] MFA Rules not processed for user `be1b091823b044d6b88b24718088e315`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:04.362463 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7c20d70d-a837-47c6-be7a-631528b90394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:04.402455 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:04.415703 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1000/2002] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:43:04.425215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f657a5-837b-4fb4-a3fe-78469039b5a7 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:04.426832 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d5f657a5-837b-4fb4-a3fe-78469039b5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:04.434818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1003/2003] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:43:04.439888 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20d70d-a837-47c6-be7a-631528b90394 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:04.443864 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7c20d70d-a837-47c6-be7a-631528b90394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:04.455547 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20d70d-a837-47c6-be7a-631528b90394 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:04.460282 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b9b9c-c2eb-4d38-a339-a84b6f7f97c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:04.460938 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b9b9c-c2eb-4d38-a339-a84b6f7f97c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:04.461225 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b9b9c-c2eb-4d38-a339-a84b6f7f97c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:04.462216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b9b9c-c2eb-4d38-a339-a84b6f7f97c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:04.462911 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b9b9c-c2eb-4d38-a339-a84b6f7f97c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:04.464812 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b9b9c-c2eb-4d38-a339-a84b6f7f97c7 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:04.486103 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f657a5-837b-4fb4-a3fe-78469039b5a7 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:04.489785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18360e-bad3-41c4-897b-0a84e58a0077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:04.490294 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1004/2004] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:43:04 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:04.490498 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18360e-bad3-41c4-897b-0a84e58a0077 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:04.490786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18360e-bad3-41c4-897b-0a84e58a0077 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:04.491063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18360e-bad3-41c4-897b-0a84e58a0077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:04.494264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b9b9c-c2eb-4d38-a339-a84b6f7f97c7 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:04.500720 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18360e-bad3-41c4-897b-0a84e58a0077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:04.502208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18360e-bad3-41c4-897b-0a84e58a0077 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:04.513069 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1001/2005] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:43:04.562005 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b9b9c-c2eb-4d38-a339-a84b6f7f97c7 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:04.567534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb203b5-8ccf-4082-8625-764390c3b154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:04.568228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb203b5-8ccf-4082-8625-764390c3b154 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:04.568534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb203b5-8ccf-4082-8625-764390c3b154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:04.568808 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb203b5-8ccf-4082-8625-764390c3b154 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:04.569566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb203b5-8ccf-4082-8625-764390c3b154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:04.572433 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb203b5-8ccf-4082-8625-764390c3b154 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:04.592847 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1005/2006] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:43:04 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:43:04.596927 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18360e-bad3-41c4-897b-0a84e58a0077 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:04.608166 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18360e-bad3-41c4-897b-0a84e58a0077 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:04.613421 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bbfa8-ab9c-4d35-afcb-b1f5eff0ea0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:04.614089 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bbfa8-ab9c-4d35-afcb-b1f5eff0ea0c admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:04.614378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bbfa8-ab9c-4d35-afcb-b1f5eff0ea0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:04.614658 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bbfa8-ab9c-4d35-afcb-b1f5eff0ea0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:04.615391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50bbfa8-ab9c-4d35-afcb-b1f5eff0ea0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:04.617001 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50bbfa8-ab9c-4d35-afcb-b1f5eff0ea0c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:04.630636 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1002/2007] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:04.632249 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb203b5-8ccf-4082-8625-764390c3b154 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:04.644378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb203b5-8ccf-4082-8625-764390c3b154 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:04.649514 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1898c-4342-4187-ad6b-72441aff5ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:04.650396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1898c-4342-4187-ad6b-72441aff5ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:04.650680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1898c-4342-4187-ad6b-72441aff5ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:04.650955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1898c-4342-4187-ad6b-72441aff5ffc admin admin] PATH_INFO: `/v3/projects/eaa2681228bb4d58b22101a9bab49d5b/users/702e3760f5a948b3b1a5f2f92f2f11db/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:04.669919 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1898c-4342-4187-ad6b-72441aff5ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa2681228bb4d58b22101a9bab49d5b, user_id=702e3760f5a948b3b1a5f2f92f2f11db, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:04.672626 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1898c-4342-4187-ad6b-72441aff5ffc admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:04.687782 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1006/2008] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:04 2022] PUT /identity/v3/projects/eaa2681228bb4d58b22101a9bab49d5b/users/702e3760f5a948b3b1a5f2f92f2f11db/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:04.691517 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bbfa8-ab9c-4d35-afcb-b1f5eff0ea0c admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:04.702087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bbfa8-ab9c-4d35-afcb-b1f5eff0ea0c admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:04.761285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89820a-caf4-44d6-85b3-0cf58013c13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:04.761862 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89820a-caf4-44d6-85b3-0cf58013c13e admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:04.762161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89820a-caf4-44d6-85b3-0cf58013c13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:04.762381 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff89820a-caf4-44d6-85b3-0cf58013c13e admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:04.763234 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89820a-caf4-44d6-85b3-0cf58013c13e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:04.764805 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff89820a-caf4-44d6-85b3-0cf58013c13e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:04.783138 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1003/2009] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:04.789504 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1898c-4342-4187-ad6b-72441aff5ffc admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:04.801059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:04.804535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1898c-4342-4187-ad6b-72441aff5ffc admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:04.806029 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89820a-caf4-44d6-85b3-0cf58013c13e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:04.808463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ff89820a-caf4-44d6-85b3-0cf58013c13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:04.823569 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56131477-0792-4353-913f-5c3a177d8a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:04.824614 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56131477-0792-4353-913f-5c3a177d8a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:04.824902 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56131477-0792-4353-913f-5c3a177d8a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:04.825177 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56131477-0792-4353-913f-5c3a177d8a25 admin admin] PATH_INFO: `/v3/projects/eaa2681228bb4d58b22101a9bab49d5b/users/702e3760f5a948b3b1a5f2f92f2f11db/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:04.827227 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56131477-0792-4353-913f-5c3a177d8a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa2681228bb4d58b22101a9bab49d5b, user_id=702e3760f5a948b3b1a5f2f92f2f11db, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:04.830696 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56131477-0792-4353-913f-5c3a177d8a25 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:04.830835 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff89820a-caf4-44d6-85b3-0cf58013c13e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:04.837568 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fc170-7b62-471b-927b-fb6df557ba04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:04.838272 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fc170-7b62-471b-927b-fb6df557ba04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:04.838556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fc170-7b62-471b-927b-fb6df557ba04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:04.838892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fc170-7b62-471b-927b-fb6df557ba04 admin admin] PATH_INFO: `/v3/projects/19b9a8086b7f49a8b9f04f8c213cafc4` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:04.840227 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900fc170-7b62-471b-927b-fb6df557ba04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b9a8086b7f49a8b9f04f8c213cafc4)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:04.841942 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1007/2010] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:04 2022] PUT /identity/v3/projects/eaa2681228bb4d58b22101a9bab49d5b/users/702e3760f5a948b3b1a5f2f92f2f11db/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:04.842214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900fc170-7b62-471b-927b-fb6df557ba04 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:04.851848 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064da02e-d429-41e5-9476-ac7b0928280b None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:04.852170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064da02e-d429-41e5-9476-ac7b0928280b None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:04.852522 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064da02e-d429-41e5-9476-ac7b0928280b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:04.881713 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-064da02e-d429-41e5-9476-ac7b0928280b None None] MFA Rules not processed for user `702e3760f5a948b3b1a5f2f92f2f11db`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:04.882975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-064da02e-d429-41e5-9476-ac7b0928280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:04.892557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-900fc170-7b62-471b-927b-fb6df557ba04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b9a8086b7f49a8b9f04f8c213cafc4', 'request_id': 'req-900fc170-7b62-471b-927b-fb6df557ba04'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:04.898402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-900fc170-7b62-471b-927b-fb6df557ba04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b9a8086b7f49a8b9f04f8c213cafc4', 'request_id': 'req-900fc170-7b62-471b-927b-fb6df557ba04'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:04.907566 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-900fc170-7b62-471b-927b-fb6df557ba04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b9a8086b7f49a8b9f04f8c213cafc4', 'request_id': 'req-900fc170-7b62-471b-927b-fb6df557ba04'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:04.920730 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-900fc170-7b62-471b-927b-fb6df557ba04 admin admin] The token cache is being invalidate because project 19b9a8086b7f49a8b9f04f8c213cafc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:04.921018 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-900fc170-7b62-471b-927b-fb6df557ba04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:04.921690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-900fc170-7b62-471b-927b-fb6df557ba04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:04.923261 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1004/2011] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:04 2022] DELETE /identity/v3/projects/19b9a8086b7f49a8b9f04f8c213cafc4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:04.927145 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fc170-7b62-471b-927b-fb6df557ba04 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:04.928509 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-900fc170-7b62-471b-927b-fb6df557ba04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:04.937926 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:04.959521 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1008/2012] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:43:04.967755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064da02e-d429-41e5-9476-ac7b0928280b None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:04.969123 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-064da02e-d429-41e5-9476-ac7b0928280b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:04.995983 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fc170-7b62-471b-927b-fb6df557ba04 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:05.000734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b805e20-843d-4a5f-ac4d-8c172ae35a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:05.001673 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b805e20-843d-4a5f-ac4d-8c172ae35a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:05.001962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b805e20-843d-4a5f-ac4d-8c172ae35a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:05.002242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b805e20-843d-4a5f-ac4d-8c172ae35a50 admin admin] PATH_INFO: `/v3/users/e167bef0faf447a0a1cf7ab60ce7e2bb` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:05.003461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b805e20-843d-4a5f-ac4d-8c172ae35a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e167bef0faf447a0a1cf7ab60ce7e2bb)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:05.005425 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b805e20-843d-4a5f-ac4d-8c172ae35a50 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:05.027149 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064da02e-d429-41e5-9476-ac7b0928280b None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:05.031728 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04946e38-8658-4033-ac17-1636029dd6b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:05.032400 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04946e38-8658-4033-ac17-1636029dd6b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:05.032669 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04946e38-8658-4033-ac17-1636029dd6b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:05.032981 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04946e38-8658-4033-ac17-1636029dd6b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:05.044153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04946e38-8658-4033-ac17-1636029dd6b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:05.045618 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04946e38-8658-4033-ac17-1636029dd6b7 service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:05.053248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0b805e20-843d-4a5f-ac4d-8c172ae35a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e167bef0faf447a0a1cf7ab60ce7e2bb'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:05.053964 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0b805e20-843d-4a5f-ac4d-8c172ae35a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e167bef0faf447a0a1cf7ab60ce7e2bb'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:05.055093 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1009/2013] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:43:05.062009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0b805e20-843d-4a5f-ac4d-8c172ae35a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e167bef0faf447a0a1cf7ab60ce7e2bb'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:05.069082 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0b805e20-843d-4a5f-ac4d-8c172ae35a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e167bef0faf447a0a1cf7ab60ce7e2bb'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:05.086450 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0b805e20-843d-4a5f-ac4d-8c172ae35a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e167bef0faf447a0a1cf7ab60ce7e2bb'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:05.093726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1005/2014] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:04 2022] DELETE /identity/v3/users/e167bef0faf447a0a1cf7ab60ce7e2bb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:05.094381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04946e38-8658-4033-ac17-1636029dd6b7 service cinder] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:05.095912 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-04946e38-8658-4033-ac17-1636029dd6b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:05.107840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04946e38-8658-4033-ac17-1636029dd6b7 service cinder] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:05.162142 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ff90e-ab35-4852-9f56-c611b90f454a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:05.162894 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ff90e-ab35-4852-9f56-c611b90f454a service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:05.163210 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ff90e-ab35-4852-9f56-c611b90f454a service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:05.163618 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ff90e-ab35-4852-9f56-c611b90f454a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:05.166485 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-5e2ff90e-ab35-4852-9f56-c611b90f454a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:05.202171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:05.229871 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ff90e-ab35-4852-9f56-c611b90f454a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:05.231296 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ff90e-ab35-4852-9f56-c611b90f454a service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:05.240971 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1010/2015] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:43:05.383275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b805e20-843d-4a5f-ac4d-8c172ae35a50 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:05.385875 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0b805e20-843d-4a5f-ac4d-8c172ae35a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:05.484515 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b805e20-843d-4a5f-ac4d-8c172ae35a50 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:05.490208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba9a87-9477-4463-b036-ca4f353ba243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:05.491166 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba9a87-9477-4463-b036-ca4f353ba243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:05.491546 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba9a87-9477-4463-b036-ca4f353ba243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:05.491863 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba9a87-9477-4463-b036-ca4f353ba243 admin admin] PATH_INFO: `/v3/projects/78c679613cf04a5c94c3006f0214ed35` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:05.493199 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba9a87-9477-4463-b036-ca4f353ba243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c679613cf04a5c94c3006f0214ed35)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:05.495455 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba9a87-9477-4463-b036-ca4f353ba243 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:05.542809 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:05.565107 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-08ba9a87-9477-4463-b036-ca4f353ba243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c679613cf04a5c94c3006f0214ed35', 'request_id': 'req-08ba9a87-9477-4463-b036-ca4f353ba243'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:05.571943 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-08ba9a87-9477-4463-b036-ca4f353ba243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c679613cf04a5c94c3006f0214ed35', 'request_id': 'req-08ba9a87-9477-4463-b036-ca4f353ba243'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:05.597584 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-08ba9a87-9477-4463-b036-ca4f353ba243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c679613cf04a5c94c3006f0214ed35', 'request_id': 'req-08ba9a87-9477-4463-b036-ca4f353ba243'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:05.605491 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-08ba9a87-9477-4463-b036-ca4f353ba243 admin admin] The token cache is being invalidate because project 78c679613cf04a5c94c3006f0214ed35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:05.606068 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-08ba9a87-9477-4463-b036-ca4f353ba243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:05.606738 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-08ba9a87-9477-4463-b036-ca4f353ba243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:05.608639 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1006/2016] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:05 2022] DELETE /identity/v3/projects/78c679613cf04a5c94c3006f0214ed35 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:05.614063 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ad5f4-c46f-4c52-bbfd-0abeca839c5f None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:05.614556 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ad5f4-c46f-4c52-bbfd-0abeca839c5f None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:05.614853 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ad5f4-c46f-4c52-bbfd-0abeca839c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:05.634996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-764ad5f4-c46f-4c52-bbfd-0abeca839c5f None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:05.636320 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-764ad5f4-c46f-4c52-bbfd-0abeca839c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:05.702128 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1011/2017] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:43:05.709617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f5d71-1231-428d-81c2-ca3d826f48f4 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:05.709914 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f5d71-1231-428d-81c2-ca3d826f48f4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:05.710194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f5d71-1231-428d-81c2-ca3d826f48f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:05.729439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-425f5d71-1231-428d-81c2-ca3d826f48f4 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:05.730673 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-425f5d71-1231-428d-81c2-ca3d826f48f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:05.738460 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1007/2018] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:05.742437 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ad5f4-c46f-4c52-bbfd-0abeca839c5f None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:05.752278 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ad5f4-c46f-4c52-bbfd-0abeca839c5f None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:05.756820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83fd4b-c1a2-4889-9cf4-f1132f94a8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:05.757516 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83fd4b-c1a2-4889-9cf4-f1132f94a8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:05.757785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83fd4b-c1a2-4889-9cf4-f1132f94a8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:05.758059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83fd4b-c1a2-4889-9cf4-f1132f94a8e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:05.759325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83fd4b-c1a2-4889-9cf4-f1132f94a8e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:43:05.759604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83fd4b-c1a2-4889-9cf4-f1132f94a8e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:05.761180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83fd4b-c1a2-4889-9cf4-f1132f94a8e8 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:05.772930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1012/2019] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:43:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:43:05.777553 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f5d71-1231-428d-81c2-ca3d826f48f4 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:05.786975 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f5d71-1231-428d-81c2-ca3d826f48f4 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:05.792134 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c435ad-1c3f-460a-ab91-8d6887bf7a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:05.792778 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c435ad-1c3f-460a-ab91-8d6887bf7a1d admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:05.793112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c435ad-1c3f-460a-ab91-8d6887bf7a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:05.793338 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c435ad-1c3f-460a-ab91-8d6887bf7a1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:05.794053 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c435ad-1c3f-460a-ab91-8d6887bf7a1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:05.796067 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c435ad-1c3f-460a-ab91-8d6887bf7a1d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:05.832387 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1008/2020] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:43:05 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:05.833815 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83fd4b-c1a2-4889-9cf4-f1132f94a8e8 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:05.844398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83fd4b-c1a2-4889-9cf4-f1132f94a8e8 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:05.900494 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d687e4-0328-4a89-a8e2-3ab5f04e4bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:05.901163 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d687e4-0328-4a89-a8e2-3ab5f04e4bab admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:05.901470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d687e4-0328-4a89-a8e2-3ab5f04e4bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:05.901748 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d687e4-0328-4a89-a8e2-3ab5f04e4bab admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:05.902438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d687e4-0328-4a89-a8e2-3ab5f04e4bab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:05.904333 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d687e4-0328-4a89-a8e2-3ab5f04e4bab admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:05.923645 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1013/2021] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:43:05 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:05.927724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c435ad-1c3f-460a-ab91-8d6887bf7a1d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:05.938269 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c435ad-1c3f-460a-ab91-8d6887bf7a1d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:05.943059 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b297f-c554-44f3-90e1-4962e8aba0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:05.943714 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b297f-c554-44f3-90e1-4962e8aba0fa admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:05.943999 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b297f-c554-44f3-90e1-4962e8aba0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:05.944275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b297f-c554-44f3-90e1-4962e8aba0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:05.945023 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b297f-c554-44f3-90e1-4962e8aba0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:05.947621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b297f-c554-44f3-90e1-4962e8aba0fa admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:05.957924 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1009/2022] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:05.962292 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d687e4-0328-4a89-a8e2-3ab5f04e4bab admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:05.972058 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d687e4-0328-4a89-a8e2-3ab5f04e4bab admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:05.976546 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd53cb-c356-4272-902b-b509dc66889e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:05.977195 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd53cb-c356-4272-902b-b509dc66889e admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:05.977512 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd53cb-c356-4272-902b-b509dc66889e admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:05.977788 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd53cb-c356-4272-902b-b509dc66889e admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:05.978500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd53cb-c356-4272-902b-b509dc66889e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:05.980183 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd53cb-c356-4272-902b-b509dc66889e admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:05.989970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1014/2023] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:05.994283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b297f-c554-44f3-90e1-4962e8aba0fa admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:06.004041 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b297f-c554-44f3-90e1-4962e8aba0fa admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:06.009550 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78092d20-a35a-40b9-b9f0-689acf466804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:06.010431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78092d20-a35a-40b9-b9f0-689acf466804 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:06.010713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78092d20-a35a-40b9-b9f0-689acf466804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:06.010983 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78092d20-a35a-40b9-b9f0-689acf466804 admin admin] PATH_INFO: `/v3/projects/dc63279634e2484d96009b03ffe2bae2/users/6aa81f6e85184805978c401087ccf34a/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:06.025907 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78092d20-a35a-40b9-b9f0-689acf466804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc63279634e2484d96009b03ffe2bae2, user_id=6aa81f6e85184805978c401087ccf34a, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:06.028621 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78092d20-a35a-40b9-b9f0-689acf466804 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:06.041776 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1010/2024] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:05 2022] PUT /identity/v3/projects/dc63279634e2484d96009b03ffe2bae2/users/6aa81f6e85184805978c401087ccf34a/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:06.052991 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531289c2-bb9a-4307-ada9-3ec07b8e5ebe None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:06.053672 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531289c2-bb9a-4307-ada9-3ec07b8e5ebe None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:06.053672 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531289c2-bb9a-4307-ada9-3ec07b8e5ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:06.081759 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-531289c2-bb9a-4307-ada9-3ec07b8e5ebe None None] MFA Rules not processed for user `6aa81f6e85184805978c401087ccf34a`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:06.082950 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-531289c2-bb9a-4307-ada9-3ec07b8e5ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:06.112422 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:06.149891 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1015/2025] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:06.154358 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78092d20-a35a-40b9-b9f0-689acf466804 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:06.216366 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78092d20-a35a-40b9-b9f0-689acf466804 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:06.221043 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac505e8-3454-40c4-b6e0-7783b6de2b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:06.221757 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac505e8-3454-40c4-b6e0-7783b6de2b64 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:06.222044 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac505e8-3454-40c4-b6e0-7783b6de2b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:06.222323 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac505e8-3454-40c4-b6e0-7783b6de2b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:06.223042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac505e8-3454-40c4-b6e0-7783b6de2b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:06.224969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac505e8-3454-40c4-b6e0-7783b6de2b64 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:06.250047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1011/2026] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:43:06 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:06.254103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531289c2-bb9a-4307-ada9-3ec07b8e5ebe None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:06.265106 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531289c2-bb9a-4307-ada9-3ec07b8e5ebe None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:06.323650 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b32f0-d1f9-4eab-a224-0b3221bf81b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:06.324238 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b32f0-d1f9-4eab-a224-0b3221bf81b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:06.324520 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b32f0-d1f9-4eab-a224-0b3221bf81b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:06.324795 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b32f0-d1f9-4eab-a224-0b3221bf81b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:06.325546 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b32f0-d1f9-4eab-a224-0b3221bf81b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:06.327560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b32f0-d1f9-4eab-a224-0b3221bf81b9 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:06.347676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1016/2027] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:43:06 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:43:06.351645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac505e8-3454-40c4-b6e0-7783b6de2b64 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:06.362874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac505e8-3454-40c4-b6e0-7783b6de2b64 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:06.367416 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a340dc5-01b1-498b-a2b7-dbb88b2df5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:06.368664 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a340dc5-01b1-498b-a2b7-dbb88b2df5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:06.368949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a340dc5-01b1-498b-a2b7-dbb88b2df5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:06.369366 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a340dc5-01b1-498b-a2b7-dbb88b2df5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:06.370183 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a340dc5-01b1-498b-a2b7-dbb88b2df5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:06.371784 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a340dc5-01b1-498b-a2b7-dbb88b2df5e8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:06.382115 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1012/2028] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:06.386253 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b32f0-d1f9-4eab-a224-0b3221bf81b9 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:06.395915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b32f0-d1f9-4eab-a224-0b3221bf81b9 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:06.401015 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b76b7-2574-47fd-bfcd-d2c0fa92772b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:06.401909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b76b7-2574-47fd-bfcd-d2c0fa92772b admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:06.402193 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b76b7-2574-47fd-bfcd-d2c0fa92772b admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:06.402467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b76b7-2574-47fd-bfcd-d2c0fa92772b admin admin] PATH_INFO: `/v3/projects/7b9c4b081d65472fb310b6b9902ea4a4/users/b482712ce5134015a1d2127090efa282/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:06.417981 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b76b7-2574-47fd-bfcd-d2c0fa92772b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9c4b081d65472fb310b6b9902ea4a4, user_id=b482712ce5134015a1d2127090efa282, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:06.420671 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b76b7-2574-47fd-bfcd-d2c0fa92772b admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:06.434038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1017/2029] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:06 2022] PUT /identity/v3/projects/7b9c4b081d65472fb310b6b9902ea4a4/users/b482712ce5134015a1d2127090efa282/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:06.437902 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a340dc5-01b1-498b-a2b7-dbb88b2df5e8 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:06.448169 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a340dc5-01b1-498b-a2b7-dbb88b2df5e8 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:06.471923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:06.513130 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a10ce-95a0-4eb1-b780-1d46847bb225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:06.513859 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a10ce-95a0-4eb1-b780-1d46847bb225 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:06.514138 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a10ce-95a0-4eb1-b780-1d46847bb225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:06.514410 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a10ce-95a0-4eb1-b780-1d46847bb225 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:06.515129 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a10ce-95a0-4eb1-b780-1d46847bb225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:06.516715 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a10ce-95a0-4eb1-b780-1d46847bb225 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:06.529059 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1013/2030] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:43:06.531875 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b76b7-2574-47fd-bfcd-d2c0fa92772b admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:06.542898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b76b7-2574-47fd-bfcd-d2c0fa92772b admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:06.547554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62807311-4c98-43b3-b22e-cbe67649ede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:06.548440 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62807311-4c98-43b3-b22e-cbe67649ede6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:06.548729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62807311-4c98-43b3-b22e-cbe67649ede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:06.549013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62807311-4c98-43b3-b22e-cbe67649ede6 admin admin] PATH_INFO: `/v3/projects/7b9c4b081d65472fb310b6b9902ea4a4/users/b482712ce5134015a1d2127090efa282/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:06.551022 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62807311-4c98-43b3-b22e-cbe67649ede6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b9c4b081d65472fb310b6b9902ea4a4, user_id=b482712ce5134015a1d2127090efa282, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:06.553693 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62807311-4c98-43b3-b22e-cbe67649ede6 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:06.563927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1018/2031] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:06 2022] PUT /identity/v3/projects/7b9c4b081d65472fb310b6b9902ea4a4/users/b482712ce5134015a1d2127090efa282/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:06.574893 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20d14f-db1e-44f1-9686-b4dabdeb0cee None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:06.575120 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20d14f-db1e-44f1-9686-b4dabdeb0cee None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:06.575400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20d14f-db1e-44f1-9686-b4dabdeb0cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:06.601677 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-5c20d14f-db1e-44f1-9686-b4dabdeb0cee None None] MFA Rules not processed for user `b482712ce5134015a1d2127090efa282`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:06.603458 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5c20d14f-db1e-44f1-9686-b4dabdeb0cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:06.679928 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1014/2032] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:43:06.697647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62807311-4c98-43b3-b22e-cbe67649ede6 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:06.699403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-62807311-4c98-43b3-b22e-cbe67649ede6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:06.761147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62807311-4c98-43b3-b22e-cbe67649ede6 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:06.765168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff69c17-d414-4e25-bdb9-5fbb71611b63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:06.765884 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff69c17-d414-4e25-bdb9-5fbb71611b63 service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:06.766172 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff69c17-d414-4e25-bdb9-5fbb71611b63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:06.766569 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff69c17-d414-4e25-bdb9-5fbb71611b63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:06.777490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff69c17-d414-4e25-bdb9-5fbb71611b63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:06.778933 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff69c17-d414-4e25-bdb9-5fbb71611b63 service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:06.788791 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1019/2033] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:43:06.887498 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20d14f-db1e-44f1-9686-b4dabdeb0cee None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:06.888947 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5c20d14f-db1e-44f1-9686-b4dabdeb0cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:06.901963 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20d14f-db1e-44f1-9686-b4dabdeb0cee None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:06.905361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0f6b3-6713-4731-913a-633b73112df5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:06.906284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0f6b3-6713-4731-913a-633b73112df5 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:06.906568 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0f6b3-6713-4731-913a-633b73112df5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:06.906838 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0f6b3-6713-4731-913a-633b73112df5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:06.920059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c292d8e-7a36-4559-bcfa-df9beb45fa55 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:06.920354 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c292d8e-7a36-4559-bcfa-df9beb45fa55 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:06.920632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c292d8e-7a36-4559-bcfa-df9beb45fa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:06.939047 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-0c292d8e-7a36-4559-bcfa-df9beb45fa55 None None] MFA Rules not processed for user `de843beff4dd401fb34b34ab83f6f7f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:06.940234 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-0c292d8e-7a36-4559-bcfa-df9beb45fa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:06.959137 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:06.966023 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0f6b3-6713-4731-913a-633b73112df5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:06.967478 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0f6b3-6713-4731-913a-633b73112df5 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:06.976731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1015/2034] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:43:07.007265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1020/2035] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:43:09.460642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0f6b3-6713-4731-913a-633b73112df5 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:09.462656 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c8f0f6b3-6713-4731-913a-633b73112df5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:09.520154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:09.538656 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0f6b3-6713-4731-913a-633b73112df5 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:09.543573 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e091b-fef4-4514-a5a0-af304c8c8cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:09.545047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e091b-fef4-4514-a5a0-af304c8c8cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:09.545420 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e091b-fef4-4514-a5a0-af304c8c8cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:09.545748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e091b-fef4-4514-a5a0-af304c8c8cd8 admin admin] PATH_INFO: `/v3/users/063c123ea7cf40d0acc9f46901f2fcb1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:09.546993 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e091b-fef4-4514-a5a0-af304c8c8cd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=063c123ea7cf40d0acc9f46901f2fcb1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:09.548956 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e091b-fef4-4514-a5a0-af304c8c8cd8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:09.561592 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c292d8e-7a36-4559-bcfa-df9beb45fa55 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:09.573632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c292d8e-7a36-4559-bcfa-df9beb45fa55 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:09.578641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca89423-ac1d-411e-8be1-86f22c8010db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:09.579702 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca89423-ac1d-411e-8be1-86f22c8010db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:09.580358 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca89423-ac1d-411e-8be1-86f22c8010db admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:09.580690 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca89423-ac1d-411e-8be1-86f22c8010db admin admin] PATH_INFO: `/v3/users/6aa81f6e85184805978c401087ccf34a` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:09.581948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca89423-ac1d-411e-8be1-86f22c8010db admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aa81f6e85184805978c401087ccf34a)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:09.583934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca89423-ac1d-411e-8be1-86f22c8010db admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:09.612179 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3f8e091b-fef4-4514-a5a0-af304c8c8cd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063c123ea7cf40d0acc9f46901f2fcb1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:09.613143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3f8e091b-fef4-4514-a5a0-af304c8c8cd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063c123ea7cf40d0acc9f46901f2fcb1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:09.623718 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3f8e091b-fef4-4514-a5a0-af304c8c8cd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063c123ea7cf40d0acc9f46901f2fcb1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:09.632836 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3f8e091b-fef4-4514-a5a0-af304c8c8cd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063c123ea7cf40d0acc9f46901f2fcb1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:09.645078 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6ca89423-ac1d-411e-8be1-86f22c8010db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aa81f6e85184805978c401087ccf34a'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:09.646176 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6ca89423-ac1d-411e-8be1-86f22c8010db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aa81f6e85184805978c401087ccf34a'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:09.650714 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3f8e091b-fef4-4514-a5a0-af304c8c8cd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063c123ea7cf40d0acc9f46901f2fcb1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:09.656227 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6ca89423-ac1d-411e-8be1-86f22c8010db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aa81f6e85184805978c401087ccf34a'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:09.659496 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1016/2036] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:09 2022] DELETE /identity/v3/users/063c123ea7cf40d0acc9f46901f2fcb1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:09.664091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f67e7-dcdc-43a8-acc5-a3c462ec0a49 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:09.664479 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f67e7-dcdc-43a8-acc5-a3c462ec0a49 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:09.664718 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f67e7-dcdc-43a8-acc5-a3c462ec0a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:09.665186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6ca89423-ac1d-411e-8be1-86f22c8010db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aa81f6e85184805978c401087ccf34a'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:09.679587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6ca89423-ac1d-411e-8be1-86f22c8010db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aa81f6e85184805978c401087ccf34a'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:09.686548 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1021/2037] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:09 2022] DELETE /identity/v3/users/6aa81f6e85184805978c401087ccf34a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:09.688167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-5c8f67e7-dcdc-43a8-acc5-a3c462ec0a49 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:09.689692 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5c8f67e7-dcdc-43a8-acc5-a3c462ec0a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:09.691163 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11c3a-a038-4d8b-9ba7-bd5d53023ba6 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:09.691635 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11c3a-a038-4d8b-9ba7-bd5d53023ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:09.691923 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b11c3a-a038-4d8b-9ba7-bd5d53023ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:09.710145 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-66b11c3a-a038-4d8b-9ba7-bd5d53023ba6 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:09.712142 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-66b11c3a-a038-4d8b-9ba7-bd5d53023ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:09.759655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1017/2038] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:09.769587 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f67e7-dcdc-43a8-acc5-a3c462ec0a49 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:09.771034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5c8f67e7-dcdc-43a8-acc5-a3c462ec0a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:09.783872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1022/2039] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:09.794303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b11c3a-a038-4d8b-9ba7-bd5d53023ba6 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:09.796467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-66b11c3a-a038-4d8b-9ba7-bd5d53023ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:09.849025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f67e7-dcdc-43a8-acc5-a3c462ec0a49 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:09.854153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ae4df-346e-4c6f-9984-af4c7714bda6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:09.854905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ae4df-346e-4c6f-9984-af4c7714bda6 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:09.855107 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ae4df-346e-4c6f-9984-af4c7714bda6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:09.855393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ae4df-346e-4c6f-9984-af4c7714bda6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:09.858834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:09.867935 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ae4df-346e-4c6f-9984-af4c7714bda6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:09.869908 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517ae4df-346e-4c6f-9984-af4c7714bda6 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:09.871818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b11c3a-a038-4d8b-9ba7-bd5d53023ba6 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:09.878001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d5ce9-9c41-4ae0-8dfb-76d46d34ab99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:09.878750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d5ce9-9c41-4ae0-8dfb-76d46d34ab99 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:09.879439 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d5ce9-9c41-4ae0-8dfb-76d46d34ab99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:09.880131 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d5ce9-9c41-4ae0-8dfb-76d46d34ab99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:09.881702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1018/2040] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:43:09.892379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d5ce9-9c41-4ae0-8dfb-76d46d34ab99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:09.894268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d5ce9-9c41-4ae0-8dfb-76d46d34ab99 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:09.906654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1023/2041] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:43:10.432685 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ae4df-346e-4c6f-9984-af4c7714bda6 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:10.434470 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-517ae4df-346e-4c6f-9984-af4c7714bda6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:10.472727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ae4df-346e-4c6f-9984-af4c7714bda6 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:10.513873 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc419e6-a91f-4d4f-b29f-bf19389d7b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:10.514816 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc419e6-a91f-4d4f-b29f-bf19389d7b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:10.515102 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc419e6-a91f-4d4f-b29f-bf19389d7b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:10.515382 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc419e6-a91f-4d4f-b29f-bf19389d7b2d admin admin] PATH_INFO: `/v3/projects/dc63279634e2484d96009b03ffe2bae2` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:10.518263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc419e6-a91f-4d4f-b29f-bf19389d7b2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc63279634e2484d96009b03ffe2bae2)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:10.521285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc419e6-a91f-4d4f-b29f-bf19389d7b2d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:10.535933 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:10.605624 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8dc419e6-a91f-4d4f-b29f-bf19389d7b2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc63279634e2484d96009b03ffe2bae2', 'request_id': 'req-8dc419e6-a91f-4d4f-b29f-bf19389d7b2d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:10.615175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8dc419e6-a91f-4d4f-b29f-bf19389d7b2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc63279634e2484d96009b03ffe2bae2', 'request_id': 'req-8dc419e6-a91f-4d4f-b29f-bf19389d7b2d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:10.625829 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8dc419e6-a91f-4d4f-b29f-bf19389d7b2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc63279634e2484d96009b03ffe2bae2', 'request_id': 'req-8dc419e6-a91f-4d4f-b29f-bf19389d7b2d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:10.644285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8dc419e6-a91f-4d4f-b29f-bf19389d7b2d admin admin] The token cache is being invalidate because project dc63279634e2484d96009b03ffe2bae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:10.644911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8dc419e6-a91f-4d4f-b29f-bf19389d7b2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:10.645810 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8dc419e6-a91f-4d4f-b29f-bf19389d7b2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:10.648053 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1019/2042] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:10 2022] DELETE /identity/v3/projects/dc63279634e2484d96009b03ffe2bae2 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:10.653159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d5ce9-9c41-4ae0-8dfb-76d46d34ab99 service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:10.664431 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d5ce9-9c41-4ae0-8dfb-76d46d34ab99 service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:10.731587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8953265-789d-4de7-89ea-91a640f0dd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:10.733132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8953265-789d-4de7-89ea-91a640f0dd41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:10.733567 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8953265-789d-4de7-89ea-91a640f0dd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:10.733779 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8953265-789d-4de7-89ea-91a640f0dd41 admin admin] PATH_INFO: `/v3/users/b482712ce5134015a1d2127090efa282` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:10.735216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8953265-789d-4de7-89ea-91a640f0dd41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b482712ce5134015a1d2127090efa282)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:10.737250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8953265-789d-4de7-89ea-91a640f0dd41 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:10.766003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc419e6-a91f-4d4f-b29f-bf19389d7b2d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:10.767600 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8dc419e6-a91f-4d4f-b29f-bf19389d7b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:10.798805 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc419e6-a91f-4d4f-b29f-bf19389d7b2d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:10.802371 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-b8953265-789d-4de7-89ea-91a640f0dd41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b482712ce5134015a1d2127090efa282'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:10.803029 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-b8953265-789d-4de7-89ea-91a640f0dd41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b482712ce5134015a1d2127090efa282'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:10.804710 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931db6c5-b002-4998-8fcd-47fe52b4e41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:10.808086 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931db6c5-b002-4998-8fcd-47fe52b4e41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:10.808447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931db6c5-b002-4998-8fcd-47fe52b4e41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:10.808892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931db6c5-b002-4998-8fcd-47fe52b4e41b admin admin] PATH_INFO: `/v3/users/21ab21fc2a73449b8224b273f408a7d3` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:10.810390 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931db6c5-b002-4998-8fcd-47fe52b4e41b admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ab21fc2a73449b8224b273f408a7d3)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:10.812698 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931db6c5-b002-4998-8fcd-47fe52b4e41b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:10.817969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-b8953265-789d-4de7-89ea-91a640f0dd41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b482712ce5134015a1d2127090efa282'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:10.829207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-b8953265-789d-4de7-89ea-91a640f0dd41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b482712ce5134015a1d2127090efa282'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:10.846196 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-b8953265-789d-4de7-89ea-91a640f0dd41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b482712ce5134015a1d2127090efa282'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:10.854370 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1024/2043] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:10 2022] DELETE /identity/v3/users/b482712ce5134015a1d2127090efa282 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:10.879549 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8953265-789d-4de7-89ea-91a640f0dd41 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:10.881024 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b8953265-789d-4de7-89ea-91a640f0dd41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:10.891541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-931db6c5-b002-4998-8fcd-47fe52b4e41b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ab21fc2a73449b8224b273f408a7d3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:10.892646 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-931db6c5-b002-4998-8fcd-47fe52b4e41b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ab21fc2a73449b8224b273f408a7d3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:10.904874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-931db6c5-b002-4998-8fcd-47fe52b4e41b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ab21fc2a73449b8224b273f408a7d3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:10.921255 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-931db6c5-b002-4998-8fcd-47fe52b4e41b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ab21fc2a73449b8224b273f408a7d3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:10.963484 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-931db6c5-b002-4998-8fcd-47fe52b4e41b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ab21fc2a73449b8224b273f408a7d3'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:10.974607 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1020/2044] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:10 2022] DELETE /identity/v3/users/21ab21fc2a73449b8224b273f408a7d3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:10.976419 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f368b3-32e6-451f-ad6c-0718c1f17dfe None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:10.976889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f368b3-32e6-451f-ad6c-0718c1f17dfe None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:10.977085 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f368b3-32e6-451f-ad6c-0718c1f17dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:10.999602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-52f368b3-32e6-451f-ad6c-0718c1f17dfe None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:11.000934 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-52f368b3-32e6-451f-ad6c-0718c1f17dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:11.004336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8953265-789d-4de7-89ea-91a640f0dd41 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:11.016599 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:11.091971 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1021/2045] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:43:11.106518 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092292f-6208-433f-b8da-c5b3efb76276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:11.107749 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092292f-6208-433f-b8da-c5b3efb76276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:11.108212 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092292f-6208-433f-b8da-c5b3efb76276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:11.108662 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9092292f-6208-433f-b8da-c5b3efb76276 admin admin] PATH_INFO: `/v3/projects/e359b46e90f64d0baee4cfcb43173075` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:11.110924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092292f-6208-433f-b8da-c5b3efb76276 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e359b46e90f64d0baee4cfcb43173075)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:11.112312 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f368b3-32e6-451f-ad6c-0718c1f17dfe None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:11.113323 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9092292f-6208-433f-b8da-c5b3efb76276 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:11.114158 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-52f368b3-32e6-451f-ad6c-0718c1f17dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:11.125874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:11.173093 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-9092292f-6208-433f-b8da-c5b3efb76276 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e359b46e90f64d0baee4cfcb43173075', 'request_id': 'req-9092292f-6208-433f-b8da-c5b3efb76276'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:11.181071 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-9092292f-6208-433f-b8da-c5b3efb76276 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e359b46e90f64d0baee4cfcb43173075', 'request_id': 'req-9092292f-6208-433f-b8da-c5b3efb76276'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:11.194544 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f368b3-32e6-451f-ad6c-0718c1f17dfe None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:11.201351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-9092292f-6208-433f-b8da-c5b3efb76276 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e359b46e90f64d0baee4cfcb43173075', 'request_id': 'req-9092292f-6208-433f-b8da-c5b3efb76276'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:11.224219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-9092292f-6208-433f-b8da-c5b3efb76276 admin admin] The token cache is being invalidate because project e359b46e90f64d0baee4cfcb43173075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:11.224658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-9092292f-6208-433f-b8da-c5b3efb76276 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:11.225848 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-9092292f-6208-433f-b8da-c5b3efb76276 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:11.227715 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1025/2046] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:10 2022] DELETE /identity/v3/projects/e359b46e90f64d0baee4cfcb43173075 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:11.228507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092292f-6208-433f-b8da-c5b3efb76276 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:11.230089 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-9092292f-6208-433f-b8da-c5b3efb76276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:11.280091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727fddd-afc4-4c6f-ac51-5c5c1755dc7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:11.281243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727fddd-afc4-4c6f-ac51-5c5c1755dc7c service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:11.281651 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727fddd-afc4-4c6f-ac51-5c5c1755dc7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:11.281909 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b727fddd-afc4-4c6f-ac51-5c5c1755dc7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:11.284427 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b727fddd-afc4-4c6f-ac51-5c5c1755dc7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:11.305622 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9092292f-6208-433f-b8da-c5b3efb76276 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:11.310578 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb76a43-1edd-4ffc-9f7c-92ae2c9600c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:11.311455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb76a43-1edd-4ffc-9f7c-92ae2c9600c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:11.311740 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb76a43-1edd-4ffc-9f7c-92ae2c9600c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:11.312023 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb76a43-1edd-4ffc-9f7c-92ae2c9600c6 admin admin] PATH_INFO: `/v3/projects/7b9c4b081d65472fb310b6b9902ea4a4` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:11.313220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb76a43-1edd-4ffc-9f7c-92ae2c9600c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b9c4b081d65472fb310b6b9902ea4a4)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:11.315175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb76a43-1edd-4ffc-9f7c-92ae2c9600c6 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:11.367691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:11.368790 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727fddd-afc4-4c6f-ac51-5c5c1755dc7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:11.370657 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b727fddd-afc4-4c6f-ac51-5c5c1755dc7c service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:11.372441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eeb76a43-1edd-4ffc-9f7c-92ae2c9600c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b9c4b081d65472fb310b6b9902ea4a4', 'request_id': 'req-eeb76a43-1edd-4ffc-9f7c-92ae2c9600c6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:11.379305 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eeb76a43-1edd-4ffc-9f7c-92ae2c9600c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b9c4b081d65472fb310b6b9902ea4a4', 'request_id': 'req-eeb76a43-1edd-4ffc-9f7c-92ae2c9600c6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:11.386920 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eeb76a43-1edd-4ffc-9f7c-92ae2c9600c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b9c4b081d65472fb310b6b9902ea4a4', 'request_id': 'req-eeb76a43-1edd-4ffc-9f7c-92ae2c9600c6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:11.395487 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1022/2047] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:43:11.396420 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727fddd-afc4-4c6f-ac51-5c5c1755dc7c service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:11.397896 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b727fddd-afc4-4c6f-ac51-5c5c1755dc7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:11.400901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eeb76a43-1edd-4ffc-9f7c-92ae2c9600c6 admin admin] The token cache is being invalidate because project 7b9c4b081d65472fb310b6b9902ea4a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:11.401452 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eeb76a43-1edd-4ffc-9f7c-92ae2c9600c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:11.402651 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eeb76a43-1edd-4ffc-9f7c-92ae2c9600c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:11.408945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1026/2048] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:11 2022] DELETE /identity/v3/projects/7b9c4b081d65472fb310b6b9902ea4a4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:11.411619 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bfd00-07fb-4c6b-9f5d-3ed3a774aa72 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:11.411826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b727fddd-afc4-4c6f-ac51-5c5c1755dc7c service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:11.412034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bfd00-07fb-4c6b-9f5d-3ed3a774aa72 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:11.412434 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bfd00-07fb-4c6b-9f5d-3ed3a774aa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:11.434843 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-eb0bfd00-07fb-4c6b-9f5d-3ed3a774aa72 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:11.436531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-eb0bfd00-07fb-4c6b-9f5d-3ed3a774aa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:11.481143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783764cd-0f4c-433e-b99a-9eca8549f67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:11.482466 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783764cd-0f4c-433e-b99a-9eca8549f67a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:11.482848 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783764cd-0f4c-433e-b99a-9eca8549f67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:11.483234 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783764cd-0f4c-433e-b99a-9eca8549f67a admin admin] PATH_INFO: `/v3/users/be1b091823b044d6b88b24718088e315` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:11.484636 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783764cd-0f4c-433e-b99a-9eca8549f67a admin admin] RBAC: Authorizing `identity:delete_user(user_id=be1b091823b044d6b88b24718088e315)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:11.486779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783764cd-0f4c-433e-b99a-9eca8549f67a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:11.502180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:11.511198 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1027/2049] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:11.519351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c35561-a9e8-4f59-a3c5-16cef302df47 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:11.519659 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c35561-a9e8-4f59-a3c5-16cef302df47 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:11.519941 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c35561-a9e8-4f59-a3c5-16cef302df47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:11.540634 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-f8c35561-a9e8-4f59-a3c5-16cef302df47 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:11.541924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-f8c35561-a9e8-4f59-a3c5-16cef302df47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:11.550556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-783764cd-0f4c-433e-b99a-9eca8549f67a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be1b091823b044d6b88b24718088e315'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:11.553565 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-783764cd-0f4c-433e-b99a-9eca8549f67a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be1b091823b044d6b88b24718088e315'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:11.563472 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1028/2050] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:11.564501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c35561-a9e8-4f59-a3c5-16cef302df47 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:11.568061 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-783764cd-0f4c-433e-b99a-9eca8549f67a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be1b091823b044d6b88b24718088e315'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:11.576381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c35561-a9e8-4f59-a3c5-16cef302df47 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:11.578758 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-783764cd-0f4c-433e-b99a-9eca8549f67a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be1b091823b044d6b88b24718088e315'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:11.582249 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86bb5f1-5a49-406f-abe8-d7f7d470461e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:11.582915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bb5f1-5a49-406f-abe8-d7f7d470461e admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:11.583727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bb5f1-5a49-406f-abe8-d7f7d470461e admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:11.583727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86bb5f1-5a49-406f-abe8-d7f7d470461e admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:11.584271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86bb5f1-5a49-406f-abe8-d7f7d470461e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:43:11.584590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86bb5f1-5a49-406f-abe8-d7f7d470461e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:11.586868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86bb5f1-5a49-406f-abe8-d7f7d470461e admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:11.593909 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-783764cd-0f4c-433e-b99a-9eca8549f67a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be1b091823b044d6b88b24718088e315'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:11.600284 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1029/2051] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:43:11.601406 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1023/2052] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:11 2022] DELETE /identity/v3/users/be1b091823b044d6b88b24718088e315 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:11.604515 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86bb5f1-5a49-406f-abe8-d7f7d470461e admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:11.606252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c86bb5f1-5a49-406f-abe8-d7f7d470461e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:11.619977 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86bb5f1-5a49-406f-abe8-d7f7d470461e admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:11.694709 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bede84-8270-4218-9f5a-d540115ec916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:11.695326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783764cd-0f4c-433e-b99a-9eca8549f67a admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:11.696789 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bede84-8270-4218-9f5a-d540115ec916 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:11.697241 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bede84-8270-4218-9f5a-d540115ec916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:11.697685 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bede84-8270-4218-9f5a-d540115ec916 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:11.698116 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-783764cd-0f4c-433e-b99a-9eca8549f67a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:11.698744 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bede84-8270-4218-9f5a-d540115ec916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:11.700855 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bede84-8270-4218-9f5a-d540115ec916 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:11.714986 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783764cd-0f4c-433e-b99a-9eca8549f67a admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:11.721825 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fd898-35fb-4440-83c5-057e911b4a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:11.722766 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fd898-35fb-4440-83c5-057e911b4a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:11.723057 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fd898-35fb-4440-83c5-057e911b4a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:11.723387 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fd898-35fb-4440-83c5-057e911b4a63 admin admin] PATH_INFO: `/v3/projects/793968565e3e4613af858ee583a6e6e1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:11.725610 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fd898-35fb-4440-83c5-057e911b4a63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=793968565e3e4613af858ee583a6e6e1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:11.728010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fd898-35fb-4440-83c5-057e911b4a63 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:11.743216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1030/2053] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:43:11 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:43:11.744331 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bede84-8270-4218-9f5a-d540115ec916 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:11.799586 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:11.803997 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-fc5fd898-35fb-4440-83c5-057e911b4a63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '793968565e3e4613af858ee583a6e6e1', 'request_id': 'req-fc5fd898-35fb-4440-83c5-057e911b4a63'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:11.817404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-fc5fd898-35fb-4440-83c5-057e911b4a63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '793968565e3e4613af858ee583a6e6e1', 'request_id': 'req-fc5fd898-35fb-4440-83c5-057e911b4a63'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:11.834155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bede84-8270-4218-9f5a-d540115ec916 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:11.836997 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-fc5fd898-35fb-4440-83c5-057e911b4a63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '793968565e3e4613af858ee583a6e6e1', 'request_id': 'req-fc5fd898-35fb-4440-83c5-057e911b4a63'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:11.855847 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-fc5fd898-35fb-4440-83c5-057e911b4a63 admin admin] The token cache is being invalidate because project 793968565e3e4613af858ee583a6e6e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:11.856380 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-fc5fd898-35fb-4440-83c5-057e911b4a63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:11.857975 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-fc5fd898-35fb-4440-83c5-057e911b4a63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:11.860881 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1024/2054] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:11 2022] DELETE /identity/v3/projects/793968565e3e4613af858ee583a6e6e1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:11.865145 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fd898-35fb-4440-83c5-057e911b4a63 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:11.866693 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-fc5fd898-35fb-4440-83c5-057e911b4a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:11.937088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab381f6-46b0-41f4-8305-b4e8099f29dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:11.937960 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab381f6-46b0-41f4-8305-b4e8099f29dd admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:11.938250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab381f6-46b0-41f4-8305-b4e8099f29dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:11.938807 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab381f6-46b0-41f4-8305-b4e8099f29dd admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:11.939403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab381f6-46b0-41f4-8305-b4e8099f29dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:11.941606 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab381f6-46b0-41f4-8305-b4e8099f29dd admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:11.962286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fd898-35fb-4440-83c5-057e911b4a63 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:11.967911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b15ca-1af2-490c-8c96-6e2ed059bb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:11.968793 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b15ca-1af2-490c-8c96-6e2ed059bb4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:11.969103 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b15ca-1af2-490c-8c96-6e2ed059bb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:11.969399 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b15ca-1af2-490c-8c96-6e2ed059bb4c admin admin] PATH_INFO: `/v3/users/4dbd4b0914fc40b1a8a2b91003f9d5da` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:11.970675 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b15ca-1af2-490c-8c96-6e2ed059bb4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dbd4b0914fc40b1a8a2b91003f9d5da)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:11.972962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b15ca-1af2-490c-8c96-6e2ed059bb4c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:11.978632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1031/2055] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:43:11 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:43:11.979608 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab381f6-46b0-41f4-8305-b4e8099f29dd admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:11.984251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-fab381f6-46b0-41f4-8305-b4e8099f29dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:11.998616 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab381f6-46b0-41f4-8305-b4e8099f29dd admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:12.000605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:12.005041 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbddc13-fedf-4011-8c5a-c75c684c747a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:12.006063 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbddc13-fedf-4011-8c5a-c75c684c747a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:12.006453 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbddc13-fedf-4011-8c5a-c75c684c747a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:12.006855 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbddc13-fedf-4011-8c5a-c75c684c747a admin admin] PATH_INFO: `/v3/projects/d45798f4e757408198ac20ae6c64d860` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:12.009212 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbddc13-fedf-4011-8c5a-c75c684c747a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d45798f4e757408198ac20ae6c64d860)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:12.011261 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbddc13-fedf-4011-8c5a-c75c684c747a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:12.042794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f22b15ca-1af2-490c-8c96-6e2ed059bb4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dbd4b0914fc40b1a8a2b91003f9d5da'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:12.043707 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f22b15ca-1af2-490c-8c96-6e2ed059bb4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dbd4b0914fc40b1a8a2b91003f9d5da'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:12.052108 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f22b15ca-1af2-490c-8c96-6e2ed059bb4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dbd4b0914fc40b1a8a2b91003f9d5da'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:12.059536 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f22b15ca-1af2-490c-8c96-6e2ed059bb4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dbd4b0914fc40b1a8a2b91003f9d5da'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:12.062861 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6bbddc13-fedf-4011-8c5a-c75c684c747a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd45798f4e757408198ac20ae6c64d860', 'request_id': 'req-6bbddc13-fedf-4011-8c5a-c75c684c747a'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:12.068705 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6bbddc13-fedf-4011-8c5a-c75c684c747a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd45798f4e757408198ac20ae6c64d860', 'request_id': 'req-6bbddc13-fedf-4011-8c5a-c75c684c747a'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:12.072771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f22b15ca-1af2-490c-8c96-6e2ed059bb4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dbd4b0914fc40b1a8a2b91003f9d5da'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:12.077181 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6bbddc13-fedf-4011-8c5a-c75c684c747a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd45798f4e757408198ac20ae6c64d860', 'request_id': 'req-6bbddc13-fedf-4011-8c5a-c75c684c747a'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:12.079709 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1025/2056] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:11 2022] DELETE /identity/v3/users/4dbd4b0914fc40b1a8a2b91003f9d5da => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:12.083298 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b15ca-1af2-490c-8c96-6e2ed059bb4c admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:12.084600 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f22b15ca-1af2-490c-8c96-6e2ed059bb4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:12.091382 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6bbddc13-fedf-4011-8c5a-c75c684c747a admin admin] The token cache is being invalidate because project d45798f4e757408198ac20ae6c64d860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:12.091900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6bbddc13-fedf-4011-8c5a-c75c684c747a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:12.092642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6bbddc13-fedf-4011-8c5a-c75c684c747a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:12.094333 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1032/2057] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:11 2022] DELETE /identity/v3/projects/d45798f4e757408198ac20ae6c64d860 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:12.098120 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbddc13-fedf-4011-8c5a-c75c684c747a admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:12.099487 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-6bbddc13-fedf-4011-8c5a-c75c684c747a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:12.166821 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b15ca-1af2-490c-8c96-6e2ed059bb4c admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:12.171245 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:12.172921 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b372fc9-d241-4049-af4a-b0ea966ab580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:12.173823 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b372fc9-d241-4049-af4a-b0ea966ab580 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:12.174424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b372fc9-d241-4049-af4a-b0ea966ab580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:12.174715 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b372fc9-d241-4049-af4a-b0ea966ab580 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:12.175458 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b372fc9-d241-4049-af4a-b0ea966ab580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:12.176727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbddc13-fedf-4011-8c5a-c75c684c747a admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:12.177152 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b372fc9-d241-4049-af4a-b0ea966ab580 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:12.186031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af85420-bc3e-4c55-8004-3f9e86ac9b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:12.188481 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af85420-bc3e-4c55-8004-3f9e86ac9b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:12.188803 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af85420-bc3e-4c55-8004-3f9e86ac9b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:12.189106 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af85420-bc3e-4c55-8004-3f9e86ac9b73 admin admin] PATH_INFO: `/v3/users/702e3760f5a948b3b1a5f2f92f2f11db` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:12.190502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af85420-bc3e-4c55-8004-3f9e86ac9b73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=702e3760f5a948b3b1a5f2f92f2f11db)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:12.194463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1026/2058] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:12.194728 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af85420-bc3e-4c55-8004-3f9e86ac9b73 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:12.198393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b372fc9-d241-4049-af4a-b0ea966ab580 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:12.200338 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0b372fc9-d241-4049-af4a-b0ea966ab580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:12.215275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b372fc9-d241-4049-af4a-b0ea966ab580 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:12.220728 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befd26b-8a11-49d0-8c33-128a3fc663b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:12.221351 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befd26b-8a11-49d0-8c33-128a3fc663b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:12.221539 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befd26b-8a11-49d0-8c33-128a3fc663b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:12.222431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befd26b-8a11-49d0-8c33-128a3fc663b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:12.222751 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befd26b-8a11-49d0-8c33-128a3fc663b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:12.224569 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befd26b-8a11-49d0-8c33-128a3fc663b9 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:12.239570 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1027/2059] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:12.240592 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befd26b-8a11-49d0-8c33-128a3fc663b9 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:12.258502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befd26b-8a11-49d0-8c33-128a3fc663b9 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:12.263467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de85e5-7980-4e0b-aebd-3f0654bf609c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:12.264378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de85e5-7980-4e0b-aebd-3f0654bf609c admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:12.264691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de85e5-7980-4e0b-aebd-3f0654bf609c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:12.265300 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de85e5-7980-4e0b-aebd-3f0654bf609c admin admin] PATH_INFO: `/v3/projects/4a2118cf620e4593b174448828a36df4/users/28d3ec84930249cca81f18b462d8240b/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:12.283769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de85e5-7980-4e0b-aebd-3f0654bf609c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a2118cf620e4593b174448828a36df4, user_id=28d3ec84930249cca81f18b462d8240b, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:12.286751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6af85420-bc3e-4c55-8004-3f9e86ac9b73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '702e3760f5a948b3b1a5f2f92f2f11db'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:12.286925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de85e5-7980-4e0b-aebd-3f0654bf609c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:12.287639 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6af85420-bc3e-4c55-8004-3f9e86ac9b73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '702e3760f5a948b3b1a5f2f92f2f11db'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:12.299730 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6af85420-bc3e-4c55-8004-3f9e86ac9b73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '702e3760f5a948b3b1a5f2f92f2f11db'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:12.309657 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1028/2060] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:12 2022] PUT /identity/v3/projects/4a2118cf620e4593b174448828a36df4/users/28d3ec84930249cca81f18b462d8240b/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:12.312039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936d557-4604-43d9-9ae6-4e2497842826 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:12.312330 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936d557-4604-43d9-9ae6-4e2497842826 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:12.312612 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936d557-4604-43d9-9ae6-4e2497842826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:12.316014 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6af85420-bc3e-4c55-8004-3f9e86ac9b73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '702e3760f5a948b3b1a5f2f92f2f11db'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:12.338308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-4936d557-4604-43d9-9ae6-4e2497842826 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:12.339532 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4936d557-4604-43d9-9ae6-4e2497842826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:12.341223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6af85420-bc3e-4c55-8004-3f9e86ac9b73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '702e3760f5a948b3b1a5f2f92f2f11db'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:12.350835 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1033/2061] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:12 2022] DELETE /identity/v3/users/702e3760f5a948b3b1a5f2f92f2f11db => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:12.413246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:12.436102 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1029/2062] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:12.469041 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af85420-bc3e-4c55-8004-3f9e86ac9b73 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:12.471389 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-6af85420-bc3e-4c55-8004-3f9e86ac9b73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:12.483870 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936d557-4604-43d9-9ae6-4e2497842826 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:12.485886 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4936d557-4604-43d9-9ae6-4e2497842826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:12.507362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936d557-4604-43d9-9ae6-4e2497842826 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:12.583667 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3877fb-3ea2-48e1-a1f0-6c732b1a6498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:12.584661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3877fb-3ea2-48e1-a1f0-6c732b1a6498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:12.584956 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3877fb-3ea2-48e1-a1f0-6c732b1a6498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:12.585830 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3877fb-3ea2-48e1-a1f0-6c732b1a6498 admin admin] PATH_INFO: `/v3/projects/8f01686930704e748d06e844b757c469` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:12.587984 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3877fb-3ea2-48e1-a1f0-6c732b1a6498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f01686930704e748d06e844b757c469)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:12.589987 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3877fb-3ea2-48e1-a1f0-6c732b1a6498 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:12.599673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af85420-bc3e-4c55-8004-3f9e86ac9b73 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:12.611683 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d4abc-e5cd-460f-9bb0-f42d2af8f553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:12.621842 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d4abc-e5cd-460f-9bb0-f42d2af8f553 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:12.622298 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d4abc-e5cd-460f-9bb0-f42d2af8f553 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:12.624847 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d4abc-e5cd-460f-9bb0-f42d2af8f553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:12.648863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d4abc-e5cd-460f-9bb0-f42d2af8f553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:12.651196 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d4abc-e5cd-460f-9bb0-f42d2af8f553 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:12.666855 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-1b3877fb-3ea2-48e1-a1f0-6c732b1a6498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f01686930704e748d06e844b757c469', 'request_id': 'req-1b3877fb-3ea2-48e1-a1f0-6c732b1a6498'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:12.674762 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-1b3877fb-3ea2-48e1-a1f0-6c732b1a6498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f01686930704e748d06e844b757c469', 'request_id': 'req-1b3877fb-3ea2-48e1-a1f0-6c732b1a6498'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:12.681456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1034/2063] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:43:12.685299 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-1b3877fb-3ea2-48e1-a1f0-6c732b1a6498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f01686930704e748d06e844b757c469', 'request_id': 'req-1b3877fb-3ea2-48e1-a1f0-6c732b1a6498'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:12.702699 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-1b3877fb-3ea2-48e1-a1f0-6c732b1a6498 admin admin] The token cache is being invalidate because project 8f01686930704e748d06e844b757c469 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:12.703225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-1b3877fb-3ea2-48e1-a1f0-6c732b1a6498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:12.704928 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-1b3877fb-3ea2-48e1-a1f0-6c732b1a6498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:12.707341 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1030/2064] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:12 2022] DELETE /identity/v3/projects/8f01686930704e748d06e844b757c469 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:12.712811 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbc320-931a-4d4a-9b4c-e5d90e1d21d6 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:12.713352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbc320-931a-4d4a-9b4c-e5d90e1d21d6 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:12.713352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbc320-931a-4d4a-9b4c-e5d90e1d21d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:12.733826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-7bcbc320-931a-4d4a-9b4c-e5d90e1d21d6 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:12.735132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7bcbc320-931a-4d4a-9b4c-e5d90e1d21d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:12.847397 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1035/2065] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:12.850570 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9a25e-cbff-41cc-87ef-bb1c91a17f64 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:12.850903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9a25e-cbff-41cc-87ef-bb1c91a17f64 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:12.851151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9a25e-cbff-41cc-87ef-bb1c91a17f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:12.883079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbc320-931a-4d4a-9b4c-e5d90e1d21d6 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:12.883262 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-cac9a25e-cbff-41cc-87ef-bb1c91a17f64 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:12.884550 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-cac9a25e-cbff-41cc-87ef-bb1c91a17f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:12.886876 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7bcbc320-931a-4d4a-9b4c-e5d90e1d21d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:12.901081 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbc320-931a-4d4a-9b4c-e5d90e1d21d6 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:12.908403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f47e9-7ae0-4fba-89fe-e65bc355ff80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:12.910192 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f47e9-7ae0-4fba-89fe-e65bc355ff80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:12.910718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f47e9-7ae0-4fba-89fe-e65bc355ff80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:12.911109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f47e9-7ae0-4fba-89fe-e65bc355ff80 admin admin] PATH_INFO: `/v3/projects/eaa2681228bb4d58b22101a9bab49d5b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:12.912389 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f47e9-7ae0-4fba-89fe-e65bc355ff80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaa2681228bb4d58b22101a9bab49d5b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:12.913092 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1031/2066] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:12.917804 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9a25e-cbff-41cc-87ef-bb1c91a17f64 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:12.918784 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f47e9-7ae0-4fba-89fe-e65bc355ff80 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:12.940620 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9a25e-cbff-41cc-87ef-bb1c91a17f64 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:12.950514 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7868d92-7c9a-4e48-be04-021d1958a2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:12.951200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7868d92-7c9a-4e48-be04-021d1958a2cf admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:12.951530 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7868d92-7c9a-4e48-be04-021d1958a2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:12.951810 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7868d92-7c9a-4e48-be04-021d1958a2cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:12.954349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7868d92-7c9a-4e48-be04-021d1958a2cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:43:12.955409 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7868d92-7c9a-4e48-be04-021d1958a2cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:12.957816 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7868d92-7c9a-4e48-be04-021d1958a2cf admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:12.968893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:12.978562 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1032/2067] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:43:12.984290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7868d92-7c9a-4e48-be04-021d1958a2cf admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:13.006506 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7868d92-7c9a-4e48-be04-021d1958a2cf admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:13.029445 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-675f47e9-7ae0-4fba-89fe-e65bc355ff80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa2681228bb4d58b22101a9bab49d5b', 'request_id': 'req-675f47e9-7ae0-4fba-89fe-e65bc355ff80'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:13.051344 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-675f47e9-7ae0-4fba-89fe-e65bc355ff80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa2681228bb4d58b22101a9bab49d5b', 'request_id': 'req-675f47e9-7ae0-4fba-89fe-e65bc355ff80'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:13.067449 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-675f47e9-7ae0-4fba-89fe-e65bc355ff80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa2681228bb4d58b22101a9bab49d5b', 'request_id': 'req-675f47e9-7ae0-4fba-89fe-e65bc355ff80'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:13.086890 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-675f47e9-7ae0-4fba-89fe-e65bc355ff80 admin admin] The token cache is being invalidate because project eaa2681228bb4d58b22101a9bab49d5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:13.087341 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-675f47e9-7ae0-4fba-89fe-e65bc355ff80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:13.088384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-675f47e9-7ae0-4fba-89fe-e65bc355ff80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:13.092498 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1036/2068] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:12 2022] DELETE /identity/v3/projects/eaa2681228bb4d58b22101a9bab49d5b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:13.098255 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb83843-46b0-4dfe-8c5d-31ab2f4eb70f None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:13.098823 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb83843-46b0-4dfe-8c5d-31ab2f4eb70f None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:13.099282 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb83843-46b0-4dfe-8c5d-31ab2f4eb70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:13.124763 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff906e-f14d-4094-95f0-cb928522b13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:13.125675 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff906e-f14d-4094-95f0-cb928522b13b admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:13.126090 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff906e-f14d-4094-95f0-cb928522b13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:13.126506 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff906e-f14d-4094-95f0-cb928522b13b admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:13.128376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff906e-f14d-4094-95f0-cb928522b13b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:13.131208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dff906e-f14d-4094-95f0-cb928522b13b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:13.142492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-dbb83843-46b0-4dfe-8c5d-31ab2f4eb70f None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:13.143783 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-dbb83843-46b0-4dfe-8c5d-31ab2f4eb70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:13.143948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:13.166659 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1037/2069] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:43:13.179361 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b6867-a50f-47fd-9075-8037fb804cb6 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:13.179686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b6867-a50f-47fd-9075-8037fb804cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:13.180516 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b6867-a50f-47fd-9075-8037fb804cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:13.191959 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1033/2070] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:43:12 2022] POST /identity/v3/projects => generated 393 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:13.196984 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff906e-f14d-4094-95f0-cb928522b13b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:13.199467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1dff906e-f14d-4094-95f0-cb928522b13b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:13.223709 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-c40b6867-a50f-47fd-9075-8037fb804cb6 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:13.225084 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c40b6867-a50f-47fd-9075-8037fb804cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:13.334520 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1038/2071] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:43:13.338292 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b6867-a50f-47fd-9075-8037fb804cb6 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:13.339709 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff906e-f14d-4094-95f0-cb928522b13b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:13.344852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8c5ab-f34e-4709-a504-afa3c94eb654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:13.345652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8c5ab-f34e-4709-a504-afa3c94eb654 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:13.346008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8c5ab-f34e-4709-a504-afa3c94eb654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:13.346383 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8c5ab-f34e-4709-a504-afa3c94eb654 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:13.347295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8c5ab-f34e-4709-a504-afa3c94eb654 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:13.349516 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8c5ab-f34e-4709-a504-afa3c94eb654 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:13.354252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b6867-a50f-47fd-9075-8037fb804cb6 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:13.364036 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71671603-f6eb-48c6-a1f8-0cf04d5fe5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:13.365071 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71671603-f6eb-48c6-a1f8-0cf04d5fe5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:13.365450 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71671603-f6eb-48c6-a1f8-0cf04d5fe5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:13.365784 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71671603-f6eb-48c6-a1f8-0cf04d5fe5a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:13.366529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71671603-f6eb-48c6-a1f8-0cf04d5fe5a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:43:13.366961 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71671603-f6eb-48c6-a1f8-0cf04d5fe5a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:13.369640 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71671603-f6eb-48c6-a1f8-0cf04d5fe5a5 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:13.376651 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1034/2072] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:43:13 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:13.381035 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8c5ab-f34e-4709-a504-afa3c94eb654 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:13.388913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1039/2073] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:43:13.391935 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71671603-f6eb-48c6-a1f8-0cf04d5fe5a5 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:13.392213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8c5ab-f34e-4709-a504-afa3c94eb654 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:13.401522 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb91d9-fb37-4475-a9e8-6ea2b1ca6ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:13.402207 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb91d9-fb37-4475-a9e8-6ea2b1ca6ccf admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:13.402507 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb91d9-fb37-4475-a9e8-6ea2b1ca6ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:13.402793 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb91d9-fb37-4475-a9e8-6ea2b1ca6ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:13.403597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71671603-f6eb-48c6-a1f8-0cf04d5fe5a5 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:13.403723 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb91d9-fb37-4475-a9e8-6ea2b1ca6ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:13.406234 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb91d9-fb37-4475-a9e8-6ea2b1ca6ccf admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:13.409508 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a41e6-12da-4c84-9cdb-6deec1c22922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:13.410852 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a41e6-12da-4c84-9cdb-6deec1c22922 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:13.411203 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a41e6-12da-4c84-9cdb-6deec1c22922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:13.411552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a41e6-12da-4c84-9cdb-6deec1c22922 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:13.412361 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a41e6-12da-4c84-9cdb-6deec1c22922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:13.414792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a41e6-12da-4c84-9cdb-6deec1c22922 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:13.425204 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1035/2074] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:13.426948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb91d9-fb37-4475-a9e8-6ea2b1ca6ccf admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:13.439485 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb91d9-fb37-4475-a9e8-6ea2b1ca6ccf admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:13.449430 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1040/2075] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:43:13 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:43:13.449595 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd9936-699d-4734-b850-78594362eec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:13.449595 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd9936-699d-4734-b850-78594362eec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:13.449595 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd9936-699d-4734-b850-78594362eec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:13.449595 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd9936-699d-4734-b850-78594362eec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:13.449963 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd9936-699d-4734-b850-78594362eec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:13.451032 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a41e6-12da-4c84-9cdb-6deec1c22922 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:13.451704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd9936-699d-4734-b850-78594362eec9 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:13.467711 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1036/2076] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:13.469351 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd9936-699d-4734-b850-78594362eec9 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:13.481882 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd9936-699d-4734-b850-78594362eec9 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:13.523041 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a41e6-12da-4c84-9cdb-6deec1c22922 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:13.530002 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3997ef-94cc-4582-90d5-93ca186a2960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:13.531250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3997ef-94cc-4582-90d5-93ca186a2960 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:13.531828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3997ef-94cc-4582-90d5-93ca186a2960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:13.532367 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3997ef-94cc-4582-90d5-93ca186a2960 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:13.533211 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3997ef-94cc-4582-90d5-93ca186a2960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:13.536210 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3997ef-94cc-4582-90d5-93ca186a2960 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:13.546244 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:13.553508 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d587b6-01a6-4c38-b603-adb898c33d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:13.554749 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d587b6-01a6-4c38-b603-adb898c33d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:13.555079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d587b6-01a6-4c38-b603-adb898c33d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:13.555481 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d587b6-01a6-4c38-b603-adb898c33d8e admin admin] PATH_INFO: `/v3/projects/99ad4fec1b5b45029a4f4b3c1e47e854/users/da321436f26d4150a1714664bda9d11f/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:13.569608 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1041/2077] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:43:13 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:13.571511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d89b8-029d-4575-b0eb-c22484775475 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:13.571809 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d89b8-029d-4575-b0eb-c22484775475 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:13.572084 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d89b8-029d-4575-b0eb-c22484775475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:13.573113 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d587b6-01a6-4c38-b603-adb898c33d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ad4fec1b5b45029a4f4b3c1e47e854, user_id=da321436f26d4150a1714664bda9d11f, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:13.576312 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d587b6-01a6-4c38-b603-adb898c33d8e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:13.591763 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1037/2078] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:13 2022] PUT /identity/v3/projects/99ad4fec1b5b45029a4f4b3c1e47e854/users/da321436f26d4150a1714664bda9d11f/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:13.592728 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d587b6-01a6-4c38-b603-adb898c33d8e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:13.609470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-458d89b8-029d-4575-b0eb-c22484775475 None None] MFA Rules not processed for user `28d3ec84930249cca81f18b462d8240b`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:13.610794 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-458d89b8-029d-4575-b0eb-c22484775475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:13.672466 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:13.693293 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1042/2079] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:13.694833 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd0d4d-0a2f-4d4b-b5a6-abf81920d1d2 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:13.695192 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd0d4d-0a2f-4d4b-b5a6-abf81920d1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:13.695639 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd0d4d-0a2f-4d4b-b5a6-abf81920d1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:13.713162 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d587b6-01a6-4c38-b603-adb898c33d8e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:13.722138 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c57455-acdf-46b4-95a6-bf63ac41c692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:13.723796 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c57455-acdf-46b4-95a6-bf63ac41c692 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:13.724752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c57455-acdf-46b4-95a6-bf63ac41c692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:13.725124 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c57455-acdf-46b4-95a6-bf63ac41c692 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:13.726169 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c57455-acdf-46b4-95a6-bf63ac41c692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:13.728452 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-0dfd0d4d-0a2f-4d4b-b5a6-abf81920d1d2 None None] MFA Rules not processed for user `da321436f26d4150a1714664bda9d11f`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:13.729729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-0dfd0d4d-0a2f-4d4b-b5a6-abf81920d1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:13.730108 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c57455-acdf-46b4-95a6-bf63ac41c692 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:13.745048 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1038/2080] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:13.745947 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c57455-acdf-46b4-95a6-bf63ac41c692 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:13.749572 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f4c57455-acdf-46b4-95a6-bf63ac41c692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:13.765268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c57455-acdf-46b4-95a6-bf63ac41c692 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:13.773913 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64993d-06be-4d0b-bf0c-56b4d47eee74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:13.778458 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64993d-06be-4d0b-bf0c-56b4d47eee74 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:13.778876 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64993d-06be-4d0b-bf0c-56b4d47eee74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:13.780603 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64993d-06be-4d0b-bf0c-56b4d47eee74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:13.781493 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64993d-06be-4d0b-bf0c-56b4d47eee74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:13.783899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d64993d-06be-4d0b-bf0c-56b4d47eee74 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:13.823651 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1039/2081] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:43:13 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:13.828653 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64993d-06be-4d0b-bf0c-56b4d47eee74 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:13.833515 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1043/2082] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:13.834429 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd0d4d-0a2f-4d4b-b5a6-abf81920d1d2 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:13.846432 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfd0d4d-0a2f-4d4b-b5a6-abf81920d1d2 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:13.926062 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64993d-06be-4d0b-bf0c-56b4d47eee74 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:13.928062 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b2a91-4444-45f1-a213-cb3369b6f263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:13.928746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b2a91-4444-45f1-a213-cb3369b6f263 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:13.929033 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b2a91-4444-45f1-a213-cb3369b6f263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:13.929314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b2a91-4444-45f1-a213-cb3369b6f263 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:13.930083 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b2a91-4444-45f1-a213-cb3369b6f263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:13.932204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b2a91-4444-45f1-a213-cb3369b6f263 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:13.932568 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d204fdd-06f6-4673-aa02-b048d0715cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:13.933796 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d204fdd-06f6-4673-aa02-b048d0715cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:13.934150 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d204fdd-06f6-4673-aa02-b048d0715cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:13.934511 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d204fdd-06f6-4673-aa02-b048d0715cc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:13.935309 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d204fdd-06f6-4673-aa02-b048d0715cc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:13.936969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d204fdd-06f6-4673-aa02-b048d0715cc8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:13.948246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:13.948673 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1040/2083] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:13.949565 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d204fdd-06f6-4673-aa02-b048d0715cc8 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:13.960153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d204fdd-06f6-4673-aa02-b048d0715cc8 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:13.961930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1044/2084] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:43:13 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:13.962978 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b2a91-4444-45f1-a213-cb3369b6f263 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:13.966186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bdfc2-824b-46d7-919f-5bbbc20d1cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:13.966828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bdfc2-824b-46d7-919f-5bbbc20d1cc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:13.967113 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bdfc2-824b-46d7-919f-5bbbc20d1cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:13.967416 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4bdfc2-824b-46d7-919f-5bbbc20d1cc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:13.968107 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4bdfc2-824b-46d7-919f-5bbbc20d1cc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:13.970062 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4bdfc2-824b-46d7-919f-5bbbc20d1cc8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:13.973224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b2a91-4444-45f1-a213-cb3369b6f263 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:13.978592 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde75ac-07ef-493b-b74c-2aface7fd66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:13.979461 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde75ac-07ef-493b-b74c-2aface7fd66a admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:13.979743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde75ac-07ef-493b-b74c-2aface7fd66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:13.980018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde75ac-07ef-493b-b74c-2aface7fd66a admin admin] PATH_INFO: `/v3/projects/ca2063b43b24440e82872471fa978f37/users/7b71c119a6fa4dfa8052e6651818b4b1/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:13.995936 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde75ac-07ef-493b-b74c-2aface7fd66a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca2063b43b24440e82872471fa978f37, user_id=7b71c119a6fa4dfa8052e6651818b4b1, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:13.998638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde75ac-07ef-493b-b74c-2aface7fd66a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:13.999807 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1041/2085] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:43:13 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:14.000918 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bdfc2-824b-46d7-919f-5bbbc20d1cc8 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:14.020250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1045/2086] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:13 2022] PUT /identity/v3/projects/ca2063b43b24440e82872471fa978f37/users/7b71c119a6fa4dfa8052e6651818b4b1/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:14.021512 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde75ac-07ef-493b-b74c-2aface7fd66a admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:14.082772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4bdfc2-824b-46d7-919f-5bbbc20d1cc8 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:14.088570 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e457a-61c8-4987-bde3-b0388ab95e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:14.089235 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e457a-61c8-4987-bde3-b0388ab95e8d admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:14.089561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e457a-61c8-4987-bde3-b0388ab95e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:14.089836 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e457a-61c8-4987-bde3-b0388ab95e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:14.090561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e457a-61c8-4987-bde3-b0388ab95e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:14.091167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde75ac-07ef-493b-b74c-2aface7fd66a admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:14.092176 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e457a-61c8-4987-bde3-b0388ab95e8d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:14.096087 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c040b8-3957-453d-bb38-a9c55d651ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:14.096802 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c040b8-3957-453d-bb38-a9c55d651ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:14.097035 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c040b8-3957-453d-bb38-a9c55d651ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:14.097313 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c040b8-3957-453d-bb38-a9c55d651ed1 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:14.098033 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c040b8-3957-453d-bb38-a9c55d651ed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:14.099930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c040b8-3957-453d-bb38-a9c55d651ed1 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:14.103241 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1042/2087] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:14.107771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea76884-9785-43eb-b9a8-483934ff879d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:14.108063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea76884-9785-43eb-b9a8-483934ff879d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:14.108345 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea76884-9785-43eb-b9a8-483934ff879d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:14.121710 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1046/2088] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:43:14 2022] POST /identity/v3/users => generated 303 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:14.122979 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c040b8-3957-453d-bb38-a9c55d651ed1 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:14.135314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c040b8-3957-453d-bb38-a9c55d651ed1 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:14.136963 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-5ea76884-9785-43eb-b9a8-483934ff879d None None] MFA Rules not processed for user `7b71c119a6fa4dfa8052e6651818b4b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:14.138203 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5ea76884-9785-43eb-b9a8-483934ff879d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:14.140216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b61b5-939a-4305-bc94-6cfbaf3f83ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:14.141092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b61b5-939a-4305-bc94-6cfbaf3f83ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:14.141409 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b61b5-939a-4305-bc94-6cfbaf3f83ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:14.141692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b61b5-939a-4305-bc94-6cfbaf3f83ab admin admin] PATH_INFO: `/v3/projects/53ca5bd084204aa6a6c47c9cd44f7f7e/users/fbd971d7071c45f2b23064f2cfac7ce4/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:14.150504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:14.159183 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b61b5-939a-4305-bc94-6cfbaf3f83ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ca5bd084204aa6a6c47c9cd44f7f7e, user_id=fbd971d7071c45f2b23064f2cfac7ce4, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:14.161982 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b61b5-939a-4305-bc94-6cfbaf3f83ab admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:14.176671 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1047/2089] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:14 2022] PUT /identity/v3/projects/53ca5bd084204aa6a6c47c9cd44f7f7e/users/fbd971d7071c45f2b23064f2cfac7ce4/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:14.177653 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b61b5-939a-4305-bc94-6cfbaf3f83ab admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:14.212290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1043/2090] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:14.212951 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea76884-9785-43eb-b9a8-483934ff879d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:14.223223 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea76884-9785-43eb-b9a8-483934ff879d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:14.245744 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b61b5-939a-4305-bc94-6cfbaf3f83ab admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:14.251235 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c9999-81f9-43a0-9638-9b5ed7e4f292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:14.251920 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c9999-81f9-43a0-9638-9b5ed7e4f292 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:14.252200 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c9999-81f9-43a0-9638-9b5ed7e4f292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:14.252469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c9999-81f9-43a0-9638-9b5ed7e4f292 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:14.253194 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c9999-81f9-43a0-9638-9b5ed7e4f292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:14.254862 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c9999-81f9-43a0-9638-9b5ed7e4f292 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:14.265910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1048/2091] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:14.266805 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c9999-81f9-43a0-9638-9b5ed7e4f292 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:14.277138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c9999-81f9-43a0-9638-9b5ed7e4f292 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:14.280176 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8608eac-327d-4a60-938a-818f3c8f21db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:14.281101 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608eac-327d-4a60-938a-818f3c8f21db admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:14.281410 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608eac-327d-4a60-938a-818f3c8f21db admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:14.281677 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8608eac-327d-4a60-938a-818f3c8f21db admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:14.282316 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908a110-0365-40a8-a1d9-82308459f5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:14.282501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8608eac-327d-4a60-938a-818f3c8f21db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:14.282968 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908a110-0365-40a8-a1d9-82308459f5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:14.283238 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908a110-0365-40a8-a1d9-82308459f5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:14.283516 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1908a110-0365-40a8-a1d9-82308459f5f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:14.284058 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8608eac-327d-4a60-938a-818f3c8f21db admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:14.284236 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908a110-0365-40a8-a1d9-82308459f5f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:14.286136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1908a110-0365-40a8-a1d9-82308459f5f4 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:14.294000 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1044/2092] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:14.294956 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8608eac-327d-4a60-938a-818f3c8f21db admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:14.306844 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8608eac-327d-4a60-938a-818f3c8f21db admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:14.312722 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f1dc6-3f0e-48c4-9ca3-a989f03bb3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:14.313698 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f1dc6-3f0e-48c4-9ca3-a989f03bb3df admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:14.313982 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f1dc6-3f0e-48c4-9ca3-a989f03bb3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:14.314260 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081f1dc6-3f0e-48c4-9ca3-a989f03bb3df admin admin] PATH_INFO: `/v3/projects/71c094f28e8e41c59083e8c12d387512/users/59c504915c1b4377983440c20f9bfbd2/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:14.321586 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1049/2093] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:43:14 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:14.322588 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908a110-0365-40a8-a1d9-82308459f5f4 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:14.332705 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f1dc6-3f0e-48c4-9ca3-a989f03bb3df admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c094f28e8e41c59083e8c12d387512, user_id=59c504915c1b4377983440c20f9bfbd2, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:14.335448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081f1dc6-3f0e-48c4-9ca3-a989f03bb3df admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:14.346422 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:14.350938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1045/2094] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:14 2022] PUT /identity/v3/projects/71c094f28e8e41c59083e8c12d387512/users/59c504915c1b4377983440c20f9bfbd2/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:14.351789 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f1dc6-3f0e-48c4-9ca3-a989f03bb3df admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:14.401955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1908a110-0365-40a8-a1d9-82308459f5f4 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:14.427451 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081f1dc6-3f0e-48c4-9ca3-a989f03bb3df admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:14.433695 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06b5de-72fb-4b20-9a61-1023a28ae2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:14.434365 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06b5de-72fb-4b20-9a61-1023a28ae2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:14.434659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06b5de-72fb-4b20-9a61-1023a28ae2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:14.434940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06b5de-72fb-4b20-9a61-1023a28ae2a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:14.435638 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06b5de-72fb-4b20-9a61-1023a28ae2a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:14.437744 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06b5de-72fb-4b20-9a61-1023a28ae2a9 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:14.460936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1046/2095] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:43:14 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:14.462842 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06b5de-72fb-4b20-9a61-1023a28ae2a9 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:14.466158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c941c9-625d-4269-9203-c05c95dd7557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:14.467019 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c941c9-625d-4269-9203-c05c95dd7557 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:14.467307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c941c9-625d-4269-9203-c05c95dd7557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:14.467589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c941c9-625d-4269-9203-c05c95dd7557 admin admin] PATH_INFO: `/v3/projects/53ca5bd084204aa6a6c47c9cd44f7f7e/users/fbd971d7071c45f2b23064f2cfac7ce4/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:14.469697 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c941c9-625d-4269-9203-c05c95dd7557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ca5bd084204aa6a6c47c9cd44f7f7e, user_id=fbd971d7071c45f2b23064f2cfac7ce4, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:14.472351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c941c9-625d-4269-9203-c05c95dd7557 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:14.475186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06b5de-72fb-4b20-9a61-1023a28ae2a9 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:14.481149 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecee62-716d-46c5-89fd-50fb50c739cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:14.481802 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecee62-716d-46c5-89fd-50fb50c739cf admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:14.482250 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecee62-716d-46c5-89fd-50fb50c739cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:14.482537 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecee62-716d-46c5-89fd-50fb50c739cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:14.483269 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecee62-716d-46c5-89fd-50fb50c739cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:14.483727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1050/2096] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:14 2022] PUT /identity/v3/projects/53ca5bd084204aa6a6c47c9cd44f7f7e/users/fbd971d7071c45f2b23064f2cfac7ce4/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:14.485056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecee62-716d-46c5-89fd-50fb50c739cf admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:14.486528 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c941c9-625d-4269-9203-c05c95dd7557 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:14.496760 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1047/2097] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:14.500721 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecee62-716d-46c5-89fd-50fb50c739cf admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:14.507570 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:14.511503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecee62-716d-46c5-89fd-50fb50c739cf admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:14.571754 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c941c9-625d-4269-9203-c05c95dd7557 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:14.577816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52efa03-183f-4f13-b593-1a81a402a383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:14.578560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52efa03-183f-4f13-b593-1a81a402a383 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:14.578707 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b93b1-5f60-44e2-bee2-7aa3154b1b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:14.579336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52efa03-183f-4f13-b593-1a81a402a383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:14.579336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52efa03-183f-4f13-b593-1a81a402a383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:14.579938 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52efa03-183f-4f13-b593-1a81a402a383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:14.580272 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b93b1-5f60-44e2-bee2-7aa3154b1b17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:14.580466 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b93b1-5f60-44e2-bee2-7aa3154b1b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:14.580745 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b93b1-5f60-44e2-bee2-7aa3154b1b17 admin admin] PATH_INFO: `/v3/projects/71c094f28e8e41c59083e8c12d387512/users/59c504915c1b4377983440c20f9bfbd2/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:14.581997 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52efa03-183f-4f13-b593-1a81a402a383 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:14.582918 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b93b1-5f60-44e2-bee2-7aa3154b1b17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c094f28e8e41c59083e8c12d387512, user_id=59c504915c1b4377983440c20f9bfbd2, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:14.586829 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b93b1-5f60-44e2-bee2-7aa3154b1b17 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:14.594344 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1051/2098] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:14.599744 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52efa03-183f-4f13-b593-1a81a402a383 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:14.603966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1048/2099] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:14 2022] PUT /identity/v3/projects/71c094f28e8e41c59083e8c12d387512/users/59c504915c1b4377983440c20f9bfbd2/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:14.614270 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52efa03-183f-4f13-b593-1a81a402a383 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:14.614478 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea1562-420b-4084-a510-6508b390609f None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:14.614736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea1562-420b-4084-a510-6508b390609f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:14.615051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea1562-420b-4084-a510-6508b390609f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:14.644722 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d5ea1562-420b-4084-a510-6508b390609f None None] MFA Rules not processed for user `59c504915c1b4377983440c20f9bfbd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:14.646067 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d5ea1562-420b-4084-a510-6508b390609f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:14.675764 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:14.698729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f67f2-3a64-43ef-a682-97664ea7e92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:14.699643 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f67f2-3a64-43ef-a682-97664ea7e92b admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:14.699928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f67f2-3a64-43ef-a682-97664ea7e92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:14.700203 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f67f2-3a64-43ef-a682-97664ea7e92b admin admin] PATH_INFO: `/v3/projects/e7036ed110bb49cd98affba4c01ad81f/users/e823d649ea1e4026b56c5fb652bc8f41/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:14.716122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f67f2-3a64-43ef-a682-97664ea7e92b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7036ed110bb49cd98affba4c01ad81f, user_id=e823d649ea1e4026b56c5fb652bc8f41, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:14.719046 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f67f2-3a64-43ef-a682-97664ea7e92b admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:14.733441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1052/2100] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:14 2022] PUT /identity/v3/projects/e7036ed110bb49cd98affba4c01ad81f/users/e823d649ea1e4026b56c5fb652bc8f41/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:14.735969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1049/2101] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:43:14.737256 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f67f2-3a64-43ef-a682-97664ea7e92b admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:14.747178 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea1562-420b-4084-a510-6508b390609f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:14.748693 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d5ea1562-420b-4084-a510-6508b390609f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:14.812888 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f67f2-3a64-43ef-a682-97664ea7e92b admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:14.819732 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f3c52-85a1-4f20-b218-1a63c19f2609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:14.821071 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f3c52-85a1-4f20-b218-1a63c19f2609 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:14.821356 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f3c52-85a1-4f20-b218-1a63c19f2609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:14.821682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f3c52-85a1-4f20-b218-1a63c19f2609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:14.822556 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f3c52-85a1-4f20-b218-1a63c19f2609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:14.825077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f3c52-85a1-4f20-b218-1a63c19f2609 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:14.826552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea1562-420b-4084-a510-6508b390609f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:14.846909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1053/2102] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:43:14.852107 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f3c52-85a1-4f20-b218-1a63c19f2609 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:14.866262 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f3c52-85a1-4f20-b218-1a63c19f2609 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:14.872785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53020c-f49a-4299-9146-857f587f9a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:14.873712 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53020c-f49a-4299-9146-857f587f9a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:14.873997 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53020c-f49a-4299-9146-857f587f9a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:14.874275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53020c-f49a-4299-9146-857f587f9a35 admin admin] PATH_INFO: `/v3/projects/e7036ed110bb49cd98affba4c01ad81f/users/e823d649ea1e4026b56c5fb652bc8f41/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:14.876652 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53020c-f49a-4299-9146-857f587f9a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7036ed110bb49cd98affba4c01ad81f, user_id=e823d649ea1e4026b56c5fb652bc8f41, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:14.878197 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:14.879373 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53020c-f49a-4299-9146-857f587f9a35 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:14.893687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1054/2103] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:14 2022] PUT /identity/v3/projects/e7036ed110bb49cd98affba4c01ad81f/users/e823d649ea1e4026b56c5fb652bc8f41/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:14.912128 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdc312-bb07-4794-89c3-cf88f18cd0d9 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:14.912313 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdc312-bb07-4794-89c3-cf88f18cd0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:14.912599 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdc312-bb07-4794-89c3-cf88f18cd0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:14.924627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cb20c-3b71-4cbe-acf6-9d7471a766a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:14.925290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cb20c-3b71-4cbe-acf6-9d7471a766a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:14.925604 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cb20c-3b71-4cbe-acf6-9d7471a766a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:14.927272 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695cb20c-3b71-4cbe-acf6-9d7471a766a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:14.969209 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-95bdc312-bb07-4794-89c3-cf88f18cd0d9 None None] MFA Rules not processed for user `e823d649ea1e4026b56c5fb652bc8f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:14.981579 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-95bdc312-bb07-4794-89c3-cf88f18cd0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:15.067658 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695cb20c-3b71-4cbe-acf6-9d7471a766a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:15.072275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695cb20c-3b71-4cbe-acf6-9d7471a766a2 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:15.099888 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1050/2104] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:43:15.125825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1055/2105] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:15.137823 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cb20c-3b71-4cbe-acf6-9d7471a766a2 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:15.140997 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-695cb20c-3b71-4cbe-acf6-9d7471a766a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:15.156477 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695cb20c-3b71-4cbe-acf6-9d7471a766a2 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:15.187639 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdc312-bb07-4794-89c3-cf88f18cd0d9 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:15.240918 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ebe26-7581-4858-bd65-aeda39070f38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:15.242128 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ebe26-7581-4858-bd65-aeda39070f38 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:15.242128 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ebe26-7581-4858-bd65-aeda39070f38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:15.242892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ebe26-7581-4858-bd65-aeda39070f38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:15.291536 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:15.310873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdc312-bb07-4794-89c3-cf88f18cd0d9 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:15.315063 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62da22-9a5a-4d10-a295-e3b0be00c8f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:15.315811 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62da22-9a5a-4d10-a295-e3b0be00c8f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:15.316074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62da22-9a5a-4d10-a295-e3b0be00c8f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:15.316347 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62da22-9a5a-4d10-a295-e3b0be00c8f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:15.353850 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ebe26-7581-4858-bd65-aeda39070f38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:15.356622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ebe26-7581-4858-bd65-aeda39070f38 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:15.368815 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1051/2106] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:43:15.370518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e5db2-e7b4-4803-b13a-dc4c20655862 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:15.370795 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e5db2-e7b4-4803-b13a-dc4c20655862 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:15.370977 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e5db2-e7b4-4803-b13a-dc4c20655862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:15.411407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62da22-9a5a-4d10-a295-e3b0be00c8f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:15.412991 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62da22-9a5a-4d10-a295-e3b0be00c8f3 service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:15.416485 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ac1e5db2-e7b4-4803-b13a-dc4c20655862 None None] MFA Rules not processed for user `fbd971d7071c45f2b23064f2cfac7ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:15.417808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ac1e5db2-e7b4-4803-b13a-dc4c20655862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:15.442077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1056/2107] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:43:15.466246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:15.527600 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1052/2108] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:15.709567 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62da22-9a5a-4d10-a295-e3b0be00c8f3 service cinder] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:15.719593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62da22-9a5a-4d10-a295-e3b0be00c8f3 service cinder] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:15.724200 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1456638-46f6-43db-a7eb-7b29d1ce796e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:15.724947 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1456638-46f6-43db-a7eb-7b29d1ce796e service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:15.725234 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1456638-46f6-43db-a7eb-7b29d1ce796e service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:15.725669 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1456638-46f6-43db-a7eb-7b29d1ce796e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:15.797283 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1456638-46f6-43db-a7eb-7b29d1ce796e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:15.798749 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1456638-46f6-43db-a7eb-7b29d1ce796e service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:15.827845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1057/2109] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:43:17.172895 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e5db2-e7b4-4803-b13a-dc4c20655862 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:17.182273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e5db2-e7b4-4803-b13a-dc4c20655862 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:17.185894 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e56e71-d76b-4f31-b2cb-3f1ad69f92cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:17.186493 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e56e71-d76b-4f31-b2cb-3f1ad69f92cc service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:17.186776 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e56e71-d76b-4f31-b2cb-3f1ad69f92cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:17.187051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e56e71-d76b-4f31-b2cb-3f1ad69f92cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:17.196938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e56e71-d76b-4f31-b2cb-3f1ad69f92cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:17.198495 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e56e71-d76b-4f31-b2cb-3f1ad69f92cc service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:17.207886 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1053/2110] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:43:18.103373 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1456638-46f6-43db-a7eb-7b29d1ce796e service cinder] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:18.166946 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1456638-46f6-43db-a7eb-7b29d1ce796e service cinder] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:18.171463 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614e72c-43be-4abc-9330-e0f886bdb940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:18.172330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614e72c-43be-4abc-9330-e0f886bdb940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:18.172609 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614e72c-43be-4abc-9330-e0f886bdb940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:18.172884 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614e72c-43be-4abc-9330-e0f886bdb940 admin admin] PATH_INFO: `/v3/users/7b71c119a6fa4dfa8052e6651818b4b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:18.174072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614e72c-43be-4abc-9330-e0f886bdb940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b71c119a6fa4dfa8052e6651818b4b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:18.175985 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614e72c-43be-4abc-9330-e0f886bdb940 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:18.219704 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:18.224358 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6614e72c-43be-4abc-9330-e0f886bdb940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b71c119a6fa4dfa8052e6651818b4b1'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:18.225518 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6614e72c-43be-4abc-9330-e0f886bdb940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b71c119a6fa4dfa8052e6651818b4b1'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:18.233031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6614e72c-43be-4abc-9330-e0f886bdb940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b71c119a6fa4dfa8052e6651818b4b1'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:18.239908 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6614e72c-43be-4abc-9330-e0f886bdb940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b71c119a6fa4dfa8052e6651818b4b1'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:18.252194 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-6614e72c-43be-4abc-9330-e0f886bdb940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b71c119a6fa4dfa8052e6651818b4b1'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:18.258103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1058/2111] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:18 2022] DELETE /identity/v3/users/7b71c119a6fa4dfa8052e6651818b4b1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:18.263236 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245bdae-1b4c-4eeb-b255-23bb9bd1cef5 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:18.263694 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245bdae-1b4c-4eeb-b255-23bb9bd1cef5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:18.263782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245bdae-1b4c-4eeb-b255-23bb9bd1cef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:18.281334 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9245bdae-1b4c-4eeb-b255-23bb9bd1cef5 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:18.282575 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9245bdae-1b4c-4eeb-b255-23bb9bd1cef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:18.341271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1054/2112] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:18.350825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614e72c-43be-4abc-9330-e0f886bdb940 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:18.352230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-6614e72c-43be-4abc-9330-e0f886bdb940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:18.409394 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614e72c-43be-4abc-9330-e0f886bdb940 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:18.413011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92df3db-260d-48f5-a2f8-afc01fb9317c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:18.413691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92df3db-260d-48f5-a2f8-afc01fb9317c service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:18.413974 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92df3db-260d-48f5-a2f8-afc01fb9317c service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:18.414252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92df3db-260d-48f5-a2f8-afc01fb9317c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:18.423452 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92df3db-260d-48f5-a2f8-afc01fb9317c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:18.424871 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92df3db-260d-48f5-a2f8-afc01fb9317c service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:18.435028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1059/2113] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:43:18.754637 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245bdae-1b4c-4eeb-b255-23bb9bd1cef5 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:18.757823 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9245bdae-1b4c-4eeb-b255-23bb9bd1cef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:18.791742 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245bdae-1b4c-4eeb-b255-23bb9bd1cef5 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:18.796802 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdfc21-3f0c-4f9c-8aaa-2962553d6272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:18.797756 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdfc21-3f0c-4f9c-8aaa-2962553d6272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:18.798033 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdfc21-3f0c-4f9c-8aaa-2962553d6272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:18.798311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdfc21-3f0c-4f9c-8aaa-2962553d6272 admin admin] PATH_INFO: `/v3/projects/ca2063b43b24440e82872471fa978f37` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:18.799518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fdfc21-3f0c-4f9c-8aaa-2962553d6272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca2063b43b24440e82872471fa978f37)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:18.803452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fdfc21-3f0c-4f9c-8aaa-2962553d6272 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:18.886010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d2fdfc21-3f0c-4f9c-8aaa-2962553d6272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca2063b43b24440e82872471fa978f37', 'request_id': 'req-d2fdfc21-3f0c-4f9c-8aaa-2962553d6272'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:18.892827 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d2fdfc21-3f0c-4f9c-8aaa-2962553d6272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca2063b43b24440e82872471fa978f37', 'request_id': 'req-d2fdfc21-3f0c-4f9c-8aaa-2962553d6272'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:18.901070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d2fdfc21-3f0c-4f9c-8aaa-2962553d6272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca2063b43b24440e82872471fa978f37', 'request_id': 'req-d2fdfc21-3f0c-4f9c-8aaa-2962553d6272'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:18.916509 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d2fdfc21-3f0c-4f9c-8aaa-2962553d6272 admin admin] The token cache is being invalidate because project ca2063b43b24440e82872471fa978f37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:18.916852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d2fdfc21-3f0c-4f9c-8aaa-2962553d6272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:18.917582 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-d2fdfc21-3f0c-4f9c-8aaa-2962553d6272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:18.919496 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1055/2114] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:18 2022] DELETE /identity/v3/projects/ca2063b43b24440e82872471fa978f37 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:18.923428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92df3db-260d-48f5-a2f8-afc01fb9317c service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:18.936149 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92df3db-260d-48f5-a2f8-afc01fb9317c service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:19.010878 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a2730-d626-4289-a4ab-092f372f635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:19.011791 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a2730-d626-4289-a4ab-092f372f635f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:19.011996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a2730-d626-4289-a4ab-092f372f635f admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:19.012280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a2730-d626-4289-a4ab-092f372f635f admin admin] PATH_INFO: `/v3/users/e823d649ea1e4026b56c5fb652bc8f41` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:19.013586 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a2730-d626-4289-a4ab-092f372f635f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e823d649ea1e4026b56c5fb652bc8f41)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:19.015822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a2730-d626-4289-a4ab-092f372f635f admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:19.018899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdfc21-3f0c-4f9c-8aaa-2962553d6272 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:19.020726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d2fdfc21-3f0c-4f9c-8aaa-2962553d6272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:19.036830 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdfc21-3f0c-4f9c-8aaa-2962553d6272 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:19.041798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f84b7-8a97-4500-a1ed-2973f7193469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:19.042665 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f84b7-8a97-4500-a1ed-2973f7193469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:19.042970 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f84b7-8a97-4500-a1ed-2973f7193469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:19.043245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f84b7-8a97-4500-a1ed-2973f7193469 admin admin] PATH_INFO: `/v3/users/da321436f26d4150a1714664bda9d11f` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:19.044450 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f84b7-8a97-4500-a1ed-2973f7193469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da321436f26d4150a1714664bda9d11f)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:19.046442 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f84b7-8a97-4500-a1ed-2973f7193469 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:19.073465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-4b2a2730-d626-4289-a4ab-092f372f635f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e823d649ea1e4026b56c5fb652bc8f41'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:19.074679 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-4b2a2730-d626-4289-a4ab-092f372f635f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e823d649ea1e4026b56c5fb652bc8f41'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:19.082891 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-4b2a2730-d626-4289-a4ab-092f372f635f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e823d649ea1e4026b56c5fb652bc8f41'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:19.090181 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:19.093010 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-4b2a2730-d626-4289-a4ab-092f372f635f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e823d649ea1e4026b56c5fb652bc8f41'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:19.098742 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:19.115039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-734f84b7-8a97-4500-a1ed-2973f7193469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da321436f26d4150a1714664bda9d11f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:19.115738 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-734f84b7-8a97-4500-a1ed-2973f7193469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da321436f26d4150a1714664bda9d11f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:19.118231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-4b2a2730-d626-4289-a4ab-092f372f635f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e823d649ea1e4026b56c5fb652bc8f41'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:19.125904 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1060/2115] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:18 2022] DELETE /identity/v3/users/e823d649ea1e4026b56c5fb652bc8f41 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:19.127030 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-734f84b7-8a97-4500-a1ed-2973f7193469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da321436f26d4150a1714664bda9d11f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:19.138067 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-734f84b7-8a97-4500-a1ed-2973f7193469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da321436f26d4150a1714664bda9d11f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:19.153740 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-734f84b7-8a97-4500-a1ed-2973f7193469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da321436f26d4150a1714664bda9d11f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:19.163725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1056/2116] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:19 2022] DELETE /identity/v3/users/da321436f26d4150a1714664bda9d11f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:19.166035 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557da4b-8e83-4873-b657-77a9448d3bc5 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:19.166451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557da4b-8e83-4873-b657-77a9448d3bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:19.166822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b557da4b-8e83-4873-b657-77a9448d3bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:19.188912 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-b557da4b-8e83-4873-b657-77a9448d3bc5 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:19.190433 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b557da4b-8e83-4873-b657-77a9448d3bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:19.268889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1061/2117] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:43:19.277125 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f84b7-8a97-4500-a1ed-2973f7193469 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:19.278831 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-734f84b7-8a97-4500-a1ed-2973f7193469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:19.360851 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f84b7-8a97-4500-a1ed-2973f7193469 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:19.365720 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5464a2c-3416-45a0-b316-26bf244ca3cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:19.365862 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5464a2c-3416-45a0-b316-26bf244ca3cc service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:19.366258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5464a2c-3416-45a0-b316-26bf244ca3cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:19.366611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5464a2c-3416-45a0-b316-26bf244ca3cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:19.377139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5464a2c-3416-45a0-b316-26bf244ca3cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:19.378741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5464a2c-3416-45a0-b316-26bf244ca3cc service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:19.391894 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1057/2118] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:43:19.472488 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557da4b-8e83-4873-b657-77a9448d3bc5 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:19.473954 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b557da4b-8e83-4873-b657-77a9448d3bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:19.486311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b557da4b-8e83-4873-b657-77a9448d3bc5 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:19.491889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98594326-64a3-4e73-baae-a78b60d60e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:19.492893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98594326-64a3-4e73-baae-a78b60d60e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:19.493074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98594326-64a3-4e73-baae-a78b60d60e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:19.493533 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98594326-64a3-4e73-baae-a78b60d60e72 admin admin] PATH_INFO: `/v3/projects/e7036ed110bb49cd98affba4c01ad81f` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:19.494893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98594326-64a3-4e73-baae-a78b60d60e72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7036ed110bb49cd98affba4c01ad81f)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:19.512307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98594326-64a3-4e73-baae-a78b60d60e72 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:19.569299 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-98594326-64a3-4e73-baae-a78b60d60e72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7036ed110bb49cd98affba4c01ad81f', 'request_id': 'req-98594326-64a3-4e73-baae-a78b60d60e72'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:19.576386 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-98594326-64a3-4e73-baae-a78b60d60e72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7036ed110bb49cd98affba4c01ad81f', 'request_id': 'req-98594326-64a3-4e73-baae-a78b60d60e72'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:19.584220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-98594326-64a3-4e73-baae-a78b60d60e72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7036ed110bb49cd98affba4c01ad81f', 'request_id': 'req-98594326-64a3-4e73-baae-a78b60d60e72'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:19.598556 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-98594326-64a3-4e73-baae-a78b60d60e72 admin admin] The token cache is being invalidate because project e7036ed110bb49cd98affba4c01ad81f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:19.598848 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-98594326-64a3-4e73-baae-a78b60d60e72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:19.599541 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-98594326-64a3-4e73-baae-a78b60d60e72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:19.601197 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1062/2119] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:19 2022] DELETE /identity/v3/projects/e7036ed110bb49cd98affba4c01ad81f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:19.818269 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5464a2c-3416-45a0-b316-26bf244ca3cc service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:19.819824 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f5464a2c-3416-45a0-b316-26bf244ca3cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:19.845916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5464a2c-3416-45a0-b316-26bf244ca3cc service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:19.906845 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167c863-e8ac-4bae-906f-5915cb9ab490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:19.907707 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167c863-e8ac-4bae-906f-5915cb9ab490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:19.907993 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167c863-e8ac-4bae-906f-5915cb9ab490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:19.908266 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167c863-e8ac-4bae-906f-5915cb9ab490 admin admin] PATH_INFO: `/v3/projects/99ad4fec1b5b45029a4f4b3c1e47e854` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:19.909518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167c863-e8ac-4bae-906f-5915cb9ab490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ad4fec1b5b45029a4f4b3c1e47e854)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:19.911464 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167c863-e8ac-4bae-906f-5915cb9ab490 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:19.961745 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7167c863-e8ac-4bae-906f-5915cb9ab490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ad4fec1b5b45029a4f4b3c1e47e854', 'request_id': 'req-7167c863-e8ac-4bae-906f-5915cb9ab490'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:19.966986 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:19.968715 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7167c863-e8ac-4bae-906f-5915cb9ab490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ad4fec1b5b45029a4f4b3c1e47e854', 'request_id': 'req-7167c863-e8ac-4bae-906f-5915cb9ab490'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:19.978623 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7167c863-e8ac-4bae-906f-5915cb9ab490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ad4fec1b5b45029a4f4b3c1e47e854', 'request_id': 'req-7167c863-e8ac-4bae-906f-5915cb9ab490'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:19.991809 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7167c863-e8ac-4bae-906f-5915cb9ab490 admin admin] The token cache is being invalidate because project 99ad4fec1b5b45029a4f4b3c1e47e854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:19.991809 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7167c863-e8ac-4bae-906f-5915cb9ab490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:19.991809 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7167c863-e8ac-4bae-906f-5915cb9ab490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:19.992781 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1058/2120] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:19 2022] DELETE /identity/v3/projects/99ad4fec1b5b45029a4f4b3c1e47e854 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:19.996664 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98594326-64a3-4e73-baae-a78b60d60e72 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:19.998226 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-98594326-64a3-4e73-baae-a78b60d60e72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:20.012092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98594326-64a3-4e73-baae-a78b60d60e72 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:20.078275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b084026-6161-429e-af85-7fe6925b641e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:20.079148 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b084026-6161-429e-af85-7fe6925b641e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:20.079424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b084026-6161-429e-af85-7fe6925b641e admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:20.079696 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b084026-6161-429e-af85-7fe6925b641e admin admin] PATH_INFO: `/v3/users/59c504915c1b4377983440c20f9bfbd2` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:20.080932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b084026-6161-429e-af85-7fe6925b641e admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c504915c1b4377983440c20f9bfbd2)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:20.082816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b084026-6161-429e-af85-7fe6925b641e admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:20.085719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:20.131804 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-7b084026-6161-429e-af85-7fe6925b641e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c504915c1b4377983440c20f9bfbd2'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:20.132429 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-7b084026-6161-429e-af85-7fe6925b641e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c504915c1b4377983440c20f9bfbd2'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:20.140057 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-7b084026-6161-429e-af85-7fe6925b641e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c504915c1b4377983440c20f9bfbd2'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:20.147164 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-7b084026-6161-429e-af85-7fe6925b641e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c504915c1b4377983440c20f9bfbd2'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:20.160221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-7b084026-6161-429e-af85-7fe6925b641e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c504915c1b4377983440c20f9bfbd2'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:20.166570 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1063/2121] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:19 2022] DELETE /identity/v3/users/59c504915c1b4377983440c20f9bfbd2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:20.454047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167c863-e8ac-4bae-906f-5915cb9ab490 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:20.456043 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7167c863-e8ac-4bae-906f-5915cb9ab490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:20.469723 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167c863-e8ac-4bae-906f-5915cb9ab490 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:20.526513 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21cf602-2a1c-462b-86b7-580456281548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:20.527365 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cf602-2a1c-462b-86b7-580456281548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:20.527645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cf602-2a1c-462b-86b7-580456281548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:20.527918 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21cf602-2a1c-462b-86b7-580456281548 admin admin] PATH_INFO: `/v3/projects/71c094f28e8e41c59083e8c12d387512` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:20.529103 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21cf602-2a1c-462b-86b7-580456281548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c094f28e8e41c59083e8c12d387512)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:20.531302 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21cf602-2a1c-462b-86b7-580456281548 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:20.576549 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b21cf602-2a1c-462b-86b7-580456281548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c094f28e8e41c59083e8c12d387512', 'request_id': 'req-b21cf602-2a1c-462b-86b7-580456281548'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:20.581821 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b21cf602-2a1c-462b-86b7-580456281548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c094f28e8e41c59083e8c12d387512', 'request_id': 'req-b21cf602-2a1c-462b-86b7-580456281548'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:20.589544 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b21cf602-2a1c-462b-86b7-580456281548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c094f28e8e41c59083e8c12d387512', 'request_id': 'req-b21cf602-2a1c-462b-86b7-580456281548'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:20.601456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b21cf602-2a1c-462b-86b7-580456281548 admin admin] The token cache is being invalidate because project 71c094f28e8e41c59083e8c12d387512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:20.601749 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b21cf602-2a1c-462b-86b7-580456281548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:20.602691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b21cf602-2a1c-462b-86b7-580456281548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:20.605038 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1059/2122] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:20 2022] DELETE /identity/v3/projects/71c094f28e8e41c59083e8c12d387512 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:20.610446 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf044a59-c0cf-431f-836e-80f12bab7151 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:20.610738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf044a59-c0cf-431f-836e-80f12bab7151 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:20.611019 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf044a59-c0cf-431f-836e-80f12bab7151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:20.630244 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-bf044a59-c0cf-431f-836e-80f12bab7151 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:20.631453 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-bf044a59-c0cf-431f-836e-80f12bab7151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:20.694877 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1064/2123] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:20.706230 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30319c86-1f20-4f54-8c2c-fb8f003f5795 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:20.706659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30319c86-1f20-4f54-8c2c-fb8f003f5795 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:20.707172 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30319c86-1f20-4f54-8c2c-fb8f003f5795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:20.726459 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-30319c86-1f20-4f54-8c2c-fb8f003f5795 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:20.728339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-30319c86-1f20-4f54-8c2c-fb8f003f5795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:20.736509 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1060/2124] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:20.740867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf044a59-c0cf-431f-836e-80f12bab7151 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:20.751153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf044a59-c0cf-431f-836e-80f12bab7151 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:20.755896 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3eb881-7000-4615-8f93-2ae169909562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:20.756688 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3eb881-7000-4615-8f93-2ae169909562 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:20.757037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3eb881-7000-4615-8f93-2ae169909562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:20.757403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3eb881-7000-4615-8f93-2ae169909562 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:20.758210 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3eb881-7000-4615-8f93-2ae169909562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:43:20.758594 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3eb881-7000-4615-8f93-2ae169909562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:20.761078 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3eb881-7000-4615-8f93-2ae169909562 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:20.773470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1065/2125] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:43:20.778533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30319c86-1f20-4f54-8c2c-fb8f003f5795 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:20.788286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30319c86-1f20-4f54-8c2c-fb8f003f5795 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:20.793798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc0181-967c-49c0-9e0a-0f3cef1c1210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:20.794529 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc0181-967c-49c0-9e0a-0f3cef1c1210 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:20.794886 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc0181-967c-49c0-9e0a-0f3cef1c1210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:20.795235 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc0181-967c-49c0-9e0a-0f3cef1c1210 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:20.796008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc0181-967c-49c0-9e0a-0f3cef1c1210 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:20.798042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc0181-967c-49c0-9e0a-0f3cef1c1210 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:20.828523 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1061/2126] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:43:20 2022] POST /identity/v3/projects => generated 409 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:20.832634 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3eb881-7000-4615-8f93-2ae169909562 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:20.843022 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3eb881-7000-4615-8f93-2ae169909562 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:20.903630 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e9c53-a7f0-4c11-acba-8b9226076cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:20.904300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e9c53-a7f0-4c11-acba-8b9226076cce admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:20.904585 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e9c53-a7f0-4c11-acba-8b9226076cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:20.904865 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e9c53-a7f0-4c11-acba-8b9226076cce admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:20.905852 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e9c53-a7f0-4c11-acba-8b9226076cce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:20.907777 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e9c53-a7f0-4c11-acba-8b9226076cce admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:20.922383 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:20.933894 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1066/2127] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:43:20 2022] POST /identity/v3/users => generated 305 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:20.934866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc0181-967c-49c0-9e0a-0f3cef1c1210 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:20.945105 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc0181-967c-49c0-9e0a-0f3cef1c1210 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:20.949899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60ebba-f0fc-4e86-9e73-c4fc9cf30de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:20.950550 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60ebba-f0fc-4e86-9e73-c4fc9cf30de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:20.950832 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60ebba-f0fc-4e86-9e73-c4fc9cf30de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:20.951109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60ebba-f0fc-4e86-9e73-c4fc9cf30de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:20.951829 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60ebba-f0fc-4e86-9e73-c4fc9cf30de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:20.953464 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60ebba-f0fc-4e86-9e73-c4fc9cf30de7 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:20.964823 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1062/2128] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:43:20.968595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e9c53-a7f0-4c11-acba-8b9226076cce admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:20.978984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e9c53-a7f0-4c11-acba-8b9226076cce admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:20.983622 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb5fa4-7744-42f7-b1f9-203fcb2fbb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:20.984282 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb5fa4-7744-42f7-b1f9-203fcb2fbb34 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:20.984567 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb5fa4-7744-42f7-b1f9-203fcb2fbb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:20.984843 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb5fa4-7744-42f7-b1f9-203fcb2fbb34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:20.985615 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb5fa4-7744-42f7-b1f9-203fcb2fbb34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:20.987188 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb5fa4-7744-42f7-b1f9-203fcb2fbb34 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:20.998793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1067/2129] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:21.003107 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60ebba-f0fc-4e86-9e73-c4fc9cf30de7 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:21.013010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60ebba-f0fc-4e86-9e73-c4fc9cf30de7 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:21.017589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024a829-4da3-49f1-93d6-3428aad1e277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:21.018452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024a829-4da3-49f1-93d6-3428aad1e277 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:21.018737 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024a829-4da3-49f1-93d6-3428aad1e277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:21.019014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024a829-4da3-49f1-93d6-3428aad1e277 admin admin] PATH_INFO: `/v3/projects/9f6cb09739824423b98282cb67f8f059/users/ba33819dbe9948c187b6180771e100ce/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:21.033983 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024a829-4da3-49f1-93d6-3428aad1e277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6cb09739824423b98282cb67f8f059, user_id=ba33819dbe9948c187b6180771e100ce, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:21.036647 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024a829-4da3-49f1-93d6-3428aad1e277 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:21.051816 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1063/2130] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:21 2022] PUT /identity/v3/projects/9f6cb09739824423b98282cb67f8f059/users/ba33819dbe9948c187b6180771e100ce/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:21.064392 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dc7fe-b951-4ffd-a106-e3565a741812 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:21.064710 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dc7fe-b951-4ffd-a106-e3565a741812 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:21.064978 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3dc7fe-b951-4ffd-a106-e3565a741812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:21.093038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-ba3dc7fe-b951-4ffd-a106-e3565a741812 None None] MFA Rules not processed for user `ba33819dbe9948c187b6180771e100ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:21.094202 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-ba3dc7fe-b951-4ffd-a106-e3565a741812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:21.162718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1068/2131] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:21 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:21.167797 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024a829-4da3-49f1-93d6-3428aad1e277 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:21.181594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:21.240655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024a829-4da3-49f1-93d6-3428aad1e277 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:21.246443 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b733a-e7be-4727-94cf-84a9945ed1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:21.247098 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b733a-e7be-4727-94cf-84a9945ed1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:21.247380 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b733a-e7be-4727-94cf-84a9945ed1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:21.247832 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b733a-e7be-4727-94cf-84a9945ed1d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:21.248841 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b733a-e7be-4727-94cf-84a9945ed1d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:21.250476 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b733a-e7be-4727-94cf-84a9945ed1d8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:21.278150 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1064/2132] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:43:21 2022] POST /identity/v3/projects => generated 407 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:21.282691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dc7fe-b951-4ffd-a106-e3565a741812 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:21.294828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3dc7fe-b951-4ffd-a106-e3565a741812 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:21.366297 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd737d72-754b-4c72-884d-91e0709e5de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:21.367160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd737d72-754b-4c72-884d-91e0709e5de9 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:21.367617 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd737d72-754b-4c72-884d-91e0709e5de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:21.368778 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd737d72-754b-4c72-884d-91e0709e5de9 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:21.369703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd737d72-754b-4c72-884d-91e0709e5de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:21.371787 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd737d72-754b-4c72-884d-91e0709e5de9 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:21.397779 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1069/2133] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:43:21 2022] POST /identity/v3/users => generated 310 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:21.402009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b733a-e7be-4727-94cf-84a9945ed1d8 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:21.413008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b733a-e7be-4727-94cf-84a9945ed1d8 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:21.417794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1631b7e-892e-44f7-8705-c2a10f4489de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:21.418387 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1631b7e-892e-44f7-8705-c2a10f4489de admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:21.418669 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1631b7e-892e-44f7-8705-c2a10f4489de admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:21.418946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1631b7e-892e-44f7-8705-c2a10f4489de admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:21.419659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1631b7e-892e-44f7-8705-c2a10f4489de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:21.421248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1631b7e-892e-44f7-8705-c2a10f4489de admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:21.435939 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1065/2134] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:43:21.439702 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd737d72-754b-4c72-884d-91e0709e5de9 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:21.460142 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd737d72-754b-4c72-884d-91e0709e5de9 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:21.466451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170f2f9-8014-413d-b30c-a4ce6344a372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:21.467452 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170f2f9-8014-413d-b30c-a4ce6344a372 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:21.467839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170f2f9-8014-413d-b30c-a4ce6344a372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:21.468262 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170f2f9-8014-413d-b30c-a4ce6344a372 admin admin] PATH_INFO: `/v3/projects/68f2c19f596e47ef85d85491edad983a/users/ee03d54513d146a195a0ac4fd89dc3eb/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:21.491264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170f2f9-8014-413d-b30c-a4ce6344a372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f2c19f596e47ef85d85491edad983a, user_id=ee03d54513d146a195a0ac4fd89dc3eb, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:21.496845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170f2f9-8014-413d-b30c-a4ce6344a372 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:21.516290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1070/2135] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:21 2022] PUT /identity/v3/projects/68f2c19f596e47ef85d85491edad983a/users/ee03d54513d146a195a0ac4fd89dc3eb/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:21.520201 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1631b7e-892e-44f7-8705-c2a10f4489de admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:21.531276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1631b7e-892e-44f7-8705-c2a10f4489de admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:21.591097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1f5cb-01d0-4e8b-ac55-195e496e189e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:21.591910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1f5cb-01d0-4e8b-ac55-195e496e189e admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:21.592200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1f5cb-01d0-4e8b-ac55-195e496e189e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:21.592478 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1f5cb-01d0-4e8b-ac55-195e496e189e admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:21.593205 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1f5cb-01d0-4e8b-ac55-195e496e189e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:21.594844 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1f5cb-01d0-4e8b-ac55-195e496e189e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:21.606361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1066/2136] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:43:21.610735 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170f2f9-8014-413d-b30c-a4ce6344a372 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:21.622161 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170f2f9-8014-413d-b30c-a4ce6344a372 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:21.627095 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0e950-3cdd-4458-9011-28c20c78f742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:21.628043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0e950-3cdd-4458-9011-28c20c78f742 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:21.628311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0e950-3cdd-4458-9011-28c20c78f742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:21.628618 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0e950-3cdd-4458-9011-28c20c78f742 admin admin] PATH_INFO: `/v3/projects/68f2c19f596e47ef85d85491edad983a/users/ee03d54513d146a195a0ac4fd89dc3eb/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:21.630717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0e950-3cdd-4458-9011-28c20c78f742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f2c19f596e47ef85d85491edad983a, user_id=ee03d54513d146a195a0ac4fd89dc3eb, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:21.633488 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0e950-3cdd-4458-9011-28c20c78f742 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:21.645527 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1071/2137] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:21 2022] PUT /identity/v3/projects/68f2c19f596e47ef85d85491edad983a/users/ee03d54513d146a195a0ac4fd89dc3eb/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:21.656009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492680c-0d40-43ea-a7fa-e7e62d9f1b1c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:21.656300 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492680c-0d40-43ea-a7fa-e7e62d9f1b1c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:21.656583 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492680c-0d40-43ea-a7fa-e7e62d9f1b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:21.684794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0492680c-0d40-43ea-a7fa-e7e62d9f1b1c None None] MFA Rules not processed for user `ee03d54513d146a195a0ac4fd89dc3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:21.686079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0492680c-0d40-43ea-a7fa-e7e62d9f1b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:21.764475 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1067/2138] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:21 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:21.776448 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0e950-3cdd-4458-9011-28c20c78f742 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:21.778271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-24e0e950-3cdd-4458-9011-28c20c78f742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:21.836206 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:21.873634 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0e950-3cdd-4458-9011-28c20c78f742 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:21.877630 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866e878-2d7a-443c-bc8e-c0d45ec65ab0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:21.878422 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866e878-2d7a-443c-bc8e-c0d45ec65ab0 service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:21.878833 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866e878-2d7a-443c-bc8e-c0d45ec65ab0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:21.879178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866e878-2d7a-443c-bc8e-c0d45ec65ab0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:21.895800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866e878-2d7a-443c-bc8e-c0d45ec65ab0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:21.897312 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866e878-2d7a-443c-bc8e-c0d45ec65ab0 service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:21.908711 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1072/2139] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:21 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:43:22.063462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492680c-0d40-43ea-a7fa-e7e62d9f1b1c None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:22.073057 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492680c-0d40-43ea-a7fa-e7e62d9f1b1c None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:22.076636 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343082a-a80f-404b-8432-1cb0be318184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:22.077318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343082a-a80f-404b-8432-1cb0be318184 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:22.077647 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343082a-a80f-404b-8432-1cb0be318184 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:22.077926 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343082a-a80f-404b-8432-1cb0be318184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:22.082103 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:22.136669 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343082a-a80f-404b-8432-1cb0be318184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:22.138056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343082a-a80f-404b-8432-1cb0be318184 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:22.146713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1068/2140] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:22 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:43:23.022151 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946b1f8-2a0e-41d3-97f6-352b7454365b None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:23.022662 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946b1f8-2a0e-41d3-97f6-352b7454365b None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:23.022756 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946b1f8-2a0e-41d3-97f6-352b7454365b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:23.042173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-c946b1f8-2a0e-41d3-97f6-352b7454365b None None] MFA Rules not processed for user `de843beff4dd401fb34b34ab83f6f7f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:23.043448 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c946b1f8-2a0e-41d3-97f6-352b7454365b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:23.097950 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1073/2141] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:29.479484 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343082a-a80f-404b-8432-1cb0be318184 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:29.554438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343082a-a80f-404b-8432-1cb0be318184 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:29.559429 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4dd71-1b83-44b7-a72d-d142e73162e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:29.560372 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4dd71-1b83-44b7-a72d-d142e73162e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:29.560657 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4dd71-1b83-44b7-a72d-d142e73162e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:29.560933 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4dd71-1b83-44b7-a72d-d142e73162e6 admin admin] PATH_INFO: `/v3/users/ba33819dbe9948c187b6180771e100ce` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:29.562168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4dd71-1b83-44b7-a72d-d142e73162e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba33819dbe9948c187b6180771e100ce)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:29.564098 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4dd71-1b83-44b7-a72d-d142e73162e6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:29.612534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-11d4dd71-1b83-44b7-a72d-d142e73162e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba33819dbe9948c187b6180771e100ce'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:29.613203 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-11d4dd71-1b83-44b7-a72d-d142e73162e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba33819dbe9948c187b6180771e100ce'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:29.622348 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-11d4dd71-1b83-44b7-a72d-d142e73162e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba33819dbe9948c187b6180771e100ce'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:29.635581 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-11d4dd71-1b83-44b7-a72d-d142e73162e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba33819dbe9948c187b6180771e100ce'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:29.648079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-11d4dd71-1b83-44b7-a72d-d142e73162e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba33819dbe9948c187b6180771e100ce'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:29.655278 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1069/2142] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:29 2022] DELETE /identity/v3/users/ba33819dbe9948c187b6180771e100ce => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:29.659801 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26275d-f1d5-457d-b338-74acd38b1fe9 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:29.660293 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26275d-f1d5-457d-b338-74acd38b1fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:29.660392 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26275d-f1d5-457d-b338-74acd38b1fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:29.678357 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-3b26275d-f1d5-457d-b338-74acd38b1fe9 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:29.679561 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-3b26275d-f1d5-457d-b338-74acd38b1fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:29.737976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1074/2143] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:29.747567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4dd71-1b83-44b7-a72d-d142e73162e6 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:29.748985 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-11d4dd71-1b83-44b7-a72d-d142e73162e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:29.777301 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:29.808658 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4dd71-1b83-44b7-a72d-d142e73162e6 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:29.816710 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36565284-04e2-4dc1-b7f9-cb8f0f871fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:29.817703 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36565284-04e2-4dc1-b7f9-cb8f0f871fda service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:29.818133 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36565284-04e2-4dc1-b7f9-cb8f0f871fda service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:29.818544 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36565284-04e2-4dc1-b7f9-cb8f0f871fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:29.829870 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36565284-04e2-4dc1-b7f9-cb8f0f871fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:29.831306 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36565284-04e2-4dc1-b7f9-cb8f0f871fda service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:29.841670 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1070/2144] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:43:30.214768 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26275d-f1d5-457d-b338-74acd38b1fe9 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:30.216501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-3b26275d-f1d5-457d-b338-74acd38b1fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:30.229915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26275d-f1d5-457d-b338-74acd38b1fe9 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:30.236538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378be6db-d4f6-477d-b567-871c0563881d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:30.237775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378be6db-d4f6-477d-b567-871c0563881d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:30.246630 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378be6db-d4f6-477d-b567-871c0563881d admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:30.247044 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378be6db-d4f6-477d-b567-871c0563881d admin admin] PATH_INFO: `/v3/projects/9f6cb09739824423b98282cb67f8f059` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:30.248313 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378be6db-d4f6-477d-b567-871c0563881d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f6cb09739824423b98282cb67f8f059)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:30.250293 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378be6db-d4f6-477d-b567-871c0563881d admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:30.324379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-378be6db-d4f6-477d-b567-871c0563881d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f6cb09739824423b98282cb67f8f059', 'request_id': 'req-378be6db-d4f6-477d-b567-871c0563881d'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:30.330023 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-378be6db-d4f6-477d-b567-871c0563881d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f6cb09739824423b98282cb67f8f059', 'request_id': 'req-378be6db-d4f6-477d-b567-871c0563881d'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:30.338025 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-378be6db-d4f6-477d-b567-871c0563881d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f6cb09739824423b98282cb67f8f059', 'request_id': 'req-378be6db-d4f6-477d-b567-871c0563881d'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:30.346314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:30.355428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-378be6db-d4f6-477d-b567-871c0563881d admin admin] The token cache is being invalidate because project 9f6cb09739824423b98282cb67f8f059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:30.355795 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-378be6db-d4f6-477d-b567-871c0563881d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:30.357747 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-378be6db-d4f6-477d-b567-871c0563881d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:30.359320 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1075/2145] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:30 2022] DELETE /identity/v3/projects/9f6cb09739824423b98282cb67f8f059 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:30.363318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36565284-04e2-4dc1-b7f9-cb8f0f871fda service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:30.374983 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36565284-04e2-4dc1-b7f9-cb8f0f871fda service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:30.460337 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a4b15-6607-4165-a274-205b52701ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:30.462179 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4b15-6607-4165-a274-205b52701ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:30.462469 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4b15-6607-4165-a274-205b52701ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:30.462757 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a4b15-6607-4165-a274-205b52701ef9 admin admin] PATH_INFO: `/v3/users/ee03d54513d146a195a0ac4fd89dc3eb` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:30.464256 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a4b15-6607-4165-a274-205b52701ef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee03d54513d146a195a0ac4fd89dc3eb)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:30.466412 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1a4b15-6607-4165-a274-205b52701ef9 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:30.519077 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0f1a4b15-6607-4165-a274-205b52701ef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee03d54513d146a195a0ac4fd89dc3eb'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:30.519769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0f1a4b15-6607-4165-a274-205b52701ef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee03d54513d146a195a0ac4fd89dc3eb'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:30.528053 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0f1a4b15-6607-4165-a274-205b52701ef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee03d54513d146a195a0ac4fd89dc3eb'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:30.535603 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0f1a4b15-6607-4165-a274-205b52701ef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee03d54513d146a195a0ac4fd89dc3eb'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:30.548612 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0f1a4b15-6607-4165-a274-205b52701ef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee03d54513d146a195a0ac4fd89dc3eb'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:30.554692 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1071/2146] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:30 2022] DELETE /identity/v3/users/ee03d54513d146a195a0ac4fd89dc3eb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:30.834634 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378be6db-d4f6-477d-b567-871c0563881d admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:30.836143 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-378be6db-d4f6-477d-b567-871c0563881d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:30.849029 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378be6db-d4f6-477d-b567-871c0563881d admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:30.908935 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ad7da-abff-4f3f-8352-81be27978894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:30.909760 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ad7da-abff-4f3f-8352-81be27978894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:30.910044 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ad7da-abff-4f3f-8352-81be27978894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:30.910376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ad7da-abff-4f3f-8352-81be27978894 admin admin] PATH_INFO: `/v3/projects/68f2c19f596e47ef85d85491edad983a` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:30.911552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ad7da-abff-4f3f-8352-81be27978894 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f2c19f596e47ef85d85491edad983a)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:30.913498 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ad7da-abff-4f3f-8352-81be27978894 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:30.960241 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a01ad7da-abff-4f3f-8352-81be27978894 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f2c19f596e47ef85d85491edad983a', 'request_id': 'req-a01ad7da-abff-4f3f-8352-81be27978894'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:30.966410 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a01ad7da-abff-4f3f-8352-81be27978894 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f2c19f596e47ef85d85491edad983a', 'request_id': 'req-a01ad7da-abff-4f3f-8352-81be27978894'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:30.973640 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a01ad7da-abff-4f3f-8352-81be27978894 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f2c19f596e47ef85d85491edad983a', 'request_id': 'req-a01ad7da-abff-4f3f-8352-81be27978894'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:30.985834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a01ad7da-abff-4f3f-8352-81be27978894 admin admin] The token cache is being invalidate because project 68f2c19f596e47ef85d85491edad983a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:30.986152 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a01ad7da-abff-4f3f-8352-81be27978894 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:30.986785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a01ad7da-abff-4f3f-8352-81be27978894 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:30.988313 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1076/2147] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:30 2022] DELETE /identity/v3/projects/68f2c19f596e47ef85d85491edad983a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:30.993081 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3fe9a-c853-4fec-b6b3-703ceb357678 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:30.993408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3fe9a-c853-4fec-b6b3-703ceb357678 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:30.993693 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3fe9a-c853-4fec-b6b3-703ceb357678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:31.016575 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d1d3fe9a-c853-4fec-b6b3-703ceb357678 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:31.017852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d1d3fe9a-c853-4fec-b6b3-703ceb357678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:31.061033 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:31.082110 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1072/2148] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:31.091180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14a941-4536-4885-bb32-3560428876a1 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:31.091563 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14a941-4536-4885-bb32-3560428876a1 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:31.091916 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14a941-4536-4885-bb32-3560428876a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:31.111231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-1a14a941-4536-4885-bb32-3560428876a1 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:31.112551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-1a14a941-4536-4885-bb32-3560428876a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:31.121036 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1077/2149] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:31.125237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3fe9a-c853-4fec-b6b3-703ceb357678 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:31.135555 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3fe9a-c853-4fec-b6b3-703ceb357678 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:31.140390 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0159ced-d8e6-495b-82db-5cf34dd71901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:31.141086 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0159ced-d8e6-495b-82db-5cf34dd71901 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:31.141392 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0159ced-d8e6-495b-82db-5cf34dd71901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:31.141686 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0159ced-d8e6-495b-82db-5cf34dd71901 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:31.142422 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0159ced-d8e6-495b-82db-5cf34dd71901 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:43:31.142735 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0159ced-d8e6-495b-82db-5cf34dd71901 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:31.144392 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0159ced-d8e6-495b-82db-5cf34dd71901 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:31.158815 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1073/2150] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:43:31.163003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14a941-4536-4885-bb32-3560428876a1 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:31.173478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14a941-4536-4885-bb32-3560428876a1 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:31.178266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d23aa0-8eb3-494b-85cd-38a565e3aa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:31.178930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d23aa0-8eb3-494b-85cd-38a565e3aa84 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:31.179216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d23aa0-8eb3-494b-85cd-38a565e3aa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:31.179498 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d23aa0-8eb3-494b-85cd-38a565e3aa84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:31.180242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d23aa0-8eb3-494b-85cd-38a565e3aa84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:31.182204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d23aa0-8eb3-494b-85cd-38a565e3aa84 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:31.210502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1078/2151] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:43:31 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:31.215102 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0159ced-d8e6-495b-82db-5cf34dd71901 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:31.225783 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0159ced-d8e6-495b-82db-5cf34dd71901 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:31.294334 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec29ce-e561-4082-b796-4f9d13547d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:31.295003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec29ce-e561-4082-b796-4f9d13547d3f admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:31.295287 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec29ce-e561-4082-b796-4f9d13547d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:31.295561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec29ce-e561-4082-b796-4f9d13547d3f admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:31.296258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec29ce-e561-4082-b796-4f9d13547d3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:31.298218 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec29ce-e561-4082-b796-4f9d13547d3f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:31.320535 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1074/2152] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:43:31 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:43:31.325273 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d23aa0-8eb3-494b-85cd-38a565e3aa84 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:31.335762 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d23aa0-8eb3-494b-85cd-38a565e3aa84 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:31.341118 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c63f2a-5168-4f44-a0b0-b47ba3106def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:31.341804 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c63f2a-5168-4f44-a0b0-b47ba3106def admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:31.342086 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c63f2a-5168-4f44-a0b0-b47ba3106def admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:31.342362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c63f2a-5168-4f44-a0b0-b47ba3106def admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:31.343078 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c63f2a-5168-4f44-a0b0-b47ba3106def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:31.344662 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c63f2a-5168-4f44-a0b0-b47ba3106def admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:31.355112 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1079/2153] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:43:31.358966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec29ce-e561-4082-b796-4f9d13547d3f admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:31.368822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec29ce-e561-4082-b796-4f9d13547d3f admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:31.373612 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18ecbc-bd3e-41ea-a65a-e244c9998a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:31.374270 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18ecbc-bd3e-41ea-a65a-e244c9998a39 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:31.374559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18ecbc-bd3e-41ea-a65a-e244c9998a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:31.374874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18ecbc-bd3e-41ea-a65a-e244c9998a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:31.375596 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18ecbc-bd3e-41ea-a65a-e244c9998a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:31.377250 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18ecbc-bd3e-41ea-a65a-e244c9998a39 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:31.387777 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1075/2154] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:31.391777 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c63f2a-5168-4f44-a0b0-b47ba3106def admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:31.402401 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c63f2a-5168-4f44-a0b0-b47ba3106def admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:31.407295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86ad59-f289-4464-b634-95aa14d50de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:31.408166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86ad59-f289-4464-b634-95aa14d50de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:31.408453 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86ad59-f289-4464-b634-95aa14d50de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:31.408738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86ad59-f289-4464-b634-95aa14d50de3 admin admin] PATH_INFO: `/v3/projects/1cdd88f6b48d4e50b0cabfdf307b1c62/users/861f91c3b7bc416db76ded0f0eee0082/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:31.423113 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86ad59-f289-4464-b634-95aa14d50de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cdd88f6b48d4e50b0cabfdf307b1c62, user_id=861f91c3b7bc416db76ded0f0eee0082, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:31.425904 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86ad59-f289-4464-b634-95aa14d50de3 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:31.438335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1080/2155] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:31 2022] PUT /identity/v3/projects/1cdd88f6b48d4e50b0cabfdf307b1c62/users/861f91c3b7bc416db76ded0f0eee0082/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:31.449847 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e46716-df16-43a5-87d9-9ccce86dec7b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:31.450139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e46716-df16-43a5-87d9-9ccce86dec7b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:31.450421 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e46716-df16-43a5-87d9-9ccce86dec7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:31.476207 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f7e46716-df16-43a5-87d9-9ccce86dec7b None None] MFA Rules not processed for user `861f91c3b7bc416db76ded0f0eee0082`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:31.478038 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f7e46716-df16-43a5-87d9-9ccce86dec7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:31.564254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1076/2156] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:31.572269 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86ad59-f289-4464-b634-95aa14d50de3 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:31.574311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-3c86ad59-f289-4464-b634-95aa14d50de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:31.628262 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:31.692766 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86ad59-f289-4464-b634-95aa14d50de3 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:31.699326 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53792bff-df64-4d70-94cc-c1334c4f51be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:31.700762 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53792bff-df64-4d70-94cc-c1334c4f51be service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:31.701783 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53792bff-df64-4d70-94cc-c1334c4f51be service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:31.702424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53792bff-df64-4d70-94cc-c1334c4f51be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:31.721981 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53792bff-df64-4d70-94cc-c1334c4f51be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:31.723422 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53792bff-df64-4d70-94cc-c1334c4f51be service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:31.765743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1081/2157] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:43:33.013395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e46716-df16-43a5-87d9-9ccce86dec7b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:33.014984 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f7e46716-df16-43a5-87d9-9ccce86dec7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:33.061655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:33.083794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e46716-df16-43a5-87d9-9ccce86dec7b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:33.088790 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebaf19-94e9-4429-931f-2d899c2a27b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:33.089683 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebaf19-94e9-4429-931f-2d899c2a27b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:33.089970 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebaf19-94e9-4429-931f-2d899c2a27b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:33.090245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebaf19-94e9-4429-931f-2d899c2a27b5 admin admin] PATH_INFO: `/v3/users/28d3ec84930249cca81f18b462d8240b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:33.091471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebaf19-94e9-4429-931f-2d899c2a27b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d3ec84930249cca81f18b462d8240b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:33.093500 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebaf19-94e9-4429-931f-2d899c2a27b5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:33.144622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-04ebaf19-94e9-4429-931f-2d899c2a27b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d3ec84930249cca81f18b462d8240b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:33.145287 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-04ebaf19-94e9-4429-931f-2d899c2a27b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d3ec84930249cca81f18b462d8240b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:33.154447 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-04ebaf19-94e9-4429-931f-2d899c2a27b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d3ec84930249cca81f18b462d8240b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:33.169688 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-04ebaf19-94e9-4429-931f-2d899c2a27b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d3ec84930249cca81f18b462d8240b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:33.197960 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-04ebaf19-94e9-4429-931f-2d899c2a27b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d3ec84930249cca81f18b462d8240b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:33.210803 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1077/2158] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:33 2022] DELETE /identity/v3/users/28d3ec84930249cca81f18b462d8240b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:33.443891 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53792bff-df64-4d70-94cc-c1334c4f51be service cinder] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:33.456709 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53792bff-df64-4d70-94cc-c1334c4f51be service cinder] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:33.522559 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4a4f7-fc3a-462c-bbd4-c7905bfac4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:33.523378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4a4f7-fc3a-462c-bbd4-c7905bfac4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:33.524414 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4a4f7-fc3a-462c-bbd4-c7905bfac4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:33.525299 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4a4f7-fc3a-462c-bbd4-c7905bfac4e0 admin admin] PATH_INFO: `/v3/projects/4a2118cf620e4593b174448828a36df4` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:33.526634 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4a4f7-fc3a-462c-bbd4-c7905bfac4e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a2118cf620e4593b174448828a36df4)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:33.528818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4a4f7-fc3a-462c-bbd4-c7905bfac4e0 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:33.586388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-d1f4a4f7-fc3a-462c-bbd4-c7905bfac4e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a2118cf620e4593b174448828a36df4', 'request_id': 'req-d1f4a4f7-fc3a-462c-bbd4-c7905bfac4e0'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:33.592600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-d1f4a4f7-fc3a-462c-bbd4-c7905bfac4e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a2118cf620e4593b174448828a36df4', 'request_id': 'req-d1f4a4f7-fc3a-462c-bbd4-c7905bfac4e0'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:33.603990 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-d1f4a4f7-fc3a-462c-bbd4-c7905bfac4e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a2118cf620e4593b174448828a36df4', 'request_id': 'req-d1f4a4f7-fc3a-462c-bbd4-c7905bfac4e0'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:33.618505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-d1f4a4f7-fc3a-462c-bbd4-c7905bfac4e0 admin admin] The token cache is being invalidate because project 4a2118cf620e4593b174448828a36df4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:33.619029 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-d1f4a4f7-fc3a-462c-bbd4-c7905bfac4e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:33.619507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-d1f4a4f7-fc3a-462c-bbd4-c7905bfac4e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:33.621526 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1082/2159] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:33 2022] DELETE /identity/v3/projects/4a2118cf620e4593b174448828a36df4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:33.625568 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebaf19-94e9-4429-931f-2d899c2a27b5 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:33.627033 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-04ebaf19-94e9-4429-931f-2d899c2a27b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:33.642046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebaf19-94e9-4429-931f-2d899c2a27b5 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:33.713287 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d092f-7b4c-4661-a061-1190037d8cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:33.714669 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d092f-7b4c-4661-a061-1190037d8cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:33.715093 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d092f-7b4c-4661-a061-1190037d8cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:33.715495 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d092f-7b4c-4661-a061-1190037d8cc5 admin admin] PATH_INFO: `/v3/users/fbd971d7071c45f2b23064f2cfac7ce4` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:33.717320 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d092f-7b4c-4661-a061-1190037d8cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd971d7071c45f2b23064f2cfac7ce4)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:33.719899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d092f-7b4c-4661-a061-1190037d8cc5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:33.777196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e68d092f-7b4c-4661-a061-1190037d8cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd971d7071c45f2b23064f2cfac7ce4'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:33.777943 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e68d092f-7b4c-4661-a061-1190037d8cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd971d7071c45f2b23064f2cfac7ce4'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:33.787137 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e68d092f-7b4c-4661-a061-1190037d8cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd971d7071c45f2b23064f2cfac7ce4'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:33.796556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e68d092f-7b4c-4661-a061-1190037d8cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd971d7071c45f2b23064f2cfac7ce4'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:33.797775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:33.827980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e68d092f-7b4c-4661-a061-1190037d8cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd971d7071c45f2b23064f2cfac7ce4'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:33.844153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1078/2160] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:33 2022] DELETE /identity/v3/users/fbd971d7071c45f2b23064f2cfac7ce4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:34.074540 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4a4f7-fc3a-462c-bbd4-c7905bfac4e0 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:34.076162 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-d1f4a4f7-fc3a-462c-bbd4-c7905bfac4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:34.089657 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4a4f7-fc3a-462c-bbd4-c7905bfac4e0 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:34.152191 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077fe1a-9e04-475d-917f-4fd043aa1dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:34.153058 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077fe1a-9e04-475d-917f-4fd043aa1dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:34.153345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077fe1a-9e04-475d-917f-4fd043aa1dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:34.153702 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077fe1a-9e04-475d-917f-4fd043aa1dbd admin admin] PATH_INFO: `/v3/projects/53ca5bd084204aa6a6c47c9cd44f7f7e` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:34.155206 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077fe1a-9e04-475d-917f-4fd043aa1dbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ca5bd084204aa6a6c47c9cd44f7f7e)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:34.157166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077fe1a-9e04-475d-917f-4fd043aa1dbd admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:34.159098 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:34.209087 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1077fe1a-9e04-475d-917f-4fd043aa1dbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ca5bd084204aa6a6c47c9cd44f7f7e', 'request_id': 'req-1077fe1a-9e04-475d-917f-4fd043aa1dbd'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:34.215712 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1077fe1a-9e04-475d-917f-4fd043aa1dbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ca5bd084204aa6a6c47c9cd44f7f7e', 'request_id': 'req-1077fe1a-9e04-475d-917f-4fd043aa1dbd'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:34.222631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1077fe1a-9e04-475d-917f-4fd043aa1dbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ca5bd084204aa6a6c47c9cd44f7f7e', 'request_id': 'req-1077fe1a-9e04-475d-917f-4fd043aa1dbd'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:34.235566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1077fe1a-9e04-475d-917f-4fd043aa1dbd admin admin] The token cache is being invalidate because project 53ca5bd084204aa6a6c47c9cd44f7f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:34.236038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1077fe1a-9e04-475d-917f-4fd043aa1dbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:34.236707 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1077fe1a-9e04-475d-917f-4fd043aa1dbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:34.238315 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1083/2161] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:34 2022] DELETE /identity/v3/projects/53ca5bd084204aa6a6c47c9cd44f7f7e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:34.243643 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ec879-e2fd-460a-866a-c1a89ff62d9e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:34.244142 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ec879-e2fd-460a-866a-c1a89ff62d9e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:34.244238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ec879-e2fd-460a-866a-c1a89ff62d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:34.262313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b86ec879-e2fd-460a-866a-c1a89ff62d9e None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:34.263513 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b86ec879-e2fd-460a-866a-c1a89ff62d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:34.322841 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1079/2162] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:34.330872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daab67d-46b8-48ff-b326-92e4b3eff59c None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:34.331122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daab67d-46b8-48ff-b326-92e4b3eff59c None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:34.331401 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daab67d-46b8-48ff-b326-92e4b3eff59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:34.350507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-2daab67d-46b8-48ff-b326-92e4b3eff59c None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:34.351685 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-2daab67d-46b8-48ff-b326-92e4b3eff59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:34.366093 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1084/2163] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:34.370460 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ec879-e2fd-460a-866a-c1a89ff62d9e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:34.380467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ec879-e2fd-460a-866a-c1a89ff62d9e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:34.385937 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1b3d6-85f1-4220-a654-0b367829e78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:34.386611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1b3d6-85f1-4220-a654-0b367829e78f admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:34.386897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1b3d6-85f1-4220-a654-0b367829e78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:34.387177 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1b3d6-85f1-4220-a654-0b367829e78f admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:34.387921 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1b3d6-85f1-4220-a654-0b367829e78f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:43:34.388232 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1b3d6-85f1-4220-a654-0b367829e78f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:34.389873 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1b3d6-85f1-4220-a654-0b367829e78f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:34.402915 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1080/2164] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:43:34.407566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daab67d-46b8-48ff-b326-92e4b3eff59c None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:34.417113 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daab67d-46b8-48ff-b326-92e4b3eff59c None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:34.422354 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba3403-2dd2-46ef-b065-f31e355a4714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:34.423014 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba3403-2dd2-46ef-b065-f31e355a4714 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:34.423361 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba3403-2dd2-46ef-b065-f31e355a4714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:34.423667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba3403-2dd2-46ef-b065-f31e355a4714 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:34.424385 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba3403-2dd2-46ef-b065-f31e355a4714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:34.426603 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba3403-2dd2-46ef-b065-f31e355a4714 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:34.452320 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1085/2165] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:43:34 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:34.456624 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1b3d6-85f1-4220-a654-0b367829e78f admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:34.467674 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1b3d6-85f1-4220-a654-0b367829e78f admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:34.528150 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6ed8a-1e18-4e73-a120-7cd5a5133f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:34.528823 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6ed8a-1e18-4e73-a120-7cd5a5133f75 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:34.529111 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6ed8a-1e18-4e73-a120-7cd5a5133f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:34.529417 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6ed8a-1e18-4e73-a120-7cd5a5133f75 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:34.530404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6ed8a-1e18-4e73-a120-7cd5a5133f75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:34.532361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de6ed8a-1e18-4e73-a120-7cd5a5133f75 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:34.552698 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1081/2166] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:43:34 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:43:34.556900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba3403-2dd2-46ef-b065-f31e355a4714 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:34.567332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba3403-2dd2-46ef-b065-f31e355a4714 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:34.572616 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d227ad-416b-4f11-be67-0581c5c9cdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:34.573276 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d227ad-416b-4f11-be67-0581c5c9cdd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:34.573600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d227ad-416b-4f11-be67-0581c5c9cdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:34.573883 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d227ad-416b-4f11-be67-0581c5c9cdd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:34.574607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d227ad-416b-4f11-be67-0581c5c9cdd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:34.576203 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d227ad-416b-4f11-be67-0581c5c9cdd4 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:34.587936 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1086/2167] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:43:34.591296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6ed8a-1e18-4e73-a120-7cd5a5133f75 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:34.601144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6ed8a-1e18-4e73-a120-7cd5a5133f75 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:34.606234 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edec2b9-edcd-4909-858a-fe4a94cb0574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:34.606876 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edec2b9-edcd-4909-858a-fe4a94cb0574 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:34.607157 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edec2b9-edcd-4909-858a-fe4a94cb0574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:34.607432 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edec2b9-edcd-4909-858a-fe4a94cb0574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:34.608150 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edec2b9-edcd-4909-858a-fe4a94cb0574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:34.609770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edec2b9-edcd-4909-858a-fe4a94cb0574 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:34.620592 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1082/2168] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:34.624961 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d227ad-416b-4f11-be67-0581c5c9cdd4 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:34.635059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d227ad-416b-4f11-be67-0581c5c9cdd4 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:34.639897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b35d3-2e99-4d08-90ff-78128725fec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:34.640797 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b35d3-2e99-4d08-90ff-78128725fec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:34.641080 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b35d3-2e99-4d08-90ff-78128725fec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:34.641360 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b35d3-2e99-4d08-90ff-78128725fec6 admin admin] PATH_INFO: `/v3/projects/a0f2e537e38c46d9b61560cc59e01d70/users/7cbba99b11d348feb7d4b1a677bb2909/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:34.657867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b35d3-2e99-4d08-90ff-78128725fec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0f2e537e38c46d9b61560cc59e01d70, user_id=7cbba99b11d348feb7d4b1a677bb2909, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:34.660531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b35d3-2e99-4d08-90ff-78128725fec6 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:34.673155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1087/2169] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:34 2022] PUT /identity/v3/projects/a0f2e537e38c46d9b61560cc59e01d70/users/7cbba99b11d348feb7d4b1a677bb2909/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:34.684783 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae5216-4577-42af-a342-5de98217860a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:34.685075 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae5216-4577-42af-a342-5de98217860a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:34.685354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae5216-4577-42af-a342-5de98217860a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:34.713471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-77ae5216-4577-42af-a342-5de98217860a None None] MFA Rules not processed for user `7cbba99b11d348feb7d4b1a677bb2909`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:34.714677 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-77ae5216-4577-42af-a342-5de98217860a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:34.749129 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:34.784500 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1083/2170] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:34.796236 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b35d3-2e99-4d08-90ff-78128725fec6 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:34.798127 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-423b35d3-2e99-4d08-90ff-78128725fec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:34.864249 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b35d3-2e99-4d08-90ff-78128725fec6 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:34.868753 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3092132-df40-4102-8824-ab91103d4a2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:34.869676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3092132-df40-4102-8824-ab91103d4a2c service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:34.870073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3092132-df40-4102-8824-ab91103d4a2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:34.870420 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3092132-df40-4102-8824-ab91103d4a2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:34.879855 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3092132-df40-4102-8824-ab91103d4a2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:34.881436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3092132-df40-4102-8824-ab91103d4a2c service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:34.893761 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1088/2171] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:43:34.913548 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae5216-4577-42af-a342-5de98217860a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:34.986771 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae5216-4577-42af-a342-5de98217860a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:34.991318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929b6c1-9c45-4159-a5dc-2ef528c86760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:34.992218 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929b6c1-9c45-4159-a5dc-2ef528c86760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:34.992818 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929b6c1-9c45-4159-a5dc-2ef528c86760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:34.993845 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929b6c1-9c45-4159-a5dc-2ef528c86760 admin admin] PATH_INFO: `/v3/users/7cbba99b11d348feb7d4b1a677bb2909` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:34.995152 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929b6c1-9c45-4159-a5dc-2ef528c86760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cbba99b11d348feb7d4b1a677bb2909)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:34.997119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929b6c1-9c45-4159-a5dc-2ef528c86760 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:35.065678 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0929b6c1-9c45-4159-a5dc-2ef528c86760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cbba99b11d348feb7d4b1a677bb2909'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:35.065678 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0929b6c1-9c45-4159-a5dc-2ef528c86760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cbba99b11d348feb7d4b1a677bb2909'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:35.068277 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0929b6c1-9c45-4159-a5dc-2ef528c86760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cbba99b11d348feb7d4b1a677bb2909'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:35.076573 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0929b6c1-9c45-4159-a5dc-2ef528c86760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cbba99b11d348feb7d4b1a677bb2909'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:35.089468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0929b6c1-9c45-4159-a5dc-2ef528c86760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cbba99b11d348feb7d4b1a677bb2909'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:35.095431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1084/2172] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:34 2022] DELETE /identity/v3/users/7cbba99b11d348feb7d4b1a677bb2909 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:35.099993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e244ec2-0226-4021-a0cf-4690888ba041 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:35.100252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e244ec2-0226-4021-a0cf-4690888ba041 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:35.100532 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e244ec2-0226-4021-a0cf-4690888ba041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:35.120159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-7e244ec2-0226-4021-a0cf-4690888ba041 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:35.121365 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7e244ec2-0226-4021-a0cf-4690888ba041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:35.146724 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:35.187262 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1089/2173] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:35.197989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929b6c1-9c45-4159-a5dc-2ef528c86760 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:35.199639 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0929b6c1-9c45-4159-a5dc-2ef528c86760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:35.262037 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929b6c1-9c45-4159-a5dc-2ef528c86760 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:35.265881 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf6495-b048-4280-8417-5ca306cb98e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:35.266591 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf6495-b048-4280-8417-5ca306cb98e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:35.266874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf6495-b048-4280-8417-5ca306cb98e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:35.267206 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf6495-b048-4280-8417-5ca306cb98e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:35.277477 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf6495-b048-4280-8417-5ca306cb98e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:35.278987 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf6495-b048-4280-8417-5ca306cb98e0 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:35.283276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:35.292514 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1085/2174] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:43:35.582401 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e244ec2-0226-4021-a0cf-4690888ba041 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:35.583904 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7e244ec2-0226-4021-a0cf-4690888ba041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:35.596945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e244ec2-0226-4021-a0cf-4690888ba041 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:35.601621 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8667a3-6283-4257-aa03-efd4b42a8d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:35.603160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8667a3-6283-4257-aa03-efd4b42a8d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:35.603382 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8667a3-6283-4257-aa03-efd4b42a8d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:35.603662 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8667a3-6283-4257-aa03-efd4b42a8d67 admin admin] PATH_INFO: `/v3/projects/a0f2e537e38c46d9b61560cc59e01d70` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:35.604913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8667a3-6283-4257-aa03-efd4b42a8d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0f2e537e38c46d9b61560cc59e01d70)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:35.606845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8667a3-6283-4257-aa03-efd4b42a8d67 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:35.660021 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-be8667a3-6283-4257-aa03-efd4b42a8d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0f2e537e38c46d9b61560cc59e01d70', 'request_id': 'req-be8667a3-6283-4257-aa03-efd4b42a8d67'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:35.666117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-be8667a3-6283-4257-aa03-efd4b42a8d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0f2e537e38c46d9b61560cc59e01d70', 'request_id': 'req-be8667a3-6283-4257-aa03-efd4b42a8d67'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:35.673743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-be8667a3-6283-4257-aa03-efd4b42a8d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0f2e537e38c46d9b61560cc59e01d70', 'request_id': 'req-be8667a3-6283-4257-aa03-efd4b42a8d67'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:35.685818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-be8667a3-6283-4257-aa03-efd4b42a8d67 admin admin] The token cache is being invalidate because project a0f2e537e38c46d9b61560cc59e01d70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:35.686314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-be8667a3-6283-4257-aa03-efd4b42a8d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:35.686971 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-be8667a3-6283-4257-aa03-efd4b42a8d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:35.688533 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1090/2175] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:35 2022] DELETE /identity/v3/projects/a0f2e537e38c46d9b61560cc59e01d70 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:35.693406 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707ebc7-c533-43f1-a2ba-9dd3f858cd7a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:35.693709 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707ebc7-c533-43f1-a2ba-9dd3f858cd7a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:35.693989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c707ebc7-c533-43f1-a2ba-9dd3f858cd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:35.713558 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c707ebc7-c533-43f1-a2ba-9dd3f858cd7a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:35.714780 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c707ebc7-c533-43f1-a2ba-9dd3f858cd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:35.778904 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1086/2176] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:35.786878 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b171b-1316-4e08-b730-9e3d9db9d932 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:35.787175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b171b-1316-4e08-b730-9e3d9db9d932 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:35.787461 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b171b-1316-4e08-b730-9e3d9db9d932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:35.805402 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-185b171b-1316-4e08-b730-9e3d9db9d932 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:35.806575 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-185b171b-1316-4e08-b730-9e3d9db9d932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:35.814989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1091/2177] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:35.819156 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707ebc7-c533-43f1-a2ba-9dd3f858cd7a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:35.829920 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c707ebc7-c533-43f1-a2ba-9dd3f858cd7a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:35.834565 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee10a98-70cb-41ba-b048-a452b85fba40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:35.835215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee10a98-70cb-41ba-b048-a452b85fba40 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:35.835501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee10a98-70cb-41ba-b048-a452b85fba40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:35.835776 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee10a98-70cb-41ba-b048-a452b85fba40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:35.837311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee10a98-70cb-41ba-b048-a452b85fba40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:43:35.837650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee10a98-70cb-41ba-b048-a452b85fba40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:35.839260 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee10a98-70cb-41ba-b048-a452b85fba40 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:35.850695 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1087/2178] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:43:35.855045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b171b-1316-4e08-b730-9e3d9db9d932 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:35.864264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b171b-1316-4e08-b730-9e3d9db9d932 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:35.868968 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3f7f9-0af0-40ed-847c-ed39accbf078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:35.869669 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3f7f9-0af0-40ed-847c-ed39accbf078 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:35.869941 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3f7f9-0af0-40ed-847c-ed39accbf078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:35.870221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e3f7f9-0af0-40ed-847c-ed39accbf078 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:35.870923 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3f7f9-0af0-40ed-847c-ed39accbf078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:35.872915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e3f7f9-0af0-40ed-847c-ed39accbf078 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:35.898370 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1092/2179] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:43:35 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:43:35.902998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee10a98-70cb-41ba-b048-a452b85fba40 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:35.913434 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee10a98-70cb-41ba-b048-a452b85fba40 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:35.970618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edf263-76e4-4f79-93db-280855fd0788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:35.971289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edf263-76e4-4f79-93db-280855fd0788 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:35.971574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edf263-76e4-4f79-93db-280855fd0788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:35.971850 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43edf263-76e4-4f79-93db-280855fd0788 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:35.972550 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43edf263-76e4-4f79-93db-280855fd0788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:35.974526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43edf263-76e4-4f79-93db-280855fd0788 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:35.995025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1088/2180] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:43:35 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:35.999419 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3f7f9-0af0-40ed-847c-ed39accbf078 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:36.011381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e3f7f9-0af0-40ed-847c-ed39accbf078 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:36.016846 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994625d-441e-4a28-8991-c2501c917ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:36.017641 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994625d-441e-4a28-8991-c2501c917ecc admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:36.017954 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994625d-441e-4a28-8991-c2501c917ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:36.018287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994625d-441e-4a28-8991-c2501c917ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:36.019212 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994625d-441e-4a28-8991-c2501c917ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:36.021087 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d994625d-441e-4a28-8991-c2501c917ecc admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:36.038115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1093/2181] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:36.041034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edf263-76e4-4f79-93db-280855fd0788 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:36.053710 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43edf263-76e4-4f79-93db-280855fd0788 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:36.059486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c8d3f-3f4e-4ac1-8ea0-4ac248e58eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:36.060166 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8d3f-3f4e-4ac1-8ea0-4ac248e58eec admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:36.060491 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8d3f-3f4e-4ac1-8ea0-4ac248e58eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:36.060808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c8d3f-3f4e-4ac1-8ea0-4ac248e58eec admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:36.061646 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c8d3f-3f4e-4ac1-8ea0-4ac248e58eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:36.063322 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c8d3f-3f4e-4ac1-8ea0-4ac248e58eec admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:36.073882 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1089/2182] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:36.077995 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994625d-441e-4a28-8991-c2501c917ecc admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:36.088410 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994625d-441e-4a28-8991-c2501c917ecc admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:36.096369 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed0df6-0de1-4a9f-a6fb-4cb1dcaca5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:36.097271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed0df6-0de1-4a9f-a6fb-4cb1dcaca5fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:36.097586 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed0df6-0de1-4a9f-a6fb-4cb1dcaca5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:36.098208 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bed0df6-0de1-4a9f-a6fb-4cb1dcaca5fa admin admin] PATH_INFO: `/v3/projects/6f8c06a9b5f2462fb6e17f8a1a64d5b4/users/6db35c84200746a5819f2aedb2974c38/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:36.116585 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed0df6-0de1-4a9f-a6fb-4cb1dcaca5fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f8c06a9b5f2462fb6e17f8a1a64d5b4, user_id=6db35c84200746a5819f2aedb2974c38, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:36.122338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bed0df6-0de1-4a9f-a6fb-4cb1dcaca5fa admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:36.139923 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1094/2183] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:36 2022] PUT /identity/v3/projects/6f8c06a9b5f2462fb6e17f8a1a64d5b4/users/6db35c84200746a5819f2aedb2974c38/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:36.154516 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ed754-1c3d-4dd6-841a-cbb6a0db1db4 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:36.155123 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ed754-1c3d-4dd6-841a-cbb6a0db1db4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:36.155443 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ed754-1c3d-4dd6-841a-cbb6a0db1db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:36.192404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d88ed754-1c3d-4dd6-841a-cbb6a0db1db4 None None] MFA Rules not processed for user `6db35c84200746a5819f2aedb2974c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:36.193868 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d88ed754-1c3d-4dd6-841a-cbb6a0db1db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:36.260861 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:36.274990 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1090/2184] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:36.287015 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed0df6-0de1-4a9f-a6fb-4cb1dcaca5fa admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:36.288897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-8bed0df6-0de1-4a9f-a6fb-4cb1dcaca5fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:36.356378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:36.360433 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bed0df6-0de1-4a9f-a6fb-4cb1dcaca5fa admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:36.365473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aba304-6939-4d13-bc03-0d5e0b065e7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:36.366216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aba304-6939-4d13-bc03-0d5e0b065e7a service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:36.366524 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aba304-6939-4d13-bc03-0d5e0b065e7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:36.366978 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aba304-6939-4d13-bc03-0d5e0b065e7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:36.378041 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aba304-6939-4d13-bc03-0d5e0b065e7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:36.379512 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aba304-6939-4d13-bc03-0d5e0b065e7a service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:36.393103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1095/2185] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:43:39.422106 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ed754-1c3d-4dd6-841a-cbb6a0db1db4 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:39.483734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ed754-1c3d-4dd6-841a-cbb6a0db1db4 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:39.488223 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb63e6c-c8e2-4167-b315-bcdee5c25dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:39.489089 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb63e6c-c8e2-4167-b315-bcdee5c25dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:39.489393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb63e6c-c8e2-4167-b315-bcdee5c25dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:39.489678 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb63e6c-c8e2-4167-b315-bcdee5c25dd4 admin admin] PATH_INFO: `/v3/users/6db35c84200746a5819f2aedb2974c38` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:39.490855 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb63e6c-c8e2-4167-b315-bcdee5c25dd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6db35c84200746a5819f2aedb2974c38)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:39.493592 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb63e6c-c8e2-4167-b315-bcdee5c25dd4 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:39.538607 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-cbb63e6c-c8e2-4167-b315-bcdee5c25dd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6db35c84200746a5819f2aedb2974c38'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:39.539804 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-cbb63e6c-c8e2-4167-b315-bcdee5c25dd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6db35c84200746a5819f2aedb2974c38'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:39.546539 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-cbb63e6c-c8e2-4167-b315-bcdee5c25dd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6db35c84200746a5819f2aedb2974c38'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:39.553700 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-cbb63e6c-c8e2-4167-b315-bcdee5c25dd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6db35c84200746a5819f2aedb2974c38'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:39.565971 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-cbb63e6c-c8e2-4167-b315-bcdee5c25dd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6db35c84200746a5819f2aedb2974c38'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:39.571840 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1091/2186] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:39 2022] DELETE /identity/v3/users/6db35c84200746a5819f2aedb2974c38 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:39.576392 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfcae1-f123-4713-a2dd-0dcafdb8a70e None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:39.576895 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfcae1-f123-4713-a2dd-0dcafdb8a70e None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:39.576989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dfcae1-f123-4713-a2dd-0dcafdb8a70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:39.593985 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-c5dfcae1-f123-4713-a2dd-0dcafdb8a70e None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:39.595303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c5dfcae1-f123-4713-a2dd-0dcafdb8a70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:39.656603 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1096/2187] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:39.666625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb63e6c-c8e2-4167-b315-bcdee5c25dd4 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:39.668033 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-cbb63e6c-c8e2-4167-b315-bcdee5c25dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:39.723234 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb63e6c-c8e2-4167-b315-bcdee5c25dd4 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:39.727380 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3733d28f-08c5-40ef-ab3c-3546006a5537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:39.728013 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733d28f-08c5-40ef-ab3c-3546006a5537 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:39.728292 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733d28f-08c5-40ef-ab3c-3546006a5537 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:39.728565 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3733d28f-08c5-40ef-ab3c-3546006a5537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:39.737498 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733d28f-08c5-40ef-ab3c-3546006a5537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:39.738920 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3733d28f-08c5-40ef-ab3c-3546006a5537 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:39.748843 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1092/2188] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:43:40.091592 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfcae1-f123-4713-a2dd-0dcafdb8a70e None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:40.093289 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c5dfcae1-f123-4713-a2dd-0dcafdb8a70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:40.108218 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dfcae1-f123-4713-a2dd-0dcafdb8a70e None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:40.112885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6564e53-bea6-4175-9540-6e5d66333b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:40.113794 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6564e53-bea6-4175-9540-6e5d66333b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:40.114084 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6564e53-bea6-4175-9540-6e5d66333b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:40.114366 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6564e53-bea6-4175-9540-6e5d66333b72 admin admin] PATH_INFO: `/v3/projects/6f8c06a9b5f2462fb6e17f8a1a64d5b4` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:40.115599 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6564e53-bea6-4175-9540-6e5d66333b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f8c06a9b5f2462fb6e17f8a1a64d5b4)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:40.117552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6564e53-bea6-4175-9540-6e5d66333b72 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:40.165983 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f6564e53-bea6-4175-9540-6e5d66333b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f8c06a9b5f2462fb6e17f8a1a64d5b4', 'request_id': 'req-f6564e53-bea6-4175-9540-6e5d66333b72'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:40.171319 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f6564e53-bea6-4175-9540-6e5d66333b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f8c06a9b5f2462fb6e17f8a1a64d5b4', 'request_id': 'req-f6564e53-bea6-4175-9540-6e5d66333b72'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:40.178449 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f6564e53-bea6-4175-9540-6e5d66333b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f8c06a9b5f2462fb6e17f8a1a64d5b4', 'request_id': 'req-f6564e53-bea6-4175-9540-6e5d66333b72'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:40.189392 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f6564e53-bea6-4175-9540-6e5d66333b72 admin admin] The token cache is being invalidate because project 6f8c06a9b5f2462fb6e17f8a1a64d5b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:40.189695 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f6564e53-bea6-4175-9540-6e5d66333b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:40.190326 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f6564e53-bea6-4175-9540-6e5d66333b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:40.191847 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1097/2189] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:40 2022] DELETE /identity/v3/projects/6f8c06a9b5f2462fb6e17f8a1a64d5b4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:40.197907 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076746c-8edc-44af-8842-7f17154d66a3 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:40.198219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076746c-8edc-44af-8842-7f17154d66a3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:40.198497 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076746c-8edc-44af-8842-7f17154d66a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:40.216819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-5076746c-8edc-44af-8842-7f17154d66a3 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:40.218077 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5076746c-8edc-44af-8842-7f17154d66a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:40.228676 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:40.282802 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1093/2190] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:40.290512 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041e229-893e-4256-bf6d-d1b05a0480b7 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:40.290827 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041e229-893e-4256-bf6d-d1b05a0480b7 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:40.291116 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041e229-893e-4256-bf6d-d1b05a0480b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:40.309811 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-8041e229-893e-4256-bf6d-d1b05a0480b7 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:40.311030 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-8041e229-893e-4256-bf6d-d1b05a0480b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:40.319016 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1098/2191] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:40.323869 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076746c-8edc-44af-8842-7f17154d66a3 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:40.333899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076746c-8edc-44af-8842-7f17154d66a3 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:40.339742 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae6f2f-e145-4c4b-bb76-4df982be7645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:40.340405 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae6f2f-e145-4c4b-bb76-4df982be7645 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:40.340692 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae6f2f-e145-4c4b-bb76-4df982be7645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:40.340972 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae6f2f-e145-4c4b-bb76-4df982be7645 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:40.341740 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae6f2f-e145-4c4b-bb76-4df982be7645 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:43:40.342052 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae6f2f-e145-4c4b-bb76-4df982be7645 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:40.343662 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae6f2f-e145-4c4b-bb76-4df982be7645 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:40.355749 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1094/2192] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:43:40.360015 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041e229-893e-4256-bf6d-d1b05a0480b7 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:40.369263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041e229-893e-4256-bf6d-d1b05a0480b7 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:40.374264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ded9b-7e1c-41c1-a3cb-fea6134d8720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:40.374955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ded9b-7e1c-41c1-a3cb-fea6134d8720 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:40.375239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ded9b-7e1c-41c1-a3cb-fea6134d8720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:40.375638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ded9b-7e1c-41c1-a3cb-fea6134d8720 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:40.376338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ded9b-7e1c-41c1-a3cb-fea6134d8720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:40.378316 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ded9b-7e1c-41c1-a3cb-fea6134d8720 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:40.407547 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1099/2193] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:43:40 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:40.411789 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae6f2f-e145-4c4b-bb76-4df982be7645 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:40.422772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae6f2f-e145-4c4b-bb76-4df982be7645 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:40.480382 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66652c1c-e239-4632-acb8-fc65ed20a4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:40.481047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66652c1c-e239-4632-acb8-fc65ed20a4ee admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:40.481334 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66652c1c-e239-4632-acb8-fc65ed20a4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:40.481649 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66652c1c-e239-4632-acb8-fc65ed20a4ee admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:40.482375 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66652c1c-e239-4632-acb8-fc65ed20a4ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:40.484292 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66652c1c-e239-4632-acb8-fc65ed20a4ee admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:40.503868 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1095/2194] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:43:40 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:43:40.508212 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ded9b-7e1c-41c1-a3cb-fea6134d8720 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:40.518526 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ded9b-7e1c-41c1-a3cb-fea6134d8720 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:40.523549 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ae98a-1e4d-4635-b26e-519f25f69883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:40.524182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ae98a-1e4d-4635-b26e-519f25f69883 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:40.524468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ae98a-1e4d-4635-b26e-519f25f69883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:40.524748 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ae98a-1e4d-4635-b26e-519f25f69883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:40.525536 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ae98a-1e4d-4635-b26e-519f25f69883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:40.527146 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ae98a-1e4d-4635-b26e-519f25f69883 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:40.537869 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1100/2195] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:40.542158 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66652c1c-e239-4632-acb8-fc65ed20a4ee admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:40.551999 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66652c1c-e239-4632-acb8-fc65ed20a4ee admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:40.557654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec85ea7-57b5-47d1-9493-943bf1d80d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:40.558304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec85ea7-57b5-47d1-9493-943bf1d80d28 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:40.558589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec85ea7-57b5-47d1-9493-943bf1d80d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:40.558867 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec85ea7-57b5-47d1-9493-943bf1d80d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:40.559588 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec85ea7-57b5-47d1-9493-943bf1d80d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:40.561171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec85ea7-57b5-47d1-9493-943bf1d80d28 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:40.571157 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1096/2196] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:43:40.574952 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ae98a-1e4d-4635-b26e-519f25f69883 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:40.584591 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ae98a-1e4d-4635-b26e-519f25f69883 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:40.589898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a2b03-a3e2-444a-bf9d-0df65d936627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:40.590773 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a2b03-a3e2-444a-bf9d-0df65d936627 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:40.591060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a2b03-a3e2-444a-bf9d-0df65d936627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:40.591339 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a2b03-a3e2-444a-bf9d-0df65d936627 admin admin] PATH_INFO: `/v3/projects/188b1019e5a44935b7854dcea2e5fc07/users/5d24ee4931164206aeae2b9489e0aa43/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:40.607737 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a2b03-a3e2-444a-bf9d-0df65d936627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=188b1019e5a44935b7854dcea2e5fc07, user_id=5d24ee4931164206aeae2b9489e0aa43, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:40.610400 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a2b03-a3e2-444a-bf9d-0df65d936627 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:40.624337 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1101/2197] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:43:40 2022] PUT /identity/v3/projects/188b1019e5a44935b7854dcea2e5fc07/users/5d24ee4931164206aeae2b9489e0aa43/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:43:40.634527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46624c33-c400-49bf-930d-6e78036edab7 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:40.634824 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46624c33-c400-49bf-930d-6e78036edab7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:40.635106 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46624c33-c400-49bf-930d-6e78036edab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:40.662774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-46624c33-c400-49bf-930d-6e78036edab7 None None] MFA Rules not processed for user `5d24ee4931164206aeae2b9489e0aa43`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:40.664695 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-46624c33-c400-49bf-930d-6e78036edab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:40.727648 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1097/2198] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:43:40.738068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a2b03-a3e2-444a-bf9d-0df65d936627 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:40.739724 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-eb2a2b03-a3e2-444a-bf9d-0df65d936627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:40.753472 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:40.798950 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a2b03-a3e2-444a-bf9d-0df65d936627 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:40.802594 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5df923-dd80-429f-9fd6-c4ea36a26e41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:40.803239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5df923-dd80-429f-9fd6-c4ea36a26e41 service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:40.803531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5df923-dd80-429f-9fd6-c4ea36a26e41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:40.803815 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5df923-dd80-429f-9fd6-c4ea36a26e41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:40.812276 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5df923-dd80-429f-9fd6-c4ea36a26e41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:40.813781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5df923-dd80-429f-9fd6-c4ea36a26e41 service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:40.825920 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1102/2199] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:43:48.676760 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3401e-c164-48e9-993b-4e7cb47c633b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:48.677247 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3401e-c164-48e9-993b-4e7cb47c633b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:48.677326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed3401e-c164-48e9-993b-4e7cb47c633b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:48.698016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-8ed3401e-c164-48e9-993b-4e7cb47c633b None None] MFA Rules not processed for user `d16be8774cb842199cfb9e3b9965bd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:48.699472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8ed3401e-c164-48e9-993b-4e7cb47c633b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:48.709752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:48.793657 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1098/2200] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jun 14 19:43:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:48.842632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5df923-dd80-429f-9fd6-c4ea36a26e41 service cinder] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:48.844098 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-2e5df923-dd80-429f-9fd6-c4ea36a26e41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:48.917250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5df923-dd80-429f-9fd6-c4ea36a26e41 service cinder] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:48.922352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ccadf-d8f8-4758-b7d9-b1c8f5d4198c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fff5414195f4873bcc8752c914b6b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:48.923002 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ccadf-d8f8-4758-b7d9-b1c8f5d4198c service swift] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:48.923289 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ccadf-d8f8-4758-b7d9-b1c8f5d4198c service swift] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:48.923571 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ccadf-d8f8-4758-b7d9-b1c8f5d4198c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:48.932092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ccadf-d8f8-4758-b7d9-b1c8f5d4198c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:48.933751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ccadf-d8f8-4758-b7d9-b1c8f5d4198c service swift] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:48.943036 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1103/2201] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jun 14 19:43:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 19:43:55.190120 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3401e-c164-48e9-993b-4e7cb47c633b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:55.290008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed3401e-c164-48e9-993b-4e7cb47c633b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:55.294586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8067a-8217-4bef-aec8-29c1796f2193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:55.295461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8067a-8217-4bef-aec8-29c1796f2193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:55.295745 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8067a-8217-4bef-aec8-29c1796f2193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:55.296027 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b8067a-8217-4bef-aec8-29c1796f2193 admin admin] PATH_INFO: `/v3/users/5d24ee4931164206aeae2b9489e0aa43` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:55.297217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8067a-8217-4bef-aec8-29c1796f2193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d24ee4931164206aeae2b9489e0aa43)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:55.299177 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b8067a-8217-4bef-aec8-29c1796f2193 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:55.357780 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-01b8067a-8217-4bef-aec8-29c1796f2193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d24ee4931164206aeae2b9489e0aa43'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:55.358501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-01b8067a-8217-4bef-aec8-29c1796f2193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d24ee4931164206aeae2b9489e0aa43'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:55.368238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-01b8067a-8217-4bef-aec8-29c1796f2193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d24ee4931164206aeae2b9489e0aa43'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:55.389744 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-01b8067a-8217-4bef-aec8-29c1796f2193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d24ee4931164206aeae2b9489e0aa43'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:55.427743 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-01b8067a-8217-4bef-aec8-29c1796f2193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d24ee4931164206aeae2b9489e0aa43'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:55.435933 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1099/2202] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:43:55 2022] DELETE /identity/v3/users/5d24ee4931164206aeae2b9489e0aa43 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:43:55.440871 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d554527-f51d-4abc-928d-9cce5e8ed6ef None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:55.441563 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d554527-f51d-4abc-928d-9cce5e8ed6ef None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:55.441563 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d554527-f51d-4abc-928d-9cce5e8ed6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:55.462023 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-0d554527-f51d-4abc-928d-9cce5e8ed6ef None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:43:55.463906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-0d554527-f51d-4abc-928d-9cce5e8ed6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:55.548684 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1104/2203] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:43:55.559465 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8067a-8217-4bef-aec8-29c1796f2193 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:55.560979 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-01b8067a-8217-4bef-aec8-29c1796f2193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:55.606563 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:55.627888 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b8067a-8217-4bef-aec8-29c1796f2193 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:55.632041 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2ed89-ada4-4f28-983a-93f41fa953f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:55.632867 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2ed89-ada4-4f28-983a-93f41fa953f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:55.633287 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2ed89-ada4-4f28-983a-93f41fa953f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:55.633775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2ed89-ada4-4f28-983a-93f41fa953f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:55.646146 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2ed89-ada4-4f28-983a-93f41fa953f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:55.647781 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2ed89-ada4-4f28-983a-93f41fa953f6 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:55.659569 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1100/2204] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:43:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:43:56.002215 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d554527-f51d-4abc-928d-9cce5e8ed6ef None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:43:56.003939 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-0d554527-f51d-4abc-928d-9cce5e8ed6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:43:56.018497 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d554527-f51d-4abc-928d-9cce5e8ed6ef None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:43:56.034206 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb308856-705f-4e72-9831-9077a0cf52cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:43:56.035264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb308856-705f-4e72-9831-9077a0cf52cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:43:56.038967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb308856-705f-4e72-9831-9077a0cf52cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:43:56.039365 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb308856-705f-4e72-9831-9077a0cf52cf admin admin] PATH_INFO: `/v3/projects/188b1019e5a44935b7854dcea2e5fc07` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:43:56.041727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb308856-705f-4e72-9831-9077a0cf52cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=188b1019e5a44935b7854dcea2e5fc07)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:43:56.044268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb308856-705f-4e72-9831-9077a0cf52cf admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:43:56.154126 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:43:56.166721 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eb308856-705f-4e72-9831-9077a0cf52cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188b1019e5a44935b7854dcea2e5fc07', 'request_id': 'req-eb308856-705f-4e72-9831-9077a0cf52cf'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:56.180078 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eb308856-705f-4e72-9831-9077a0cf52cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188b1019e5a44935b7854dcea2e5fc07', 'request_id': 'req-eb308856-705f-4e72-9831-9077a0cf52cf'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:56.190238 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eb308856-705f-4e72-9831-9077a0cf52cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188b1019e5a44935b7854dcea2e5fc07', 'request_id': 'req-eb308856-705f-4e72-9831-9077a0cf52cf'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:56.203064 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eb308856-705f-4e72-9831-9077a0cf52cf admin admin] The token cache is being invalidate because project 188b1019e5a44935b7854dcea2e5fc07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:43:56.203352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eb308856-705f-4e72-9831-9077a0cf52cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:56.203993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eb308856-705f-4e72-9831-9077a0cf52cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:43:56.205581 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1105/2205] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:43:56 2022] DELETE /identity/v3/projects/188b1019e5a44935b7854dcea2e5fc07 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:44:00.250531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bcde1-3f70-465e-8513-988019d3bef3 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:00.251163 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bcde1-3f70-465e-8513-988019d3bef3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:00.251267 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58bcde1-3f70-465e-8513-988019d3bef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:00.285638 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f58bcde1-3f70-465e-8513-988019d3bef3 None None] MFA Rules not processed for user `323c51f037db4ecca2f66cb6e9879246`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:00.287359 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f58bcde1-3f70-465e-8513-988019d3bef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:00.371215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1101/2206] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:44:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:06.200030 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=10,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:10.358252 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=35 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:13.749926 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f9eb1-3667-4fd4-b6da-e4ea0b857793 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:13.750505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f9eb1-3667-4fd4-b6da-e4ea0b857793 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:13.750505 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f9eb1-3667-4fd4-b6da-e4ea0b857793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:13.776466 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-443f9eb1-3667-4fd4-b6da-e4ea0b857793 None None] MFA Rules not processed for user `d16be8774cb842199cfb9e3b9965bd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:13.777725 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-443f9eb1-3667-4fd4-b6da-e4ea0b857793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:13.849304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1106/2207] 10.222.0.44 () {58 vars in 967 bytes} [Tue Jun 14 19:44:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:13.862979 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58bcde1-3f70-465e-8513-988019d3bef3 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:13.864459 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f58bcde1-3f70-465e-8513-988019d3bef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:13.934112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58bcde1-3f70-465e-8513-988019d3bef3 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:13.939111 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927be6e7-e7dd-46d6-9111-0cc959688ca9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fff5414195f4873bcc8752c914b6b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:13.939754 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927be6e7-e7dd-46d6-9111-0cc959688ca9 service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:13.940040 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927be6e7-e7dd-46d6-9111-0cc959688ca9 service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:13.940317 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927be6e7-e7dd-46d6-9111-0cc959688ca9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:13.949041 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927be6e7-e7dd-46d6-9111-0cc959688ca9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:13.950713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927be6e7-e7dd-46d6-9111-0cc959688ca9 service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:13.958725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1102/2208] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jun 14 19:44:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 14 19:44:16.070676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f9eb1-3667-4fd4-b6da-e4ea0b857793 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:16.073898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-443f9eb1-3667-4fd4-b6da-e4ea0b857793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:16.169047 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f9eb1-3667-4fd4-b6da-e4ea0b857793 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:16.174613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ef58b-1558-467d-b19a-2d5df894ea73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:16.175486 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ef58b-1558-467d-b19a-2d5df894ea73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:16.175770 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ef58b-1558-467d-b19a-2d5df894ea73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:16.176237 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ef58b-1558-467d-b19a-2d5df894ea73 admin admin] PATH_INFO: `/v3/users/de843beff4dd401fb34b34ab83f6f7f3` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:16.177714 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ef58b-1558-467d-b19a-2d5df894ea73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de843beff4dd401fb34b34ab83f6f7f3)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:16.179677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ef58b-1558-467d-b19a-2d5df894ea73 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:16.231190 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ed6ef58b-1558-467d-b19a-2d5df894ea73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de843beff4dd401fb34b34ab83f6f7f3'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:16.231866 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ed6ef58b-1558-467d-b19a-2d5df894ea73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de843beff4dd401fb34b34ab83f6f7f3'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:16.239902 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ed6ef58b-1558-467d-b19a-2d5df894ea73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de843beff4dd401fb34b34ab83f6f7f3'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:16.247447 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ed6ef58b-1558-467d-b19a-2d5df894ea73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de843beff4dd401fb34b34ab83f6f7f3'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:16.260415 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ed6ef58b-1558-467d-b19a-2d5df894ea73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de843beff4dd401fb34b34ab83f6f7f3'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:16.267719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1107/2209] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:44:16 2022] DELETE /identity/v3/users/de843beff4dd401fb34b34ab83f6f7f3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:44:16.458198 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927be6e7-e7dd-46d6-9111-0cc959688ca9 service swift] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:16.482191 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927be6e7-e7dd-46d6-9111-0cc959688ca9 service swift] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:16.546296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345df30d-9c36-4f8e-b767-4f58fbcf4540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:16.547332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345df30d-9c36-4f8e-b767-4f58fbcf4540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:16.548076 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345df30d-9c36-4f8e-b767-4f58fbcf4540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:16.548319 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345df30d-9c36-4f8e-b767-4f58fbcf4540 admin admin] PATH_INFO: `/v3/projects/cbf704ce7bfd49f5b83ca2e7e0120c91` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:16.550142 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345df30d-9c36-4f8e-b767-4f58fbcf4540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf704ce7bfd49f5b83ca2e7e0120c91)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:16.552102 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345df30d-9c36-4f8e-b767-4f58fbcf4540 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:16.606872 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-345df30d-9c36-4f8e-b767-4f58fbcf4540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'request_id': 'req-345df30d-9c36-4f8e-b767-4f58fbcf4540'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:16.612253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-345df30d-9c36-4f8e-b767-4f58fbcf4540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'request_id': 'req-345df30d-9c36-4f8e-b767-4f58fbcf4540'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:16.621359 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-345df30d-9c36-4f8e-b767-4f58fbcf4540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf704ce7bfd49f5b83ca2e7e0120c91', 'request_id': 'req-345df30d-9c36-4f8e-b767-4f58fbcf4540'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:16.634349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-345df30d-9c36-4f8e-b767-4f58fbcf4540 admin admin] The token cache is being invalidate because project cbf704ce7bfd49f5b83ca2e7e0120c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:44:16.634639 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-345df30d-9c36-4f8e-b767-4f58fbcf4540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:16.635287 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-345df30d-9c36-4f8e-b767-4f58fbcf4540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:16.636827 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1103/2210] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:44:16 2022] DELETE /identity/v3/projects/cbf704ce7bfd49f5b83ca2e7e0120c91 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:44:16.641669 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff06551-6553-43ad-9e6c-6c99dbb87547 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:16.641967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff06551-6553-43ad-9e6c-6c99dbb87547 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:16.642281 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff06551-6553-43ad-9e6c-6c99dbb87547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:16.660837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-8ff06551-6553-43ad-9e6c-6c99dbb87547 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:16.662087 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-8ff06551-6553-43ad-9e6c-6c99dbb87547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:16.683044 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:16.729729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1108/2211] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:44:16.737612 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0235096-2a85-40b5-94d1-f563a1461530 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:16.737994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0235096-2a85-40b5-94d1-f563a1461530 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:16.738281 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0235096-2a85-40b5-94d1-f563a1461530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:16.757252 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b0235096-2a85-40b5-94d1-f563a1461530 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:16.758666 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b0235096-2a85-40b5-94d1-f563a1461530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:16.766842 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1104/2212] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:16.771178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff06551-6553-43ad-9e6c-6c99dbb87547 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:16.782242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff06551-6553-43ad-9e6c-6c99dbb87547 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:16.787381 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6b9f8-7323-475d-87c4-169219644f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:16.788200 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6b9f8-7323-475d-87c4-169219644f65 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:16.789198 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6b9f8-7323-475d-87c4-169219644f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:16.789578 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6b9f8-7323-475d-87c4-169219644f65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:16.790894 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6b9f8-7323-475d-87c4-169219644f65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:44:16.790894 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6b9f8-7323-475d-87c4-169219644f65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:16.792277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6b9f8-7323-475d-87c4-169219644f65 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:16.805144 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1109/2213] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:44:16.809193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0235096-2a85-40b5-94d1-f563a1461530 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:16.818987 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0235096-2a85-40b5-94d1-f563a1461530 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:16.823905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bca81-c3cb-418e-a5cd-752c399558c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:16.824590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bca81-c3cb-418e-a5cd-752c399558c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:16.824869 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bca81-c3cb-418e-a5cd-752c399558c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:16.825146 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bca81-c3cb-418e-a5cd-752c399558c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:16.825913 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bca81-c3cb-418e-a5cd-752c399558c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:16.827823 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bca81-c3cb-418e-a5cd-752c399558c1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:16.839175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:16.857685 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1105/2214] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:44:16 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:44:16.861848 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6b9f8-7323-475d-87c4-169219644f65 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:16.872695 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6b9f8-7323-475d-87c4-169219644f65 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:16.971078 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5978e0-a344-46ac-9ec9-cd5fca0f47ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:16.971781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5978e0-a344-46ac-9ec9-cd5fca0f47ab admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:16.972062 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5978e0-a344-46ac-9ec9-cd5fca0f47ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:16.972336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5978e0-a344-46ac-9ec9-cd5fca0f47ab admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:16.973058 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5978e0-a344-46ac-9ec9-cd5fca0f47ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:16.974998 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5978e0-a344-46ac-9ec9-cd5fca0f47ab admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:16.998567 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1110/2215] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:44:16 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:44:17.002714 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bca81-c3cb-418e-a5cd-752c399558c1 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:17.015125 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bca81-c3cb-418e-a5cd-752c399558c1 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:17.020215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2de73-4ef3-42c1-9ad2-f4d5cfe6248f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:17.020879 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2de73-4ef3-42c1-9ad2-f4d5cfe6248f admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:17.021265 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2de73-4ef3-42c1-9ad2-f4d5cfe6248f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:17.021569 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2de73-4ef3-42c1-9ad2-f4d5cfe6248f admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:17.022309 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2de73-4ef3-42c1-9ad2-f4d5cfe6248f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:17.024558 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2de73-4ef3-42c1-9ad2-f4d5cfe6248f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:17.042441 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1106/2216] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:44:17.046464 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5978e0-a344-46ac-9ec9-cd5fca0f47ab admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:17.057705 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5978e0-a344-46ac-9ec9-cd5fca0f47ab admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:17.062276 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa076ee-5f9b-456e-92ec-759938334cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:17.062967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa076ee-5f9b-456e-92ec-759938334cfb admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:17.063251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa076ee-5f9b-456e-92ec-759938334cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:17.063528 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa076ee-5f9b-456e-92ec-759938334cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:17.064257 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa076ee-5f9b-456e-92ec-759938334cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:17.065889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa076ee-5f9b-456e-92ec-759938334cfb admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:17.077735 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1111/2217] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:44:17.081839 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2de73-4ef3-42c1-9ad2-f4d5cfe6248f admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:17.092677 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2de73-4ef3-42c1-9ad2-f4d5cfe6248f admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:17.098916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2d98b-a322-4d03-808d-979cedfb62e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:17.102022 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2d98b-a322-4d03-808d-979cedfb62e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:17.102022 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2d98b-a322-4d03-808d-979cedfb62e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:17.102249 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2d98b-a322-4d03-808d-979cedfb62e7 admin admin] PATH_INFO: `/v3/projects/27b2e717e5ad49f889c111fe1ac5fd81/users/01d324125a7a45559c5f6e2228b89947/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:17.119114 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2d98b-a322-4d03-808d-979cedfb62e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b2e717e5ad49f889c111fe1ac5fd81, user_id=01d324125a7a45559c5f6e2228b89947, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:17.122235 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2d98b-a322-4d03-808d-979cedfb62e7 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:17.139710 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1107/2218] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:44:17 2022] PUT /identity/v3/projects/27b2e717e5ad49f889c111fe1ac5fd81/users/01d324125a7a45559c5f6e2228b89947/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:44:17.149442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b7dce-f767-4f5e-a8c8-6417af0c7676 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:17.149740 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b7dce-f767-4f5e-a8c8-6417af0c7676 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:17.150020 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b7dce-f767-4f5e-a8c8-6417af0c7676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:17.182922 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-9d6b7dce-f767-4f5e-a8c8-6417af0c7676 None None] MFA Rules not processed for user `01d324125a7a45559c5f6e2228b89947`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:17.184155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-9d6b7dce-f767-4f5e-a8c8-6417af0c7676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:17.286941 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1112/2219] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:44:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:17.295335 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2d98b-a322-4d03-808d-979cedfb62e7 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:17.299017 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e7b2d98b-a322-4d03-808d-979cedfb62e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:17.348166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f865bf-d2b0-4471-9772-44615dc704d3 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:17.348691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f865bf-d2b0-4471-9772-44615dc704d3 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:17.349145 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f865bf-d2b0-4471-9772-44615dc704d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:17.387044 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-00f865bf-d2b0-4471-9772-44615dc704d3 None None] MFA Rules not processed for user `d16be8774cb842199cfb9e3b9965bd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:17.388350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-00f865bf-d2b0-4471-9772-44615dc704d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:17.428765 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2d98b-a322-4d03-808d-979cedfb62e7 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:17.433345 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d734271-357c-4a55-8abe-fa4978c10130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:17.434047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d734271-357c-4a55-8abe-fa4978c10130 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:17.434516 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:17.434890 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d734271-357c-4a55-8abe-fa4978c10130 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:17.435204 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d734271-357c-4a55-8abe-fa4978c10130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:17.450499 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d734271-357c-4a55-8abe-fa4978c10130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:17.452203 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d734271-357c-4a55-8abe-fa4978c10130 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:17.467623 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1108/2220] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:44:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:44:17.509761 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1113/2221] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jun 14 19:44:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:44:17.527860 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d734271-357c-4a55-8abe-fa4978c10130 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:17.529998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2d734271-357c-4a55-8abe-fa4978c10130 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:17.620295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d734271-357c-4a55-8abe-fa4978c10130 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:17.633683 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4d271-abdf-4793-9dd2-569e407f05a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fff5414195f4873bcc8752c914b6b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:17.635807 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4d271-abdf-4793-9dd2-569e407f05a8 service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:17.636161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4d271-abdf-4793-9dd2-569e407f05a8 service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:17.636542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4d271-abdf-4793-9dd2-569e407f05a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:17.652133 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4d271-abdf-4793-9dd2-569e407f05a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:17.654973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4d271-abdf-4793-9dd2-569e407f05a8 service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:17.668199 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1109/2222] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jun 14 19:44:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 19:44:19.613013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f865bf-d2b0-4471-9772-44615dc704d3 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:19.614553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-00f865bf-d2b0-4471-9772-44615dc704d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:19.762232 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f865bf-d2b0-4471-9772-44615dc704d3 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:19.767847 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142c9e9-0e42-484a-ae1c-0dc6ab21b48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:19.769042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142c9e9-0e42-484a-ae1c-0dc6ab21b48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:19.769586 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142c9e9-0e42-484a-ae1c-0dc6ab21b48b admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:19.770098 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142c9e9-0e42-484a-ae1c-0dc6ab21b48b admin admin] PATH_INFO: `/v3/users/861f91c3b7bc416db76ded0f0eee0082` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:19.771966 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142c9e9-0e42-484a-ae1c-0dc6ab21b48b admin admin] RBAC: Authorizing `identity:delete_user(user_id=861f91c3b7bc416db76ded0f0eee0082)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:19.775959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7142c9e9-0e42-484a-ae1c-0dc6ab21b48b admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:19.901132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-7142c9e9-0e42-484a-ae1c-0dc6ab21b48b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '861f91c3b7bc416db76ded0f0eee0082'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:19.903679 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-7142c9e9-0e42-484a-ae1c-0dc6ab21b48b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '861f91c3b7bc416db76ded0f0eee0082'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:19.918042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-7142c9e9-0e42-484a-ae1c-0dc6ab21b48b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '861f91c3b7bc416db76ded0f0eee0082'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:19.935263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-7142c9e9-0e42-484a-ae1c-0dc6ab21b48b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '861f91c3b7bc416db76ded0f0eee0082'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:19.967222 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-7142c9e9-0e42-484a-ae1c-0dc6ab21b48b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '861f91c3b7bc416db76ded0f0eee0082'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:19.981434 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1114/2223] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:44:19 2022] DELETE /identity/v3/users/861f91c3b7bc416db76ded0f0eee0082 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:44:19.985983 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6a978-8680-4430-a5e5-975210bc27fd None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:19.986439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6a978-8680-4430-a5e5-975210bc27fd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:19.986694 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6a978-8680-4430-a5e5-975210bc27fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:20.022125 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-8ac6a978-8680-4430-a5e5-975210bc27fd None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:20.024217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8ac6a978-8680-4430-a5e5-975210bc27fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:20.111299 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:20.138794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1110/2224] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:20.150231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142c9e9-0e42-484a-ae1c-0dc6ab21b48b admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:20.151898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7142c9e9-0e42-484a-ae1c-0dc6ab21b48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:20.221026 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:20.251502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142c9e9-0e42-484a-ae1c-0dc6ab21b48b admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:20.265836 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9a2a7-afe6-4dfa-b30c-c43c66c1a507 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:20.266717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9a2a7-afe6-4dfa-b30c-c43c66c1a507 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:20.267153 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9a2a7-afe6-4dfa-b30c-c43c66c1a507 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:20.267438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9a2a7-afe6-4dfa-b30c-c43c66c1a507 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:20.275154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6a978-8680-4430-a5e5-975210bc27fd None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:20.276568 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8ac6a978-8680-4430-a5e5-975210bc27fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:20.294522 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6a978-8680-4430-a5e5-975210bc27fd None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:20.297926 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9a2a7-afe6-4dfa-b30c-c43c66c1a507 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:20.299400 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e9a2a7-afe6-4dfa-b30c-c43c66c1a507 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:20.303401 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67827814-fa01-40c5-9ee5-34114bee06c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:20.305198 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67827814-fa01-40c5-9ee5-34114bee06c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:20.305355 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67827814-fa01-40c5-9ee5-34114bee06c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:20.310800 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67827814-fa01-40c5-9ee5-34114bee06c0 admin admin] PATH_INFO: `/v3/users/01d324125a7a45559c5f6e2228b89947` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:20.312937 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67827814-fa01-40c5-9ee5-34114bee06c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01d324125a7a45559c5f6e2228b89947)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:20.320571 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1115/2225] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:44:20.321008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67827814-fa01-40c5-9ee5-34114bee06c0 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:20.450786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-67827814-fa01-40c5-9ee5-34114bee06c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01d324125a7a45559c5f6e2228b89947'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:20.451675 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-67827814-fa01-40c5-9ee5-34114bee06c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01d324125a7a45559c5f6e2228b89947'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:20.469480 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-67827814-fa01-40c5-9ee5-34114bee06c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01d324125a7a45559c5f6e2228b89947'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:20.486149 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-67827814-fa01-40c5-9ee5-34114bee06c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01d324125a7a45559c5f6e2228b89947'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:20.513288 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-67827814-fa01-40c5-9ee5-34114bee06c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01d324125a7a45559c5f6e2228b89947'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:20.528627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1111/2226] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:44:20 2022] DELETE /identity/v3/users/01d324125a7a45559c5f6e2228b89947 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:44:20.532980 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6fc62-032b-4710-b1eb-7bcbab5d6073 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:20.533418 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6fc62-032b-4710-b1eb-7bcbab5d6073 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:20.533801 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6fc62-032b-4710-b1eb-7bcbab5d6073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:20.554178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-11d6fc62-032b-4710-b1eb-7bcbab5d6073 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:20.555903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-11d6fc62-032b-4710-b1eb-7bcbab5d6073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:20.633965 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1116/2227] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:20.679025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67827814-fa01-40c5-9ee5-34114bee06c0 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:20.681346 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-67827814-fa01-40c5-9ee5-34114bee06c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:20.830105 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67827814-fa01-40c5-9ee5-34114bee06c0 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:20.834449 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3337a-0c04-4e0b-8cdc-3215909adf16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:20.835733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3337a-0c04-4e0b-8cdc-3215909adf16 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:20.836025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3337a-0c04-4e0b-8cdc-3215909adf16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:20.836911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3337a-0c04-4e0b-8cdc-3215909adf16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:20.850238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3337a-0c04-4e0b-8cdc-3215909adf16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:20.853055 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3337a-0c04-4e0b-8cdc-3215909adf16 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:20.881546 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1112/2228] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:44:20.906475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6fc62-032b-4710-b1eb-7bcbab5d6073 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:20.908088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-11d6fc62-032b-4710-b1eb-7bcbab5d6073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:20.932868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6fc62-032b-4710-b1eb-7bcbab5d6073 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:20.945659 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38dfb7-136c-4554-858a-e6485a6feeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:20.946183 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38dfb7-136c-4554-858a-e6485a6feeb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:20.946584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38dfb7-136c-4554-858a-e6485a6feeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:20.946961 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38dfb7-136c-4554-858a-e6485a6feeb4 admin admin] PATH_INFO: `/v3/projects/1cdd88f6b48d4e50b0cabfdf307b1c62` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:20.950150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38dfb7-136c-4554-858a-e6485a6feeb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cdd88f6b48d4e50b0cabfdf307b1c62)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:20.953557 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38dfb7-136c-4554-858a-e6485a6feeb4 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:21.050941 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-8b38dfb7-136c-4554-858a-e6485a6feeb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cdd88f6b48d4e50b0cabfdf307b1c62', 'request_id': 'req-8b38dfb7-136c-4554-858a-e6485a6feeb4'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:21.066414 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-8b38dfb7-136c-4554-858a-e6485a6feeb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cdd88f6b48d4e50b0cabfdf307b1c62', 'request_id': 'req-8b38dfb7-136c-4554-858a-e6485a6feeb4'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:21.086379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-8b38dfb7-136c-4554-858a-e6485a6feeb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cdd88f6b48d4e50b0cabfdf307b1c62', 'request_id': 'req-8b38dfb7-136c-4554-858a-e6485a6feeb4'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:21.144031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-8b38dfb7-136c-4554-858a-e6485a6feeb4 admin admin] The token cache is being invalidate because project 1cdd88f6b48d4e50b0cabfdf307b1c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:44:21.144791 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-8b38dfb7-136c-4554-858a-e6485a6feeb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:21.146472 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-8b38dfb7-136c-4554-858a-e6485a6feeb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:21.150132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1117/2229] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:44:20 2022] DELETE /identity/v3/projects/1cdd88f6b48d4e50b0cabfdf307b1c62 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:44:21.157433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6304e-1ca1-4adc-9a75-c6280a2ec421 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:21.158259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6304e-1ca1-4adc-9a75-c6280a2ec421 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:21.158549 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6304e-1ca1-4adc-9a75-c6280a2ec421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:21.249955 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-29a6304e-1ca1-4adc-9a75-c6280a2ec421 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:21.251247 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-29a6304e-1ca1-4adc-9a75-c6280a2ec421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:21.293160 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:21.483049 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1113/2230] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:21.495297 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ce4dd-78a4-4ca8-ad03-fd2b96743c27 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:21.505123 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ce4dd-78a4-4ca8-ad03-fd2b96743c27 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:21.505123 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ce4dd-78a4-4ca8-ad03-fd2b96743c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:21.524330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-f78ce4dd-78a4-4ca8-ad03-fd2b96743c27 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:21.525607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-f78ce4dd-78a4-4ca8-ad03-fd2b96743c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:21.535248 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1118/2231] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:21.539303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6304e-1ca1-4adc-9a75-c6280a2ec421 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:21.551742 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6304e-1ca1-4adc-9a75-c6280a2ec421 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:21.560627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bf2bd-3f0e-45da-9a76-8954c91219c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:21.561353 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bf2bd-3f0e-45da-9a76-8954c91219c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:21.561676 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bf2bd-3f0e-45da-9a76-8954c91219c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:21.562004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982bf2bd-3f0e-45da-9a76-8954c91219c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:21.562850 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bf2bd-3f0e-45da-9a76-8954c91219c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:44:21.563182 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bf2bd-3f0e-45da-9a76-8954c91219c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:21.564809 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982bf2bd-3f0e-45da-9a76-8954c91219c3 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:21.583477 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1114/2232] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:44:21.584838 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ce4dd-78a4-4ca8-ad03-fd2b96743c27 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:21.597819 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ce4dd-78a4-4ca8-ad03-fd2b96743c27 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:21.611076 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617eee0a-202d-486f-92de-4850e940ac9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:21.611887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617eee0a-202d-486f-92de-4850e940ac9a admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:21.612512 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617eee0a-202d-486f-92de-4850e940ac9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:21.612628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617eee0a-202d-486f-92de-4850e940ac9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:21.613657 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617eee0a-202d-486f-92de-4850e940ac9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:21.615954 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617eee0a-202d-486f-92de-4850e940ac9a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:21.636082 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bf2bd-3f0e-45da-9a76-8954c91219c3 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:21.642762 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-982bf2bd-3f0e-45da-9a76-8954c91219c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:21.671203 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982bf2bd-3f0e-45da-9a76-8954c91219c3 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:21.680016 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1119/2233] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:44:21 2022] POST /identity/v3/projects => generated 371 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:44:21.681326 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617eee0a-202d-486f-92de-4850e940ac9a admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:21.692367 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c27518-a6f6-4e11-82e0-66676fb4e380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:21.695978 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c27518-a6f6-4e11-82e0-66676fb4e380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:21.699208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c27518-a6f6-4e11-82e0-66676fb4e380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:21.699928 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c27518-a6f6-4e11-82e0-66676fb4e380 admin admin] PATH_INFO: `/v3/projects/27b2e717e5ad49f889c111fe1ac5fd81` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:21.703100 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c27518-a6f6-4e11-82e0-66676fb4e380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27b2e717e5ad49f889c111fe1ac5fd81)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:21.705461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c27518-a6f6-4e11-82e0-66676fb4e380 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:21.727159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:21.763492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617eee0a-202d-486f-92de-4850e940ac9a admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:21.778028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73574a-7101-40b8-be99-f43b651767f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:21.779141 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73574a-7101-40b8-be99-f43b651767f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:21.779433 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73574a-7101-40b8-be99-f43b651767f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:21.780220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73574a-7101-40b8-be99-f43b651767f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:21.781951 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73574a-7101-40b8-be99-f43b651767f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:21.783918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73574a-7101-40b8-be99-f43b651767f2 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:21.794890 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f2c27518-a6f6-4e11-82e0-66676fb4e380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27b2e717e5ad49f889c111fe1ac5fd81', 'request_id': 'req-f2c27518-a6f6-4e11-82e0-66676fb4e380'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:21.802206 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f2c27518-a6f6-4e11-82e0-66676fb4e380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27b2e717e5ad49f889c111fe1ac5fd81', 'request_id': 'req-f2c27518-a6f6-4e11-82e0-66676fb4e380'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:21.815249 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1120/2234] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:44:21 2022] POST /identity/v3/users => generated 286 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:44:21.815249 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c0cd7-c058-4503-af34-1e76e904a7ee None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:21.815249 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c0cd7-c058-4503-af34-1e76e904a7ee None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:21.815249 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c0cd7-c058-4503-af34-1e76e904a7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:21.823357 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f2c27518-a6f6-4e11-82e0-66676fb4e380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27b2e717e5ad49f889c111fe1ac5fd81', 'request_id': 'req-f2c27518-a6f6-4e11-82e0-66676fb4e380'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:21.843335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-b70c0cd7-c058-4503-af34-1e76e904a7ee None None] MFA Rules not processed for user `9b28c3b97f9f44148dd02f41509887e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:21.844980 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b70c0cd7-c058-4503-af34-1e76e904a7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:21.848625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f2c27518-a6f6-4e11-82e0-66676fb4e380 admin admin] The token cache is being invalidate because project 27b2e717e5ad49f889c111fe1ac5fd81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:44:21.849833 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f2c27518-a6f6-4e11-82e0-66676fb4e380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:21.851319 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f2c27518-a6f6-4e11-82e0-66676fb4e380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:21.856951 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1115/2235] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:44:21 2022] DELETE /identity/v3/projects/27b2e717e5ad49f889c111fe1ac5fd81 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:44:21.858097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c27518-a6f6-4e11-82e0-66676fb4e380 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:21.859940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f2c27518-a6f6-4e11-82e0-66676fb4e380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:21.930621 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1121/2236] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:44:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:21.939214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca052209-edd3-4dd3-97a7-eaae17ad6441 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:21.939661 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca052209-edd3-4dd3-97a7-eaae17ad6441 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:21.939952 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca052209-edd3-4dd3-97a7-eaae17ad6441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:21.980972 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-ca052209-edd3-4dd3-97a7-eaae17ad6441 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:21.982438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-ca052209-edd3-4dd3-97a7-eaae17ad6441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:21.995092 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c27518-a6f6-4e11-82e0-66676fb4e380 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:22.013174 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77411c50-cf92-428b-8472-acb85f9366b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:22.014061 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77411c50-cf92-428b-8472-acb85f9366b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:22.014444 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77411c50-cf92-428b-8472-acb85f9366b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:22.014826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77411c50-cf92-428b-8472-acb85f9366b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:22.015748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77411c50-cf92-428b-8472-acb85f9366b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:22.017291 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1122/2237] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:22.017612 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77411c50-cf92-428b-8472-acb85f9366b9 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:22.023812 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:22.025712 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70c60e-77cc-4efe-94a3-828f0b139973 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:22.026009 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70c60e-77cc-4efe-94a3-828f0b139973 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:22.026346 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70c60e-77cc-4efe-94a3-828f0b139973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:22.046723 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1116/2238] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:44:22.049651 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77411c50-cf92-428b-8472-acb85f9366b9 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:22.062538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-2e70c60e-77cc-4efe-94a3-828f0b139973 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:22.064064 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-2e70c60e-77cc-4efe-94a3-828f0b139973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:22.081633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1123/2239] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:22.083018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70c60e-77cc-4efe-94a3-828f0b139973 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:22.087038 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77411c50-cf92-428b-8472-acb85f9366b9 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:22.106888 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70c60e-77cc-4efe-94a3-828f0b139973 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:22.107158 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0ff33-9f87-4d36-a26f-e3d82427af77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:22.107671 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0ff33-9f87-4d36-a26f-e3d82427af77 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:22.107962 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0ff33-9f87-4d36-a26f-e3d82427af77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:22.108243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f0ff33-9f87-4d36-a26f-e3d82427af77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:22.108988 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0ff33-9f87-4d36-a26f-e3d82427af77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:22.110773 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f0ff33-9f87-4d36-a26f-e3d82427af77 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:22.114302 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bb37a-a03e-42fe-9ac1-fb74bbda9657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:22.115297 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bb37a-a03e-42fe-9ac1-fb74bbda9657 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:22.115737 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bb37a-a03e-42fe-9ac1-fb74bbda9657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:22.116349 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bb37a-a03e-42fe-9ac1-fb74bbda9657 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:22.117263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bb37a-a03e-42fe-9ac1-fb74bbda9657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:44:22.117751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bb37a-a03e-42fe-9ac1-fb74bbda9657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:22.120382 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194bb37a-a03e-42fe-9ac1-fb74bbda9657 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:22.124732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1117/2240] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:44:22.125854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0ff33-9f87-4d36-a26f-e3d82427af77 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:22.142094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1124/2241] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:44:22.149592 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f0ff33-9f87-4d36-a26f-e3d82427af77 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:22.151388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bb37a-a03e-42fe-9ac1-fb74bbda9657 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:22.158106 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1134d-e94e-44ee-a0c1-b1b4970d485e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:22.159016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1134d-e94e-44ee-a0c1-b1b4970d485e admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:22.159369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1134d-e94e-44ee-a0c1-b1b4970d485e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:22.159874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1134d-e94e-44ee-a0c1-b1b4970d485e admin admin] PATH_INFO: `/v3/projects/780be61f7cb0429fbd97488f41a6b644/users/7a5fb1cff46d4e3e8e23f9a788cec9ed/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:22.167937 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bb37a-a03e-42fe-9ac1-fb74bbda9657 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:22.174091 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e1e2e-75be-45be-9717-9505eed9f0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:22.175082 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e1e2e-75be-45be-9717-9505eed9f0fe admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:22.175470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e1e2e-75be-45be-9717-9505eed9f0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:22.176041 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e1e2e-75be-45be-9717-9505eed9f0fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:22.177368 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e1e2e-75be-45be-9717-9505eed9f0fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:22.181553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e1e2e-75be-45be-9717-9505eed9f0fe admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:22.198831 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1134d-e94e-44ee-a0c1-b1b4970d485e admin admin] RBAC: Authorizing `identity:create_grant(project_id=780be61f7cb0429fbd97488f41a6b644, user_id=7a5fb1cff46d4e3e8e23f9a788cec9ed, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:22.202206 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1134d-e94e-44ee-a0c1-b1b4970d485e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:22.237725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1118/2242] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:44:22 2022] PUT /identity/v3/projects/780be61f7cb0429fbd97488f41a6b644/users/7a5fb1cff46d4e3e8e23f9a788cec9ed/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:44:22.246153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a35d2-e54b-47a2-aa14-0fa5c1d4ba95 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:22.246693 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a35d2-e54b-47a2-aa14-0fa5c1d4ba95 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:22.247314 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a35d2-e54b-47a2-aa14-0fa5c1d4ba95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:22.277634 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1125/2243] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:44:22 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:44:22.282266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e1e2e-75be-45be-9717-9505eed9f0fe admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:22.294990 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-3e7a35d2-e54b-47a2-aa14-0fa5c1d4ba95 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:22.296274 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3e7a35d2-e54b-47a2-aa14-0fa5c1d4ba95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:22.435509 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e1e2e-75be-45be-9717-9505eed9f0fe admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:22.441430 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1119/2244] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:44:22.449705 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfbb26-a0b3-424f-a012-3d1c4c80460c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:22.452891 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfbb26-a0b3-424f-a012-3d1c4c80460c admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:22.453283 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfbb26-a0b3-424f-a012-3d1c4c80460c admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:22.453598 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bfbb26-a0b3-424f-a012-3d1c4c80460c admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:22.454356 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfbb26-a0b3-424f-a012-3d1c4c80460c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:22.456629 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a35d2-e54b-47a2-aa14-0fa5c1d4ba95 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:22.458430 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3e7a35d2-e54b-47a2-aa14-0fa5c1d4ba95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:22.458620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bfbb26-a0b3-424f-a012-3d1c4c80460c admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:22.510801 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1126/2245] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:44:22 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:44:22.516544 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfbb26-a0b3-424f-a012-3d1c4c80460c admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:22.548032 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bfbb26-a0b3-424f-a012-3d1c4c80460c admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:22.560283 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8273d5-b4a8-407a-b7b9-64ba713dad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:22.560581 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8273d5-b4a8-407a-b7b9-64ba713dad3d admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:22.560706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8273d5-b4a8-407a-b7b9-64ba713dad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:22.560958 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8273d5-b4a8-407a-b7b9-64ba713dad3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:22.561723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8273d5-b4a8-407a-b7b9-64ba713dad3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:22.563362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8273d5-b4a8-407a-b7b9-64ba713dad3d admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:22.564926 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:22.591896 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1127/2246] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:44:22.595447 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8273d5-b4a8-407a-b7b9-64ba713dad3d admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:22.618824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8273d5-b4a8-407a-b7b9-64ba713dad3d admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:22.638149 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c31f7-5e27-4fc0-b368-c2272973f700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:22.638980 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c31f7-5e27-4fc0-b368-c2272973f700 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:22.639368 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c31f7-5e27-4fc0-b368-c2272973f700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:22.639754 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c31f7-5e27-4fc0-b368-c2272973f700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:22.640596 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c31f7-5e27-4fc0-b368-c2272973f700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:22.642341 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c31f7-5e27-4fc0-b368-c2272973f700 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:22.646411 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a35d2-e54b-47a2-aa14-0fa5c1d4ba95 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:22.652409 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcb302-4f58-4c90-b6bc-346797abbd66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:22.653080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcb302-4f58-4c90-b6bc-346797abbd66 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:22.653389 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcb302-4f58-4c90-b6bc-346797abbd66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:22.654089 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcb302-4f58-4c90-b6bc-346797abbd66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:22.673273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcb302-4f58-4c90-b6bc-346797abbd66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:22.678520 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcb302-4f58-4c90-b6bc-346797abbd66 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:22.691847 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1120/2248] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:44:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:44:22.692345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1128/2248] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:44:22.693130 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcb302-4f58-4c90-b6bc-346797abbd66 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:22.704685 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcb302-4f58-4c90-b6bc-346797abbd66 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:22.712072 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae11d92-1a1e-4136-a60c-f4e20fe13de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:22.713365 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae11d92-1a1e-4136-a60c-f4e20fe13de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:22.713695 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae11d92-1a1e-4136-a60c-f4e20fe13de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:22.713976 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae11d92-1a1e-4136-a60c-f4e20fe13de7 admin admin] PATH_INFO: `/v3/projects/80045eaa8bb749e4ad460b36011f5e3a/users/335472ad818241a388ddf0247d9dbb2d/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:22.740287 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae11d92-1a1e-4136-a60c-f4e20fe13de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80045eaa8bb749e4ad460b36011f5e3a, user_id=335472ad818241a388ddf0247d9dbb2d, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:22.746330 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae11d92-1a1e-4136-a60c-f4e20fe13de7 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:22.769946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1121/2249] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:44:22 2022] PUT /identity/v3/projects/80045eaa8bb749e4ad460b36011f5e3a/users/335472ad818241a388ddf0247d9dbb2d/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:44:22.792688 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403d019-f630-4248-8185-d293363e33e1 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:22.792897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403d019-f630-4248-8185-d293363e33e1 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:22.793339 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403d019-f630-4248-8185-d293363e33e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:22.834546 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-9403d019-f630-4248-8185-d293363e33e1 None None] MFA Rules not processed for user `335472ad818241a388ddf0247d9dbb2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:22.836650 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-9403d019-f630-4248-8185-d293363e33e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:22.949876 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1129/2250] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:44:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:22.956113 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae11d92-1a1e-4136-a60c-f4e20fe13de7 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:22.958033 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-cae11d92-1a1e-4136-a60c-f4e20fe13de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:22.970614 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:23.098783 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae11d92-1a1e-4136-a60c-f4e20fe13de7 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:23.111514 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb350e-5e23-4533-afae-e2eaa689114f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:23.112695 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb350e-5e23-4533-afae-e2eaa689114f service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:23.113346 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb350e-5e23-4533-afae-e2eaa689114f service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:23.114723 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb350e-5e23-4533-afae-e2eaa689114f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:23.157646 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb350e-5e23-4533-afae-e2eaa689114f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:23.162830 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb350e-5e23-4533-afae-e2eaa689114f service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:23.193225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1122/2251] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:44:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:44:23.222406 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403d019-f630-4248-8185-d293363e33e1 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:23.358536 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403d019-f630-4248-8185-d293363e33e1 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:23.363263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0c476-a236-412a-8c63-9f56b2825c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:23.364163 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0c476-a236-412a-8c63-9f56b2825c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:23.364447 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0c476-a236-412a-8c63-9f56b2825c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:23.365493 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0c476-a236-412a-8c63-9f56b2825c39 admin admin] PATH_INFO: `/v3/users/335472ad818241a388ddf0247d9dbb2d` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:23.367367 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0c476-a236-412a-8c63-9f56b2825c39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=335472ad818241a388ddf0247d9dbb2d)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:23.369311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0c476-a236-412a-8c63-9f56b2825c39 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:23.453763 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-c6a0c476-a236-412a-8c63-9f56b2825c39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '335472ad818241a388ddf0247d9dbb2d'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:23.454753 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-c6a0c476-a236-412a-8c63-9f56b2825c39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '335472ad818241a388ddf0247d9dbb2d'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:23.472130 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-c6a0c476-a236-412a-8c63-9f56b2825c39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '335472ad818241a388ddf0247d9dbb2d'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:23.482141 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-c6a0c476-a236-412a-8c63-9f56b2825c39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '335472ad818241a388ddf0247d9dbb2d'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:23.496367 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:23.499594 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-c6a0c476-a236-412a-8c63-9f56b2825c39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '335472ad818241a388ddf0247d9dbb2d'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:23.508119 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1130/2252] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:44:23 2022] DELETE /identity/v3/users/335472ad818241a388ddf0247d9dbb2d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:44:23.512729 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5719c-b671-4cb9-826b-427e63290f49 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:23.513036 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5719c-b671-4cb9-826b-427e63290f49 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:23.513358 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5719c-b671-4cb9-826b-427e63290f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:23.539161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-2da5719c-b671-4cb9-826b-427e63290f49 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:23.541034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2da5719c-b671-4cb9-826b-427e63290f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:23.686113 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1123/2253] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:23.722619 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0c476-a236-412a-8c63-9f56b2825c39 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:23.725083 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c6a0c476-a236-412a-8c63-9f56b2825c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:23.844326 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0c476-a236-412a-8c63-9f56b2825c39 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:23.889866 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10203256-7fa6-4c56-9723-541114cd4c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:23.893502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10203256-7fa6-4c56-9723-541114cd4c7c service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:23.893864 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10203256-7fa6-4c56-9723-541114cd4c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:23.894151 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10203256-7fa6-4c56-9723-541114cd4c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:23.916773 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10203256-7fa6-4c56-9723-541114cd4c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:23.918676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10203256-7fa6-4c56-9723-541114cd4c7c service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:23.940118 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1131/2254] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:44:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:44:24.412026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5719c-b671-4cb9-826b-427e63290f49 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:24.414123 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2da5719c-b671-4cb9-826b-427e63290f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:24.441746 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5719c-b671-4cb9-826b-427e63290f49 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:24.451004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980876c-6c5c-44cf-9ad5-5f90e5b27c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:24.451916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980876c-6c5c-44cf-9ad5-5f90e5b27c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:24.452182 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980876c-6c5c-44cf-9ad5-5f90e5b27c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:24.452558 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980876c-6c5c-44cf-9ad5-5f90e5b27c2f admin admin] PATH_INFO: `/v3/projects/80045eaa8bb749e4ad460b36011f5e3a` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:24.458194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980876c-6c5c-44cf-9ad5-5f90e5b27c2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=80045eaa8bb749e4ad460b36011f5e3a)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:24.460944 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980876c-6c5c-44cf-9ad5-5f90e5b27c2f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:24.600067 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c980876c-6c5c-44cf-9ad5-5f90e5b27c2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80045eaa8bb749e4ad460b36011f5e3a', 'request_id': 'req-c980876c-6c5c-44cf-9ad5-5f90e5b27c2f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:24.612117 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c980876c-6c5c-44cf-9ad5-5f90e5b27c2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80045eaa8bb749e4ad460b36011f5e3a', 'request_id': 'req-c980876c-6c5c-44cf-9ad5-5f90e5b27c2f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:24.622830 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c980876c-6c5c-44cf-9ad5-5f90e5b27c2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80045eaa8bb749e4ad460b36011f5e3a', 'request_id': 'req-c980876c-6c5c-44cf-9ad5-5f90e5b27c2f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:24.643236 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c980876c-6c5c-44cf-9ad5-5f90e5b27c2f admin admin] The token cache is being invalidate because project 80045eaa8bb749e4ad460b36011f5e3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:44:24.643530 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c980876c-6c5c-44cf-9ad5-5f90e5b27c2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:24.646864 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c980876c-6c5c-44cf-9ad5-5f90e5b27c2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:44:24.653321 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1124/2255] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:44:24 2022] DELETE /identity/v3/projects/80045eaa8bb749e4ad460b36011f5e3a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:44:24.655658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebcf6f-0672-454e-99b8-6404a5025b8f None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:24.655953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebcf6f-0672-454e-99b8-6404a5025b8f None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:24.656271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebcf6f-0672-454e-99b8-6404a5025b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:24.680282 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-f3ebcf6f-0672-454e-99b8-6404a5025b8f None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:24.681717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-f3ebcf6f-0672-454e-99b8-6404a5025b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:24.827865 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1132/2256] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:24.837680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b191f-c6fb-4afa-89e7-48bd485450d9 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:24.838038 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b191f-c6fb-4afa-89e7-48bd485450d9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:24.838684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b191f-c6fb-4afa-89e7-48bd485450d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:24.874041 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-784b191f-c6fb-4afa-89e7-48bd485450d9 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:24.875338 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-784b191f-c6fb-4afa-89e7-48bd485450d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:24.887057 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1125/2257] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:24.890291 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebcf6f-0672-454e-99b8-6404a5025b8f None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:24.904771 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ebcf6f-0672-454e-99b8-6404a5025b8f None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:24.919354 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603b3b2-fade-4105-b768-1eb6bbe4f6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:24.920054 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603b3b2-fade-4105-b768-1eb6bbe4f6a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:24.920343 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603b3b2-fade-4105-b768-1eb6bbe4f6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:24.920623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603b3b2-fade-4105-b768-1eb6bbe4f6a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:24.921401 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603b3b2-fade-4105-b768-1eb6bbe4f6a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:44:24.921709 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603b3b2-fade-4105-b768-1eb6bbe4f6a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:24.923327 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603b3b2-fade-4105-b768-1eb6bbe4f6a4 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:24.948669 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1133/2258] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:44:24.951117 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b191f-c6fb-4afa-89e7-48bd485450d9 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:24.971684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784b191f-c6fb-4afa-89e7-48bd485450d9 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:24.983805 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931660d3-480d-4416-bd4a-acad5b483ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:24.984783 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931660d3-480d-4416-bd4a-acad5b483ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:24.985300 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931660d3-480d-4416-bd4a-acad5b483ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:24.985818 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931660d3-480d-4416-bd4a-acad5b483ae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:24.986734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931660d3-480d-4416-bd4a-acad5b483ae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:24.989924 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931660d3-480d-4416-bd4a-acad5b483ae3 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:25.061945 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1126/2259] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:44:24 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:44:25.065808 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603b3b2-fade-4105-b768-1eb6bbe4f6a4 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:25.088040 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603b3b2-fade-4105-b768-1eb6bbe4f6a4 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:25.291302 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac065f-95d6-4ae1-a986-492e34f4358e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:25.294831 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac065f-95d6-4ae1-a986-492e34f4358e admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:25.297723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac065f-95d6-4ae1-a986-492e34f4358e admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:25.298120 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac065f-95d6-4ae1-a986-492e34f4358e admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:25.310393 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac065f-95d6-4ae1-a986-492e34f4358e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:25.312939 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac065f-95d6-4ae1-a986-492e34f4358e admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:25.358276 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1134/2260] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:44:25 2022] POST /identity/v3/users => generated 287 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:44:25.362016 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931660d3-480d-4416-bd4a-acad5b483ae3 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:25.373960 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:25.408048 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931660d3-480d-4416-bd4a-acad5b483ae3 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:25.419666 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff16fbe-906c-434f-acb6-4db6726029e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:25.422015 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff16fbe-906c-434f-acb6-4db6726029e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:25.422543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff16fbe-906c-434f-acb6-4db6726029e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:25.423102 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff16fbe-906c-434f-acb6-4db6726029e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:25.424399 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff16fbe-906c-434f-acb6-4db6726029e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:25.429773 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff16fbe-906c-434f-acb6-4db6726029e4 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:25.454210 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac065f-95d6-4ae1-a986-492e34f4358e admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:25.454993 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1127/2261] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:44:25.470102 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac065f-95d6-4ae1-a986-492e34f4358e admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:25.476908 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b2107-0a2e-46f5-8c3c-34708db48988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:25.478006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b2107-0a2e-46f5-8c3c-34708db48988 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:25.478466 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b2107-0a2e-46f5-8c3c-34708db48988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:25.478975 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b2107-0a2e-46f5-8c3c-34708db48988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:25.479857 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b2107-0a2e-46f5-8c3c-34708db48988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:25.481755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b2107-0a2e-46f5-8c3c-34708db48988 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:25.509491 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1135/2262] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:44:25.514761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff16fbe-906c-434f-acb6-4db6726029e4 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:25.583810 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff16fbe-906c-434f-acb6-4db6726029e4 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:25.622194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbdd17-a5c5-40f6-8a39-bd0ad4dc09d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:25.623111 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbdd17-a5c5-40f6-8a39-bd0ad4dc09d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:25.623400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbdd17-a5c5-40f6-8a39-bd0ad4dc09d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:25.623685 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbdd17-a5c5-40f6-8a39-bd0ad4dc09d1 admin admin] PATH_INFO: `/v3/projects/34661f0f3c6444e69b48e1a6b55c26d2/users/8450ce25e50440ad81c602df61b4bf62/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:25.656196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbdd17-a5c5-40f6-8a39-bd0ad4dc09d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34661f0f3c6444e69b48e1a6b55c26d2, user_id=8450ce25e50440ad81c602df61b4bf62, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:25.659126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbdd17-a5c5-40f6-8a39-bd0ad4dc09d1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:25.696231 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1128/2263] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:44:25 2022] PUT /identity/v3/projects/34661f0f3c6444e69b48e1a6b55c26d2/users/8450ce25e50440ad81c602df61b4bf62/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:44:25.707720 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72f88a-6662-41dc-9f78-46b670b6fd79 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:25.708016 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72f88a-6662-41dc-9f78-46b670b6fd79 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:25.708622 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72f88a-6662-41dc-9f78-46b670b6fd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:25.715699 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:25.804898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-7c72f88a-6662-41dc-9f78-46b670b6fd79 None None] MFA Rules not processed for user `8450ce25e50440ad81c602df61b4bf62`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:25.828312 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7c72f88a-6662-41dc-9f78-46b670b6fd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:25.994588 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1136/2264] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:44:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:26.006332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbdd17-a5c5-40f6-8a39-bd0ad4dc09d1 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:26.008390 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c0bbdd17-a5c5-40f6-8a39-bd0ad4dc09d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:26.181023 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbdd17-a5c5-40f6-8a39-bd0ad4dc09d1 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:26.190396 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c4cec-238b-4361-b670-5dd3b6a0c025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:26.192152 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c4cec-238b-4361-b670-5dd3b6a0c025 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:26.192599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c4cec-238b-4361-b670-5dd3b6a0c025 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:26.193029 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c4cec-238b-4361-b670-5dd3b6a0c025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:26.215359 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c4cec-238b-4361-b670-5dd3b6a0c025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:26.217205 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c4cec-238b-4361-b670-5dd3b6a0c025 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:26.237968 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1129/2265] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:44:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:44:28.171098 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270e906-40d5-4392-aefb-9452f59c2301 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:28.171941 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270e906-40d5-4392-aefb-9452f59c2301 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:28.172434 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270e906-40d5-4392-aefb-9452f59c2301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:28.264323 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-1270e906-40d5-4392-aefb-9452f59c2301 None None] MFA Rules not processed for user `8450ce25e50440ad81c602df61b4bf62`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:28.268749 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-1270e906-40d5-4392-aefb-9452f59c2301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:28.294261 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1137/2266] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:44:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:44:35.115297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59cada-05dc-408c-9746-2aff5dc3e081 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:35.115886 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59cada-05dc-408c-9746-2aff5dc3e081 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:35.115886 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59cada-05dc-408c-9746-2aff5dc3e081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:35.149722 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6d59cada-05dc-408c-9746-2aff5dc3e081 None None] MFA Rules not processed for user `7a5fb1cff46d4e3e8e23f9a788cec9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:35.151231 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6d59cada-05dc-408c-9746-2aff5dc3e081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:35.280783 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1130/2267] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:44:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:35.281525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270e906-40d5-4392-aefb-9452f59c2301 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:35.283499 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-1270e906-40d5-4392-aefb-9452f59c2301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:35.368834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270e906-40d5-4392-aefb-9452f59c2301 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:35.376579 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4c223-ac9a-4f71-b794-af17c6af0c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:35.377334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4c223-ac9a-4f71-b794-af17c6af0c2f admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:35.377580 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4c223-ac9a-4f71-b794-af17c6af0c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:35.377862 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db4c223-ac9a-4f71-b794-af17c6af0c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:35.389223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4c223-ac9a-4f71-b794-af17c6af0c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:35.389223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db4c223-ac9a-4f71-b794-af17c6af0c2f admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:35.436309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1138/2268] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:44:35 2022] POST /identity/v3/projects => generated 371 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:44:35.442830 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59cada-05dc-408c-9746-2aff5dc3e081 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:35.455165 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59cada-05dc-408c-9746-2aff5dc3e081 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:35.518534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89690e-3862-47e9-a7bd-03e0f64cb9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:35.519137 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89690e-3862-47e9-a7bd-03e0f64cb9fd admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:35.519425 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89690e-3862-47e9-a7bd-03e0f64cb9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:35.519709 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89690e-3862-47e9-a7bd-03e0f64cb9fd admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:35.520876 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89690e-3862-47e9-a7bd-03e0f64cb9fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:35.522429 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89690e-3862-47e9-a7bd-03e0f64cb9fd admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:35.530638 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:35.549434 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1131/2269] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:44:35 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:44:35.550918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4c223-ac9a-4f71-b794-af17c6af0c2f admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:35.562743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db4c223-ac9a-4f71-b794-af17c6af0c2f admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:35.567290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0b03c-aecd-4e41-85f1-b50d7d702e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:35.567950 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0b03c-aecd-4e41-85f1-b50d7d702e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:35.568236 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0b03c-aecd-4e41-85f1-b50d7d702e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:35.568625 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0b03c-aecd-4e41-85f1-b50d7d702e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:35.570074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0b03c-aecd-4e41-85f1-b50d7d702e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:35.571809 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0b03c-aecd-4e41-85f1-b50d7d702e54 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:35.585185 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1139/2270] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:44:35.590473 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89690e-3862-47e9-a7bd-03e0f64cb9fd admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:35.600996 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89690e-3862-47e9-a7bd-03e0f64cb9fd admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:35.605697 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7aafc-ee61-48a4-8ec3-5bb38884bc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:35.606567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7aafc-ee61-48a4-8ec3-5bb38884bc99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:35.606848 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7aafc-ee61-48a4-8ec3-5bb38884bc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:35.607127 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7aafc-ee61-48a4-8ec3-5bb38884bc99 admin admin] PATH_INFO: `/v3/projects/b551dd9a7f3d4b26bc3651e197591b72/users/94effda373784e2d90eadd72cad14155/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:35.623449 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7aafc-ee61-48a4-8ec3-5bb38884bc99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b551dd9a7f3d4b26bc3651e197591b72, user_id=94effda373784e2d90eadd72cad14155, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:35.626730 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7aafc-ee61-48a4-8ec3-5bb38884bc99 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:35.641770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1132/2271] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:44:35 2022] PUT /identity/v3/projects/b551dd9a7f3d4b26bc3651e197591b72/users/94effda373784e2d90eadd72cad14155/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:44:35.645665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0b03c-aecd-4e41-85f1-b50d7d702e54 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:35.658280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0b03c-aecd-4e41-85f1-b50d7d702e54 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:35.720047 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7863bf5-973a-4118-8620-c2bb6df62a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:35.720731 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7863bf5-973a-4118-8620-c2bb6df62a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:35.721368 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7863bf5-973a-4118-8620-c2bb6df62a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:35.721678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7863bf5-973a-4118-8620-c2bb6df62a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:35.722604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7863bf5-973a-4118-8620-c2bb6df62a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:35.724266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7863bf5-973a-4118-8620-c2bb6df62a7c admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:35.726066 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:35.737503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1140/2272] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:44:35.742305 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7aafc-ee61-48a4-8ec3-5bb38884bc99 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:35.753053 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7aafc-ee61-48a4-8ec3-5bb38884bc99 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:35.758196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bf88c-9f03-4aed-bbcb-e5508bf6d55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:35.759089 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bf88c-9f03-4aed-bbcb-e5508bf6d55b admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:35.759543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bf88c-9f03-4aed-bbcb-e5508bf6d55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:35.759880 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bf88c-9f03-4aed-bbcb-e5508bf6d55b admin admin] PATH_INFO: `/v3/projects/b551dd9a7f3d4b26bc3651e197591b72/users/94effda373784e2d90eadd72cad14155/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:35.761925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bf88c-9f03-4aed-bbcb-e5508bf6d55b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b551dd9a7f3d4b26bc3651e197591b72, user_id=94effda373784e2d90eadd72cad14155, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:35.764568 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bf88c-9f03-4aed-bbcb-e5508bf6d55b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:35.776831 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1133/2273] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:44:35 2022] PUT /identity/v3/projects/b551dd9a7f3d4b26bc3651e197591b72/users/94effda373784e2d90eadd72cad14155/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:44:42.160195 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29be30-bb4a-4fda-93b7-2aa2ed160d3f None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:42.160719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29be30-bb4a-4fda-93b7-2aa2ed160d3f None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:42.160810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29be30-bb4a-4fda-93b7-2aa2ed160d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:42.192120 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-7c29be30-bb4a-4fda-93b7-2aa2ed160d3f None None] MFA Rules not processed for user `94effda373784e2d90eadd72cad14155`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:42.194283 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7c29be30-bb4a-4fda-93b7-2aa2ed160d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:42.290137 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1141/2274] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:44:42 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:42.304112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bf88c-9f03-4aed-bbcb-e5508bf6d55b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:42.306425 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-930bf88c-9f03-4aed-bbcb-e5508bf6d55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:42.409408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bf88c-9f03-4aed-bbcb-e5508bf6d55b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:42.419062 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d4951a-821f-4d43-ade9-38cba6171367 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:42.420174 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4951a-821f-4d43-ade9-38cba6171367 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:42.420290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4951a-821f-4d43-ade9-38cba6171367 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:42.420597 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d4951a-821f-4d43-ade9-38cba6171367 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:42.509158 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4951a-821f-4d43-ade9-38cba6171367 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:42.511243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d4951a-821f-4d43-ade9-38cba6171367 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:42.522087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1134/2275] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:44:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:44:43.103421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90c5a2-da5b-4a0a-b8b4-ba6676defb2b None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:43.103780 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90c5a2-da5b-4a0a-b8b4-ba6676defb2b None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:43.104209 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90c5a2-da5b-4a0a-b8b4-ba6676defb2b None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:43.105857 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1142/2276] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jun 14 19:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:44:43.115369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9cf10-b271-4ec6-a3ea-858f85d71717 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:43.115780 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9cf10-b271-4ec6-a3ea-858f85d71717 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:43.116401 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9cf10-b271-4ec6-a3ea-858f85d71717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:43.174689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-8de9cf10-b271-4ec6-a3ea-858f85d71717 None None] MFA Rules not processed for user `37c521e20aea4cad9758568a4f082fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:43.178094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8de9cf10-b271-4ec6-a3ea-858f85d71717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:43.192754 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1135/2277] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jun 14 19:44:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:43.206151 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90c5a2-da5b-4a0a-b8b4-ba6676defb2b None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:43.209487 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-4e90c5a2-da5b-4a0a-b8b4-ba6676defb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:43.291719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90c5a2-da5b-4a0a-b8b4-ba6676defb2b None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:43.297251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff8752-24b8-41fb-a579-3aaaea1d067d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa134b748854fb3b4de54b04390eec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:43.298216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff8752-24b8-41fb-a579-3aaaea1d067d service glance] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:43.298743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff8752-24b8-41fb-a579-3aaaea1d067d service glance] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:43.299229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff8752-24b8-41fb-a579-3aaaea1d067d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:43.318261 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff8752-24b8-41fb-a579-3aaaea1d067d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:43.322128 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff8752-24b8-41fb-a579-3aaaea1d067d service glance] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:43.345658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1143/2278] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:44:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:44:43.421977 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b86e1-41c3-4322-9f82-3159acced39a None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:43.422549 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b86e1-41c3-4322-9f82-3159acced39a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:43.422549 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b86e1-41c3-4322-9f82-3159acced39a None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:43.424013 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1136/2279] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jun 14 19:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:44:43.429813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98314a7-5011-40e1-bb9a-5da00176095d None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:43.430105 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98314a7-5011-40e1-bb9a-5da00176095d None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:43.430693 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98314a7-5011-40e1-bb9a-5da00176095d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:43.462557 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-b98314a7-5011-40e1-bb9a-5da00176095d None None] MFA Rules not processed for user `791ed0f433834b4599d6bc825440279d`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:43.466144 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b98314a7-5011-40e1-bb9a-5da00176095d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:43.555744 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1144/2280] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jun 14 19:44:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:43.568839 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b86e1-41c3-4322-9f82-3159acced39a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:43.571196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c69b86e1-41c3-4322-9f82-3159acced39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:43.587045 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b86e1-41c3-4322-9f82-3159acced39a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:43.590715 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddec28d-7c86-4352-b987-438c55549ee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:43.591363 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddec28d-7c86-4352-b987-438c55549ee4 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:43.591650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddec28d-7c86-4352-b987-438c55549ee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:43.591932 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddec28d-7c86-4352-b987-438c55549ee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:43.612479 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddec28d-7c86-4352-b987-438c55549ee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:43.614369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddec28d-7c86-4352-b987-438c55549ee4 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:43.624627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1137/2281] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:44:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:44:43.744551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ebcad-de76-4581-a9e4-72079a2f1ddb None None] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:43.745279 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ebcad-de76-4581-a9e4-72079a2f1ddb None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:43.745644 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ebcad-de76-4581-a9e4-72079a2f1ddb None None] PATH_INFO: `/` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:43.747231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1145/2282] 10.222.0.44 () {54 vars in 921 bytes} [Tue Jun 14 19:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 14 19:44:43.754081 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f54ccc-c744-47bb-8900-6fb72c33db4b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:43.754602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f54ccc-c744-47bb-8900-6fb72c33db4b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:43.755037 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f54ccc-c744-47bb-8900-6fb72c33db4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:43.777316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c7f54ccc-c744-47bb-8900-6fb72c33db4b None None] MFA Rules not processed for user `37c521e20aea4cad9758568a4f082fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:43.778855 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c7f54ccc-c744-47bb-8900-6fb72c33db4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:43.790048 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1138/2283] 10.222.0.44 () {58 vars in 1018 bytes} [Tue Jun 14 19:44:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:44:43.805537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ebcad-de76-4581-a9e4-72079a2f1ddb None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:43.817870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ebcad-de76-4581-a9e4-72079a2f1ddb None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:43.823340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb43ed9-81ca-48b6-a031-9fdddd8c7d0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:43.824223 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb43ed9-81ca-48b6-a031-9fdddd8c7d0f service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:43.825221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb43ed9-81ca-48b6-a031-9fdddd8c7d0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:43.825553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb43ed9-81ca-48b6-a031-9fdddd8c7d0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:43.836489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb43ed9-81ca-48b6-a031-9fdddd8c7d0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:43.837990 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb43ed9-81ca-48b6-a031-9fdddd8c7d0f service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:43.850018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1146/2284] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:44:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:44:44.269259 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4ba63-ff0e-4981-9c70-4b91d1a840e9 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:44.269814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4ba63-ff0e-4981-9c70-4b91d1a840e9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:44.270292 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4ba63-ff0e-4981-9c70-4b91d1a840e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:44.292882 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:44.317764 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-79e4ba63-ff0e-4981-9c70-4b91d1a840e9 None None] MFA Rules not processed for user `7a5fb1cff46d4e3e8e23f9a788cec9ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:44.319601 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-79e4ba63-ff0e-4981-9c70-4b91d1a840e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:44.342293 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1139/2285] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:44:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:48.373418 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189bff8-144f-4311-b8d1-d7a0af964042 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:48.373969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189bff8-144f-4311-b8d1-d7a0af964042 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:48.373969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189bff8-144f-4311-b8d1-d7a0af964042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:48.393824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-4189bff8-144f-4311-b8d1-d7a0af964042 None None] MFA Rules not processed for user `d16be8774cb842199cfb9e3b9965bd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:48.395295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-4189bff8-144f-4311-b8d1-d7a0af964042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:48.410242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:44:48.462565 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1147/2286] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jun 14 19:44:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:48.474358 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4ba63-ff0e-4981-9c70-4b91d1a840e9 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:48.476652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-79e4ba63-ff0e-4981-9c70-4b91d1a840e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:48.550066 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4ba63-ff0e-4981-9c70-4b91d1a840e9 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:48.556374 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe6a91-d558-4de7-b30b-da062d0d322f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fff5414195f4873bcc8752c914b6b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:48.557094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe6a91-d558-4de7-b30b-da062d0d322f service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:48.557433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe6a91-d558-4de7-b30b-da062d0d322f service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:48.557717 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe6a91-d558-4de7-b30b-da062d0d322f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:48.567758 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe6a91-d558-4de7-b30b-da062d0d322f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:48.569365 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe6a91-d558-4de7-b30b-da062d0d322f service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:48.577526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1140/2287] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jun 14 19:44:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 19:44:48.917332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcbec6-aa7c-4dbd-a672-3c659dd87221 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:48.917656 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcbec6-aa7c-4dbd-a672-3c659dd87221 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:48.917938 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcbec6-aa7c-4dbd-a672-3c659dd87221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:48.937663 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-8cbcbec6-aa7c-4dbd-a672-3c659dd87221 None None] MFA Rules not processed for user `d16be8774cb842199cfb9e3b9965bd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:48.938879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-8cbcbec6-aa7c-4dbd-a672-3c659dd87221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:48.946370 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1148/2288] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jun 14 19:44:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:48.967329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe6a91-d558-4de7-b30b-da062d0d322f service swift] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:48.978373 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe6a91-d558-4de7-b30b-da062d0d322f service swift] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:48.983519 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83e7e6-0d76-4a25-a0fd-b528ef0bba61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fff5414195f4873bcc8752c914b6b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:48.984158 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83e7e6-0d76-4a25-a0fd-b528ef0bba61 service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:48.984446 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83e7e6-0d76-4a25-a0fd-b528ef0bba61 service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:48.984727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83e7e6-0d76-4a25-a0fd-b528ef0bba61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:48.993728 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83e7e6-0d76-4a25-a0fd-b528ef0bba61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:48.995309 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83e7e6-0d76-4a25-a0fd-b528ef0bba61 service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:49.003307 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1141/2289] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jun 14 19:44:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 19:44:57.327795 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f16af-7029-4679-a293-d436a8a5626f None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:57.328420 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f16af-7029-4679-a293-d436a8a5626f None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:57.328420 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f16af-7029-4679-a293-d436a8a5626f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:57.347782 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-316f16af-7029-4679-a293-d436a8a5626f None None] MFA Rules not processed for user `d16be8774cb842199cfb9e3b9965bd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:57.348993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-316f16af-7029-4679-a293-d436a8a5626f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:57.357265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1149/2290] 10.222.0.44 () {58 vars in 967 bytes} [Tue Jun 14 19:44:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:57.370463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83e7e6-0d76-4a25-a0fd-b528ef0bba61 service swift] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:57.381492 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83e7e6-0d76-4a25-a0fd-b528ef0bba61 service swift] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:57.387727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3885e-a11d-4f98-8913-993a43cafb67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fff5414195f4873bcc8752c914b6b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:57.388536 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3885e-a11d-4f98-8913-993a43cafb67 service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:57.388818 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3885e-a11d-4f98-8913-993a43cafb67 service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:57.389091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3885e-a11d-4f98-8913-993a43cafb67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:57.398617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3885e-a11d-4f98-8913-993a43cafb67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:57.400219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3885e-a11d-4f98-8913-993a43cafb67 service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:57.410904 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1142/2291] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jun 14 19:44:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 19:44:57.657093 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4a00b-d64a-4444-b380-7bfef7a18bde None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:57.657816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4a00b-d64a-4444-b380-7bfef7a18bde None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:57.658167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4a00b-d64a-4444-b380-7bfef7a18bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:57.677603 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-27e4a00b-d64a-4444-b380-7bfef7a18bde None None] MFA Rules not processed for user `d16be8774cb842199cfb9e3b9965bd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:57.678801 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-27e4a00b-d64a-4444-b380-7bfef7a18bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:57.686114 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1150/2292] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jun 14 19:44:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:44:57.698471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3885e-a11d-4f98-8913-993a43cafb67 service swift] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:57.709170 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3885e-a11d-4f98-8913-993a43cafb67 service swift] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:57.715088 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b2b17-a53e-4db6-9e87-41d2af92b0c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fff5414195f4873bcc8752c914b6b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:57.715818 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b2b17-a53e-4db6-9e87-41d2af92b0c5 service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:57.716187 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b2b17-a53e-4db6-9e87-41d2af92b0c5 service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:57.716533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b2b17-a53e-4db6-9e87-41d2af92b0c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:57.726062 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b2b17-a53e-4db6-9e87-41d2af92b0c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:57.727747 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b2b17-a53e-4db6-9e87-41d2af92b0c5 service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:57.738508 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1143/2293] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jun 14 19:44:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 19:44:58.180618 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dc9e3-7861-4e8a-8ef6-486d3554b47d None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:58.180912 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dc9e3-7861-4e8a-8ef6-486d3554b47d None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:58.181194 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dc9e3-7861-4e8a-8ef6-486d3554b47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:58.199155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-fb2dc9e3-7861-4e8a-8ef6-486d3554b47d None None] MFA Rules not processed for user `d16be8774cb842199cfb9e3b9965bd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:44:58.200341 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-fb2dc9e3-7861-4e8a-8ef6-486d3554b47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:44:58.207421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1151/2294] 10.222.0.44 () {58 vars in 967 bytes} [Tue Jun 14 19:44:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:44:58.227376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b2b17-a53e-4db6-9e87-41d2af92b0c5 service swift] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:44:58.240990 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b2b17-a53e-4db6-9e87-41d2af92b0c5 service swift] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:44:58.248708 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356cd41-55a8-4fb3-a92b-d93f31015065 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fff5414195f4873bcc8752c914b6b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:44:58.249797 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356cd41-55a8-4fb3-a92b-d93f31015065 service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:44:58.250332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356cd41-55a8-4fb3-a92b-d93f31015065 service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:44:58.250841 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356cd41-55a8-4fb3-a92b-d93f31015065 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:44:58.262982 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356cd41-55a8-4fb3-a92b-d93f31015065 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:44:58.264898 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356cd41-55a8-4fb3-a92b-d93f31015065 service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:44:58.273688 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1144/2295] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jun 14 19:44:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 19:45:00.553478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dc9e3-7861-4e8a-8ef6-486d3554b47d None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:45:00.615111 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dc9e3-7861-4e8a-8ef6-486d3554b47d None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:45:00.620184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23950164-1af8-4de7-9303-4ef1e78077b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:45:00.621122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23950164-1af8-4de7-9303-4ef1e78077b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:45:00.621423 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23950164-1af8-4de7-9303-4ef1e78077b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:45:00.621699 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23950164-1af8-4de7-9303-4ef1e78077b2 admin admin] PATH_INFO: `/v3/users/8450ce25e50440ad81c602df61b4bf62` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:45:00.622876 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23950164-1af8-4de7-9303-4ef1e78077b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8450ce25e50440ad81c602df61b4bf62)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:45:00.624781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23950164-1af8-4de7-9303-4ef1e78077b2 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:45:00.671561 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-23950164-1af8-4de7-9303-4ef1e78077b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8450ce25e50440ad81c602df61b4bf62'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:45:00.672207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-23950164-1af8-4de7-9303-4ef1e78077b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8450ce25e50440ad81c602df61b4bf62'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:45:00.679585 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-23950164-1af8-4de7-9303-4ef1e78077b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8450ce25e50440ad81c602df61b4bf62'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:45:00.687268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-23950164-1af8-4de7-9303-4ef1e78077b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8450ce25e50440ad81c602df61b4bf62'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:45:00.699682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-23950164-1af8-4de7-9303-4ef1e78077b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8450ce25e50440ad81c602df61b4bf62'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:45:00.705608 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1152/2296] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:45:00 2022] DELETE /identity/v3/users/8450ce25e50440ad81c602df61b4bf62 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:45:00.710142 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108b20e-7cd9-42fd-9e89-efed962ef757 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:45:00.710652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108b20e-7cd9-42fd-9e89-efed962ef757 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:45:00.710786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108b20e-7cd9-42fd-9e89-efed962ef757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:45:00.730470 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1108b20e-7cd9-42fd-9e89-efed962ef757 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:45:00.731684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1108b20e-7cd9-42fd-9e89-efed962ef757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:45:00.792893 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1145/2297] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:45:00.802838 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23950164-1af8-4de7-9303-4ef1e78077b2 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:45:00.804177 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-23950164-1af8-4de7-9303-4ef1e78077b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:45:00.824732 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:00.876351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23950164-1af8-4de7-9303-4ef1e78077b2 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:45:00.879983 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b75637-d51b-4987-bdca-bb14af24a129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:45:00.880624 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b75637-d51b-4987-bdca-bb14af24a129 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:45:00.880907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b75637-d51b-4987-bdca-bb14af24a129 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:45:00.881185 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b75637-d51b-4987-bdca-bb14af24a129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:45:00.890177 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b75637-d51b-4987-bdca-bb14af24a129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:45:00.891596 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b75637-d51b-4987-bdca-bb14af24a129 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:45:00.901440 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1153/2298] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:45:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:45:01.072469 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108b20e-7cd9-42fd-9e89-efed962ef757 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:45:01.073961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1108b20e-7cd9-42fd-9e89-efed962ef757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:45:01.086753 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108b20e-7cd9-42fd-9e89-efed962ef757 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:45:01.097630 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5eafa3-32bd-4e3d-bf08-fd587ce1360a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:45:01.098600 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5eafa3-32bd-4e3d-bf08-fd587ce1360a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:45:01.098874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5eafa3-32bd-4e3d-bf08-fd587ce1360a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:45:01.099150 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5eafa3-32bd-4e3d-bf08-fd587ce1360a admin admin] PATH_INFO: `/v3/projects/34661f0f3c6444e69b48e1a6b55c26d2` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:45:01.100393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5eafa3-32bd-4e3d-bf08-fd587ce1360a admin admin] RBAC: Authorizing `identity:delete_project(project_id=34661f0f3c6444e69b48e1a6b55c26d2)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:45:01.102391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5eafa3-32bd-4e3d-bf08-fd587ce1360a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:45:01.139810 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:01.152594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8e5eafa3-32bd-4e3d-bf08-fd587ce1360a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34661f0f3c6444e69b48e1a6b55c26d2', 'request_id': 'req-8e5eafa3-32bd-4e3d-bf08-fd587ce1360a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:45:01.158899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8e5eafa3-32bd-4e3d-bf08-fd587ce1360a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34661f0f3c6444e69b48e1a6b55c26d2', 'request_id': 'req-8e5eafa3-32bd-4e3d-bf08-fd587ce1360a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:45:01.167385 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8e5eafa3-32bd-4e3d-bf08-fd587ce1360a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34661f0f3c6444e69b48e1a6b55c26d2', 'request_id': 'req-8e5eafa3-32bd-4e3d-bf08-fd587ce1360a'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:45:01.178360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8e5eafa3-32bd-4e3d-bf08-fd587ce1360a admin admin] The token cache is being invalidate because project 34661f0f3c6444e69b48e1a6b55c26d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:45:01.178647 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8e5eafa3-32bd-4e3d-bf08-fd587ce1360a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:45:01.179270 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8e5eafa3-32bd-4e3d-bf08-fd587ce1360a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:45:01.180807 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1146/2299] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:45:01 2022] DELETE /identity/v3/projects/34661f0f3c6444e69b48e1a6b55c26d2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:45:02.477946 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b75637-d51b-4987-bdca-bb14af24a129 service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:45:02.479758 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-61b75637-d51b-4987-bdca-bb14af24a129 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:45:02.576720 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b75637-d51b-4987-bdca-bb14af24a129 service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:45:02.634881 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80165e15-9920-4db2-8c6d-6d79c015b6ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98915513674460485413c2dbee87fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:45:02.635524 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80165e15-9920-4db2-8c6d-6d79c015b6ee service placement] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:45:02.635846 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80165e15-9920-4db2-8c6d-6d79c015b6ee service placement] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:45:02.636086 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80165e15-9920-4db2-8c6d-6d79c015b6ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:45:02.637948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-80165e15-9920-4db2-8c6d-6d79c015b6ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:45:02.648919 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80165e15-9920-4db2-8c6d-6d79c015b6ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:45:02.650554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80165e15-9920-4db2-8c6d-6d79c015b6ee service placement] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:45:02.661701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1154/2300] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:45:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:45:11.175402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:12.656515 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=88 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:14.893576 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29905b83-e848-4b7d-8e05-3c4a897f1b30 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:45:14.894027 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29905b83-e848-4b7d-8e05-3c4a897f1b30 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:45:14.894133 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29905b83-e848-4b7d-8e05-3c4a897f1b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:45:14.942417 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-29905b83-e848-4b7d-8e05-3c4a897f1b30 None None] MFA Rules not processed for user `d16be8774cb842199cfb9e3b9965bd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:45:14.943630 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-29905b83-e848-4b7d-8e05-3c4a897f1b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:45:15.006469 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1147/2301] 10.222.0.44 () {58 vars in 967 bytes} [Tue Jun 14 19:45:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:45:15.018688 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80165e15-9920-4db2-8c6d-6d79c015b6ee service placement] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:45:15.020100 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-80165e15-9920-4db2-8c6d-6d79c015b6ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:45:15.108334 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80165e15-9920-4db2-8c6d-6d79c015b6ee service placement] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:45:15.113327 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9de9e1-6113-4976-892d-cd1de3042922 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fff5414195f4873bcc8752c914b6b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:45:15.113990 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9de9e1-6113-4976-892d-cd1de3042922 service swift] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:45:15.114276 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9de9e1-6113-4976-892d-cd1de3042922 service swift] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:45:15.114552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9de9e1-6113-4976-892d-cd1de3042922 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:45:15.123198 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9de9e1-6113-4976-892d-cd1de3042922 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:45:15.124790 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9de9e1-6113-4976-892d-cd1de3042922 service swift] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:45:15.132677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1155/2302] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jun 14 19:45:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 19:45:21.490866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29905b83-e848-4b7d-8e05-3c4a897f1b30 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:45:21.492390 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-29905b83-e848-4b7d-8e05-3c4a897f1b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:45:21.548488 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29905b83-e848-4b7d-8e05-3c4a897f1b30 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:45:21.551951 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a2128-bff9-4d89-97e6-2cb08829a083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:45:21.552589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a2128-bff9-4d89-97e6-2cb08829a083 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:45:21.552871 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a2128-bff9-4d89-97e6-2cb08829a083 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:45:21.553142 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a2128-bff9-4d89-97e6-2cb08829a083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:45:21.554927 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-528a2128-bff9-4d89-97e6-2cb08829a083 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:45:21.619984 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a2128-bff9-4d89-97e6-2cb08829a083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:45:21.621446 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a2128-bff9-4d89-97e6-2cb08829a083 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:45:21.631358 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1148/2303] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:45:21 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:45:25.129622 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=41 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:31.627271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=90 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:45:32.728781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712027a5-b365-4e21-99ed-32ebb69df8b2 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:45:32.729677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712027a5-b365-4e21-99ed-32ebb69df8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:45:32.730127 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712027a5-b365-4e21-99ed-32ebb69df8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:45:32.751397 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-712027a5-b365-4e21-99ed-32ebb69df8b2 None None] MFA Rules not processed for user `323c51f037db4ecca2f66cb6e9879246`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:45:32.752934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-712027a5-b365-4e21-99ed-32ebb69df8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:45:32.814412 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1156/2304] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:45:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:45:42.807077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=25 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:46:05.524402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a793f-4f22-4807-8711-4999ea79c0e8 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:46:05.524918 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a793f-4f22-4807-8711-4999ea79c0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:46:05.525021 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a793f-4f22-4807-8711-4999ea79c0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:46:05.542946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-407a793f-4f22-4807-8711-4999ea79c0e8 None None] MFA Rules not processed for user `f60ed90fb1a54339ac563bc649e98989`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:46:05.544140 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-407a793f-4f22-4807-8711-4999ea79c0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:46:05.599380 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1149/2305] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:46:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:46:11.355459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7c1f2-b843-4b43-adec-433218dbf780 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:46:11.355979 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7c1f2-b843-4b43-adec-433218dbf780 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:46:11.356085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7c1f2-b843-4b43-adec-433218dbf780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:46:11.373232 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-b1b7c1f2-b843-4b43-adec-433218dbf780 None None] MFA Rules not processed for user `9b28c3b97f9f44148dd02f41509887e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:46:11.374450 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b1b7c1f2-b843-4b43-adec-433218dbf780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:46:11.429228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1157/2306] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:46:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:46:15.592694 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=25 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:46:21.422724 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=25 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:46:46.831628 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74d84d-c1a0-4121-b199-0d3cd64bf24a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:46:46.832165 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74d84d-c1a0-4121-b199-0d3cd64bf24a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:46:46.832165 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f74d84d-c1a0-4121-b199-0d3cd64bf24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:46:46.850205 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-8f74d84d-c1a0-4121-b199-0d3cd64bf24a None None] MFA Rules not processed for user `323c51f037db4ecca2f66cb6e9879246`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:46:46.851391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8f74d84d-c1a0-4121-b199-0d3cd64bf24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:46:46.859007 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1150/2307] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:46:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:46:47.045833 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccba0e-c824-41b6-b365-e8b84a231dc5 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:46:47.046455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccba0e-c824-41b6-b365-e8b84a231dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:46:47.046455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccba0e-c824-41b6-b365-e8b84a231dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:46:47.065670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-57ccba0e-c824-41b6-b365-e8b84a231dc5 None None] MFA Rules not processed for user `18261f10678a4ce99626794c39bb5d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:46:47.066888 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-57ccba0e-c824-41b6-b365-e8b84a231dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:46:47.124418 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1158/2308] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:46:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:46:50.129582 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74d84d-c1a0-4121-b199-0d3cd64bf24a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:46:50.131001 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8f74d84d-c1a0-4121-b199-0d3cd64bf24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:46:50.147402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f74d84d-c1a0-4121-b199-0d3cd64bf24a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:46:50.152624 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f3ba5-3647-4558-8301-8548ffbfcba7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:46:50.153210 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f3ba5-3647-4558-8301-8548ffbfcba7 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:46:50.153768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f3ba5-3647-4558-8301-8548ffbfcba7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:46:50.154214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f3ba5-3647-4558-8301-8548ffbfcba7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:46:50.157978 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-486f3ba5-3647-4558-8301-8548ffbfcba7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:46:50.295785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f3ba5-3647-4558-8301-8548ffbfcba7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:46:50.297088 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f3ba5-3647-4558-8301-8548ffbfcba7 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:46:50.338086 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1151/2309] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:46:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:46:51.544561 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccba0e-c824-41b6-b365-e8b84a231dc5 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:46:51.554911 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccba0e-c824-41b6-b365-e8b84a231dc5 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:46:51.558511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2342d7-4e4a-445f-8052-2d10acfc92ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:46:51.559175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2342d7-4e4a-445f-8052-2d10acfc92ca service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:46:51.559463 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2342d7-4e4a-445f-8052-2d10acfc92ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:46:51.559744 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2342d7-4e4a-445f-8052-2d10acfc92ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:46:51.561585 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-af2342d7-4e4a-445f-8052-2d10acfc92ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:46:51.575700 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2342d7-4e4a-445f-8052-2d10acfc92ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:46:51.577111 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2342d7-4e4a-445f-8052-2d10acfc92ca service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:46:51.588193 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1159/2310] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:46:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:46:59.225878 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f3ba5-3647-4558-8301-8548ffbfcba7 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:46:59.227300 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-486f3ba5-3647-4558-8301-8548ffbfcba7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:46:59.240870 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f3ba5-3647-4558-8301-8548ffbfcba7 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:46:59.246477 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa1c92-e4f7-4c80-b37e-fd942a8108d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:46:59.247238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa1c92-e4f7-4c80-b37e-fd942a8108d8 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:46:59.247685 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa1c92-e4f7-4c80-b37e-fd942a8108d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:46:59.248135 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa1c92-e4f7-4c80-b37e-fd942a8108d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:46:59.250006 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-56aa1c92-e4f7-4c80-b37e-fd942a8108d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:46:59.262180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa1c92-e4f7-4c80-b37e-fd942a8108d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:46:59.263889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa1c92-e4f7-4c80-b37e-fd942a8108d8 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:46:59.275742 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1152/2311] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:46:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:47:01.583869 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=31 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:09.269194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=52 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:13.612333 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2342d7-4e4a-445f-8052-2d10acfc92ca service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:13.614159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-af2342d7-4e4a-445f-8052-2d10acfc92ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:13.632000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2342d7-4e4a-445f-8052-2d10acfc92ca service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:13.639816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2689b-b5ff-4ee4-aefb-14dec1a178b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:13.640457 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2689b-b5ff-4ee4-aefb-14dec1a178b1 service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:13.640738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2689b-b5ff-4ee4-aefb-14dec1a178b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:13.641010 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2689b-b5ff-4ee4-aefb-14dec1a178b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:13.642786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-5de2689b-b5ff-4ee4-aefb-14dec1a178b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:13.657591 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2689b-b5ff-4ee4-aefb-14dec1a178b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:13.659173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2689b-b5ff-4ee4-aefb-14dec1a178b1 service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:13.670385 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1160/2312] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:47:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:47:14.501281 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa1c92-e4f7-4c80-b37e-fd942a8108d8 service nova] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:14.511199 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa1c92-e4f7-4c80-b37e-fd942a8108d8 service nova] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:14.514717 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81908f-16d5-4241-b2b6-9501564a8633 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:14.515339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81908f-16d5-4241-b2b6-9501564a8633 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:14.515617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81908f-16d5-4241-b2b6-9501564a8633 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:14.515890 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e81908f-16d5-4241-b2b6-9501564a8633 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:14.517639 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4e81908f-16d5-4241-b2b6-9501564a8633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:14.581704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81908f-16d5-4241-b2b6-9501564a8633 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:14.583176 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e81908f-16d5-4241-b2b6-9501564a8633 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:14.592843 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1153/2313] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:47:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:47:17.870860 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2689b-b5ff-4ee4-aefb-14dec1a178b1 service nova] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:17.872392 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-5de2689b-b5ff-4ee4-aefb-14dec1a178b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:17.886845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2689b-b5ff-4ee4-aefb-14dec1a178b1 service nova] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:17.892290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f918d-603c-4dc2-be38-107fc1674391 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98915513674460485413c2dbee87fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:17.892941 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f918d-603c-4dc2-be38-107fc1674391 service placement] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:17.893228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f918d-603c-4dc2-be38-107fc1674391 service placement] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:17.893548 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f918d-603c-4dc2-be38-107fc1674391 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:17.895578 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-872f918d-603c-4dc2-be38-107fc1674391 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:17.910415 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f918d-603c-4dc2-be38-107fc1674391 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:17.912046 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f918d-603c-4dc2-be38-107fc1674391 service placement] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:17.924339 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1161/2314] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:47:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:47:17.929673 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81908f-16d5-4241-b2b6-9501564a8633 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:17.931083 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4e81908f-16d5-4241-b2b6-9501564a8633 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:17.944690 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e81908f-16d5-4241-b2b6-9501564a8633 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:17.949887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1083ec-275e-450c-ab24-652a11e60c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:17.951046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1083ec-275e-450c-ab24-652a11e60c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:17.951331 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1083ec-275e-450c-ab24-652a11e60c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:17.951609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1083ec-275e-450c-ab24-652a11e60c6e admin admin] PATH_INFO: `/v3/users/9b28c3b97f9f44148dd02f41509887e8` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:17.952846 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1083ec-275e-450c-ab24-652a11e60c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b28c3b97f9f44148dd02f41509887e8)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:17.955002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1083ec-275e-450c-ab24-652a11e60c6e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:18.021295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2c1083ec-275e-450c-ab24-652a11e60c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b28c3b97f9f44148dd02f41509887e8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:18.022727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2c1083ec-275e-450c-ab24-652a11e60c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b28c3b97f9f44148dd02f41509887e8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:18.031568 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2c1083ec-275e-450c-ab24-652a11e60c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b28c3b97f9f44148dd02f41509887e8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:18.043161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2c1083ec-275e-450c-ab24-652a11e60c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b28c3b97f9f44148dd02f41509887e8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:18.055590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2c1083ec-275e-450c-ab24-652a11e60c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b28c3b97f9f44148dd02f41509887e8'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:18.061713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1154/2315] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:47:17 2022] DELETE /identity/v3/users/9b28c3b97f9f44148dd02f41509887e8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:47:18.240010 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f918d-603c-4dc2-be38-107fc1674391 service placement] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:18.257452 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f918d-603c-4dc2-be38-107fc1674391 service placement] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:18.314535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92288e1-ba29-461f-aac3-3c44dc6bea37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:18.315338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92288e1-ba29-461f-aac3-3c44dc6bea37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:18.315621 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92288e1-ba29-461f-aac3-3c44dc6bea37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:18.315896 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92288e1-ba29-461f-aac3-3c44dc6bea37 admin admin] PATH_INFO: `/v3/projects/05db8610cfa7449daeec7419d4f7ad6c` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:18.317067 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92288e1-ba29-461f-aac3-3c44dc6bea37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05db8610cfa7449daeec7419d4f7ad6c)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:18.319033 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92288e1-ba29-461f-aac3-3c44dc6bea37 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:18.364442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-e92288e1-ba29-461f-aac3-3c44dc6bea37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05db8610cfa7449daeec7419d4f7ad6c', 'request_id': 'req-e92288e1-ba29-461f-aac3-3c44dc6bea37'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:18.370450 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-e92288e1-ba29-461f-aac3-3c44dc6bea37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05db8610cfa7449daeec7419d4f7ad6c', 'request_id': 'req-e92288e1-ba29-461f-aac3-3c44dc6bea37'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:18.377636 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-e92288e1-ba29-461f-aac3-3c44dc6bea37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05db8610cfa7449daeec7419d4f7ad6c', 'request_id': 'req-e92288e1-ba29-461f-aac3-3c44dc6bea37'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:18.388611 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-e92288e1-ba29-461f-aac3-3c44dc6bea37 admin admin] The token cache is being invalidate because project 05db8610cfa7449daeec7419d4f7ad6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:47:18.388902 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-e92288e1-ba29-461f-aac3-3c44dc6bea37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:18.389546 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-e92288e1-ba29-461f-aac3-3c44dc6bea37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:18.391063 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1162/2316] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:47:18 2022] DELETE /identity/v3/projects/05db8610cfa7449daeec7419d4f7ad6c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:47:18.395842 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e486c3-09a0-4a1b-bb81-38d455a23def None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:18.396163 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e486c3-09a0-4a1b-bb81-38d455a23def None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:18.397037 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e486c3-09a0-4a1b-bb81-38d455a23def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:18.417884 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-73e486c3-09a0-4a1b-bb81-38d455a23def None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:18.419125 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-73e486c3-09a0-4a1b-bb81-38d455a23def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:18.478642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1155/2317] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:18.486412 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f936a44-c8ec-44ca-beaf-cac31ba22f32 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:18.486701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f936a44-c8ec-44ca-beaf-cac31ba22f32 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:18.486977 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f936a44-c8ec-44ca-beaf-cac31ba22f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:18.504922 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-4f936a44-c8ec-44ca-beaf-cac31ba22f32 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:18.506186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-4f936a44-c8ec-44ca-beaf-cac31ba22f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:18.514010 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1163/2318] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:18.518236 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e486c3-09a0-4a1b-bb81-38d455a23def None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:18.529111 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e486c3-09a0-4a1b-bb81-38d455a23def None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:18.533829 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e404b-e2d7-46a7-8daf-b3f51376b1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:18.534480 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e404b-e2d7-46a7-8daf-b3f51376b1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:18.534768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e404b-e2d7-46a7-8daf-b3f51376b1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:18.535043 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e404b-e2d7-46a7-8daf-b3f51376b1f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:18.535772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e404b-e2d7-46a7-8daf-b3f51376b1f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:47:18.536106 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e404b-e2d7-46a7-8daf-b3f51376b1f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:18.538409 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e404b-e2d7-46a7-8daf-b3f51376b1f0 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:18.539895 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:18.551825 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1156/2319] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:47:18.556320 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f936a44-c8ec-44ca-beaf-cac31ba22f32 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:18.565651 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f936a44-c8ec-44ca-beaf-cac31ba22f32 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:18.570531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325ced8-79ae-4198-9744-85477231781a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:18.571176 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325ced8-79ae-4198-9744-85477231781a admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:18.571457 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325ced8-79ae-4198-9744-85477231781a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:18.571733 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325ced8-79ae-4198-9744-85477231781a admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:18.572424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325ced8-79ae-4198-9744-85477231781a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:18.574351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c325ced8-79ae-4198-9744-85477231781a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:18.600723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1164/2320] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:47:18 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:47:18.604938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e404b-e2d7-46a7-8daf-b3f51376b1f0 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:18.614852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e404b-e2d7-46a7-8daf-b3f51376b1f0 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:18.671974 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3ec8b-107f-447a-9834-a19ba4ef8930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:18.672700 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3ec8b-107f-447a-9834-a19ba4ef8930 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:18.672986 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3ec8b-107f-447a-9834-a19ba4ef8930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:18.673267 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e3ec8b-107f-447a-9834-a19ba4ef8930 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:18.673990 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3ec8b-107f-447a-9834-a19ba4ef8930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:18.675935 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e3ec8b-107f-447a-9834-a19ba4ef8930 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:18.696864 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1157/2321] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:47:18 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:47:18.701280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325ced8-79ae-4198-9744-85477231781a admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:18.711986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325ced8-79ae-4198-9744-85477231781a admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:18.716847 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581e209-12e4-4924-8e33-df41f5edad35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:18.717525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581e209-12e4-4924-8e33-df41f5edad35 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:18.717809 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581e209-12e4-4924-8e33-df41f5edad35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:18.718083 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581e209-12e4-4924-8e33-df41f5edad35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:18.718800 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581e209-12e4-4924-8e33-df41f5edad35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:18.720379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0581e209-12e4-4924-8e33-df41f5edad35 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:18.731860 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1165/2322] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:47:18.735691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3ec8b-107f-447a-9834-a19ba4ef8930 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:18.746071 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e3ec8b-107f-447a-9834-a19ba4ef8930 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:18.750664 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d942c18-27fc-4959-95e8-37507c480b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:18.751312 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d942c18-27fc-4959-95e8-37507c480b7d admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:18.751594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d942c18-27fc-4959-95e8-37507c480b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:18.751874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d942c18-27fc-4959-95e8-37507c480b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:18.752596 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d942c18-27fc-4959-95e8-37507c480b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:18.754222 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d942c18-27fc-4959-95e8-37507c480b7d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:18.763970 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1158/2323] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:47:18.768127 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581e209-12e4-4924-8e33-df41f5edad35 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:18.778657 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581e209-12e4-4924-8e33-df41f5edad35 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:18.783225 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83083435-91b8-40c5-a267-cff69aef1d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:18.784088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83083435-91b8-40c5-a267-cff69aef1d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:18.784366 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83083435-91b8-40c5-a267-cff69aef1d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:18.784640 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83083435-91b8-40c5-a267-cff69aef1d9f admin admin] PATH_INFO: `/v3/projects/1d2ca2450d3b4f7d9fc8f649db071b67/users/c7fb8dc2fafc464a8e78e156ccad10c2/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:18.799740 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83083435-91b8-40c5-a267-cff69aef1d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d2ca2450d3b4f7d9fc8f649db071b67, user_id=c7fb8dc2fafc464a8e78e156ccad10c2, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:18.802396 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83083435-91b8-40c5-a267-cff69aef1d9f admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:18.811253 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:18.817643 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1166/2324] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:47:18 2022] PUT /identity/v3/projects/1d2ca2450d3b4f7d9fc8f649db071b67/users/c7fb8dc2fafc464a8e78e156ccad10c2/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:47:18.828738 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d462b-7604-4529-a2bf-fb4899c37af4 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:18.829035 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d462b-7604-4529-a2bf-fb4899c37af4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:18.829319 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d462b-7604-4529-a2bf-fb4899c37af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:18.856376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-eb3d462b-7604-4529-a2bf-fb4899c37af4 None None] MFA Rules not processed for user `c7fb8dc2fafc464a8e78e156ccad10c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:18.857653 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-eb3d462b-7604-4529-a2bf-fb4899c37af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:18.922487 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1159/2325] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:18.927102 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83083435-91b8-40c5-a267-cff69aef1d9f admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:18.988776 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83083435-91b8-40c5-a267-cff69aef1d9f admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:18.993707 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199272f-06c2-460f-bea5-2fcb2526849d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:18.994362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199272f-06c2-460f-bea5-2fcb2526849d admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:18.994649 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199272f-06c2-460f-bea5-2fcb2526849d admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:18.994930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199272f-06c2-460f-bea5-2fcb2526849d admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:18.995629 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199272f-06c2-460f-bea5-2fcb2526849d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:18.997562 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199272f-06c2-460f-bea5-2fcb2526849d admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:19.025407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1167/2326] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:47:18 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:47:19.030409 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d462b-7604-4529-a2bf-fb4899c37af4 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:19.045224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d462b-7604-4529-a2bf-fb4899c37af4 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:19.103915 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c261f-f6f3-46c3-86b8-969f8e6066f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:19.104505 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c261f-f6f3-46c3-86b8-969f8e6066f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:19.104800 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c261f-f6f3-46c3-86b8-969f8e6066f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:19.105082 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c261f-f6f3-46c3-86b8-969f8e6066f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:19.105812 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c261f-f6f3-46c3-86b8-969f8e6066f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:19.107890 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c261f-f6f3-46c3-86b8-969f8e6066f5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:19.116183 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:19.131726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1160/2327] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:47:19 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:47:19.135492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199272f-06c2-460f-bea5-2fcb2526849d admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:19.146578 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199272f-06c2-460f-bea5-2fcb2526849d admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:19.151764 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb044e9-3fc0-465c-bc63-bf8269a9b2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:19.152682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb044e9-3fc0-465c-bc63-bf8269a9b2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:19.152799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb044e9-3fc0-465c-bc63-bf8269a9b2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:19.153017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb044e9-3fc0-465c-bc63-bf8269a9b2a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:19.153796 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb044e9-3fc0-465c-bc63-bf8269a9b2a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:19.155406 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb044e9-3fc0-465c-bc63-bf8269a9b2a7 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:19.167557 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1168/2328] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:47:19.174461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c261f-f6f3-46c3-86b8-969f8e6066f5 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:19.186061 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c261f-f6f3-46c3-86b8-969f8e6066f5 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:19.191032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57e297-8bc2-4641-b0f3-3f6831576da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:19.191901 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57e297-8bc2-4641-b0f3-3f6831576da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:19.192185 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57e297-8bc2-4641-b0f3-3f6831576da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:19.192774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d57e297-8bc2-4641-b0f3-3f6831576da9 admin admin] PATH_INFO: `/v3/projects/017480a5587b482ab082ea820f84fa4a/users/61dea3d1927449ccbafa39c2f8c526d6/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:19.207386 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57e297-8bc2-4641-b0f3-3f6831576da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=017480a5587b482ab082ea820f84fa4a, user_id=61dea3d1927449ccbafa39c2f8c526d6, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:19.211049 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d57e297-8bc2-4641-b0f3-3f6831576da9 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:19.223622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1161/2329] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:47:19 2022] PUT /identity/v3/projects/017480a5587b482ab082ea820f84fa4a/users/61dea3d1927449ccbafa39c2f8c526d6/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:47:19.228298 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb044e9-3fc0-465c-bc63-bf8269a9b2a7 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:19.238210 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb044e9-3fc0-465c-bc63-bf8269a9b2a7 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:19.294953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7c4c2-fc71-4ddc-b3ea-0cdc7ce7457c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:19.295610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7c4c2-fc71-4ddc-b3ea-0cdc7ce7457c admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:19.295896 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7c4c2-fc71-4ddc-b3ea-0cdc7ce7457c admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:19.296170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7c4c2-fc71-4ddc-b3ea-0cdc7ce7457c admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:19.296883 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7c4c2-fc71-4ddc-b3ea-0cdc7ce7457c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:19.298495 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7c4c2-fc71-4ddc-b3ea-0cdc7ce7457c admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:19.308169 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1169/2330] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:47:19.312309 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57e297-8bc2-4641-b0f3-3f6831576da9 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:19.322644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d57e297-8bc2-4641-b0f3-3f6831576da9 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:19.327237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a247ef2-0557-4342-8b60-21eca77bffe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:19.328124 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a247ef2-0557-4342-8b60-21eca77bffe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:19.328412 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a247ef2-0557-4342-8b60-21eca77bffe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:19.328692 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a247ef2-0557-4342-8b60-21eca77bffe1 admin admin] PATH_INFO: `/v3/projects/017480a5587b482ab082ea820f84fa4a/users/61dea3d1927449ccbafa39c2f8c526d6/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:19.330702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a247ef2-0557-4342-8b60-21eca77bffe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=017480a5587b482ab082ea820f84fa4a, user_id=61dea3d1927449ccbafa39c2f8c526d6, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:19.333448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a247ef2-0557-4342-8b60-21eca77bffe1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:19.344643 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1162/2331] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:47:19 2022] PUT /identity/v3/projects/017480a5587b482ab082ea820f84fa4a/users/61dea3d1927449ccbafa39c2f8c526d6/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:47:19.356767 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f2816-a966-4c0d-ab6d-cd4438d3bc11 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:19.356996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f2816-a966-4c0d-ab6d-cd4438d3bc11 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:19.357277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f2816-a966-4c0d-ab6d-cd4438d3bc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:19.382780 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-fb3f2816-a966-4c0d-ab6d-cd4438d3bc11 None None] MFA Rules not processed for user `61dea3d1927449ccbafa39c2f8c526d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:19.383976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-fb3f2816-a966-4c0d-ab6d-cd4438d3bc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:19.444795 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:19.455400 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1170/2332] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:19.467443 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a247ef2-0557-4342-8b60-21eca77bffe1 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:19.469144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4a247ef2-0557-4342-8b60-21eca77bffe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:19.547248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a247ef2-0557-4342-8b60-21eca77bffe1 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:19.551010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176249c-523d-4a3f-aa3e-95333e463342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:19.551658 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176249c-523d-4a3f-aa3e-95333e463342 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:19.551947 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176249c-523d-4a3f-aa3e-95333e463342 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:19.552228 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176249c-523d-4a3f-aa3e-95333e463342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:19.561742 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176249c-523d-4a3f-aa3e-95333e463342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:19.563223 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176249c-523d-4a3f-aa3e-95333e463342 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:19.573224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1163/2333] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:47:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:47:19.600599 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f2816-a966-4c0d-ab6d-cd4438d3bc11 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:19.663067 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f2816-a966-4c0d-ab6d-cd4438d3bc11 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:19.667627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ea8aa-c11e-4d18-ac79-01602aebac6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:19.668497 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ea8aa-c11e-4d18-ac79-01602aebac6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:19.668795 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ea8aa-c11e-4d18-ac79-01602aebac6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:19.669071 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ea8aa-c11e-4d18-ac79-01602aebac6a admin admin] PATH_INFO: `/v3/users/c7fb8dc2fafc464a8e78e156ccad10c2` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:19.670387 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ea8aa-c11e-4d18-ac79-01602aebac6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7fb8dc2fafc464a8e78e156ccad10c2)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:19.672538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647ea8aa-c11e-4d18-ac79-01602aebac6a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:19.718764 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-647ea8aa-c11e-4d18-ac79-01602aebac6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7fb8dc2fafc464a8e78e156ccad10c2'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:19.719403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-647ea8aa-c11e-4d18-ac79-01602aebac6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7fb8dc2fafc464a8e78e156ccad10c2'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:19.726965 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-647ea8aa-c11e-4d18-ac79-01602aebac6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7fb8dc2fafc464a8e78e156ccad10c2'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:19.734112 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-647ea8aa-c11e-4d18-ac79-01602aebac6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7fb8dc2fafc464a8e78e156ccad10c2'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:19.746363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-647ea8aa-c11e-4d18-ac79-01602aebac6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7fb8dc2fafc464a8e78e156ccad10c2'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:19.752165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1171/2334] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:47:19 2022] DELETE /identity/v3/users/c7fb8dc2fafc464a8e78e156ccad10c2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:47:19.757248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf608f-547d-4f93-8565-2f8bd17467ac None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:19.757662 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf608f-547d-4f93-8565-2f8bd17467ac None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:19.758014 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf608f-547d-4f93-8565-2f8bd17467ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:19.776106 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-fbcf608f-547d-4f93-8565-2f8bd17467ac None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:19.777305 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-fbcf608f-547d-4f93-8565-2f8bd17467ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:19.837534 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1164/2335] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:19.847198 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ea8aa-c11e-4d18-ac79-01602aebac6a admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:19.848583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-647ea8aa-c11e-4d18-ac79-01602aebac6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:19.906516 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ea8aa-c11e-4d18-ac79-01602aebac6a admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:19.910202 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc8c00-b2bc-4da0-a12b-d411679cb9e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:19.910841 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc8c00-b2bc-4da0-a12b-d411679cb9e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:19.911125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc8c00-b2bc-4da0-a12b-d411679cb9e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:19.911401 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc8c00-b2bc-4da0-a12b-d411679cb9e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:19.920489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc8c00-b2bc-4da0-a12b-d411679cb9e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:19.921881 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc8c00-b2bc-4da0-a12b-d411679cb9e9 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:19.931759 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1172/2336] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:47:20.197736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf608f-547d-4f93-8565-2f8bd17467ac None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:20.199253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-fbcf608f-547d-4f93-8565-2f8bd17467ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:20.214291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf608f-547d-4f93-8565-2f8bd17467ac None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:20.219144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1c66e-4f4b-4c80-ae63-f432d5dcd4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:20.220009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1c66e-4f4b-4c80-ae63-f432d5dcd4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:20.220295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1c66e-4f4b-4c80-ae63-f432d5dcd4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:20.220574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1c66e-4f4b-4c80-ae63-f432d5dcd4ca admin admin] PATH_INFO: `/v3/projects/1d2ca2450d3b4f7d9fc8f649db071b67` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:20.222464 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1c66e-4f4b-4c80-ae63-f432d5dcd4ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d2ca2450d3b4f7d9fc8f649db071b67)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:20.225988 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1c66e-4f4b-4c80-ae63-f432d5dcd4ca admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:20.262727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:INSERT=4,keystone:SELECT=94,keystone:DELETE=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:20.276275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b4a1c66e-4f4b-4c80-ae63-f432d5dcd4ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d2ca2450d3b4f7d9fc8f649db071b67', 'request_id': 'req-b4a1c66e-4f4b-4c80-ae63-f432d5dcd4ca'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:20.281903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b4a1c66e-4f4b-4c80-ae63-f432d5dcd4ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d2ca2450d3b4f7d9fc8f649db071b67', 'request_id': 'req-b4a1c66e-4f4b-4c80-ae63-f432d5dcd4ca'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:20.290263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b4a1c66e-4f4b-4c80-ae63-f432d5dcd4ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d2ca2450d3b4f7d9fc8f649db071b67', 'request_id': 'req-b4a1c66e-4f4b-4c80-ae63-f432d5dcd4ca'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:20.301684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b4a1c66e-4f4b-4c80-ae63-f432d5dcd4ca admin admin] The token cache is being invalidate because project 1d2ca2450d3b4f7d9fc8f649db071b67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:47:20.301972 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b4a1c66e-4f4b-4c80-ae63-f432d5dcd4ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:20.302680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-b4a1c66e-4f4b-4c80-ae63-f432d5dcd4ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:20.304785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1165/2337] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:47:20 2022] DELETE /identity/v3/projects/1d2ca2450d3b4f7d9fc8f649db071b67 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:47:20.308866 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc8c00-b2bc-4da0-a12b-d411679cb9e9 service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:20.319762 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc8c00-b2bc-4da0-a12b-d411679cb9e9 service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:20.332649 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:20.381348 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301af4ed-2f5d-4b4f-a571-d1ac8769df82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:20.382258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301af4ed-2f5d-4b4f-a571-d1ac8769df82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:20.382543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301af4ed-2f5d-4b4f-a571-d1ac8769df82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:20.382822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301af4ed-2f5d-4b4f-a571-d1ac8769df82 admin admin] PATH_INFO: `/v3/users/61dea3d1927449ccbafa39c2f8c526d6` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:20.384028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301af4ed-2f5d-4b4f-a571-d1ac8769df82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61dea3d1927449ccbafa39c2f8c526d6)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:20.385984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301af4ed-2f5d-4b4f-a571-d1ac8769df82 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:20.433369 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-301af4ed-2f5d-4b4f-a571-d1ac8769df82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61dea3d1927449ccbafa39c2f8c526d6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:20.434042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-301af4ed-2f5d-4b4f-a571-d1ac8769df82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61dea3d1927449ccbafa39c2f8c526d6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:20.441047 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-301af4ed-2f5d-4b4f-a571-d1ac8769df82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61dea3d1927449ccbafa39c2f8c526d6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:20.448086 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-301af4ed-2f5d-4b4f-a571-d1ac8769df82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61dea3d1927449ccbafa39c2f8c526d6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:20.460002 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-301af4ed-2f5d-4b4f-a571-d1ac8769df82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61dea3d1927449ccbafa39c2f8c526d6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:20.465852 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1173/2338] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:47:20 2022] DELETE /identity/v3/users/61dea3d1927449ccbafa39c2f8c526d6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:47:20.738398 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1c66e-4f4b-4c80-ae63-f432d5dcd4ca admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:20.739786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b4a1c66e-4f4b-4c80-ae63-f432d5dcd4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:20.753695 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1c66e-4f4b-4c80-ae63-f432d5dcd4ca admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:20.810648 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da923b6-6b95-4537-948e-de9904091df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:20.811507 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da923b6-6b95-4537-948e-de9904091df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:20.811792 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da923b6-6b95-4537-948e-de9904091df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:20.812070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da923b6-6b95-4537-948e-de9904091df2 admin admin] PATH_INFO: `/v3/projects/017480a5587b482ab082ea820f84fa4a` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:20.813255 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da923b6-6b95-4537-948e-de9904091df2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=017480a5587b482ab082ea820f84fa4a)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:20.815258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da923b6-6b95-4537-948e-de9904091df2 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:20.863103 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8da923b6-6b95-4537-948e-de9904091df2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017480a5587b482ab082ea820f84fa4a', 'request_id': 'req-8da923b6-6b95-4537-948e-de9904091df2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:20.869591 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8da923b6-6b95-4537-948e-de9904091df2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017480a5587b482ab082ea820f84fa4a', 'request_id': 'req-8da923b6-6b95-4537-948e-de9904091df2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:20.876640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8da923b6-6b95-4537-948e-de9904091df2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017480a5587b482ab082ea820f84fa4a', 'request_id': 'req-8da923b6-6b95-4537-948e-de9904091df2'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:20.887524 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8da923b6-6b95-4537-948e-de9904091df2 admin admin] The token cache is being invalidate because project 017480a5587b482ab082ea820f84fa4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:47:20.887814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8da923b6-6b95-4537-948e-de9904091df2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:20.888443 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8da923b6-6b95-4537-948e-de9904091df2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:20.890029 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1166/2339] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:47:20 2022] DELETE /identity/v3/projects/017480a5587b482ab082ea820f84fa4a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:47:20.894996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1ef33-b218-4a4a-aed0-fabe7cbf9e0a None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:20.895282 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1ef33-b218-4a4a-aed0-fabe7cbf9e0a None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:20.895610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1ef33-b218-4a4a-aed0-fabe7cbf9e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:20.915090 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-ebc1ef33-b218-4a4a-aed0-fabe7cbf9e0a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:20.916311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-ebc1ef33-b218-4a4a-aed0-fabe7cbf9e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:20.976352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1174/2340] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:20.984134 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326541d-a649-45e7-a4b1-0b1b14920140 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:20.984363 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326541d-a649-45e7-a4b1-0b1b14920140 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:20.984640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326541d-a649-45e7-a4b1-0b1b14920140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:21.002503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-2326541d-a649-45e7-a4b1-0b1b14920140 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:21.003686 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2326541d-a649-45e7-a4b1-0b1b14920140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:21.011724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1167/2341] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:21.015759 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1ef33-b218-4a4a-aed0-fabe7cbf9e0a None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:21.026257 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1ef33-b218-4a4a-aed0-fabe7cbf9e0a None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:21.031234 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316c593-eedc-4561-90af-b6ebd07299cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:21.031894 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316c593-eedc-4561-90af-b6ebd07299cd admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:21.032182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316c593-eedc-4561-90af-b6ebd07299cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:21.032465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316c593-eedc-4561-90af-b6ebd07299cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:21.033196 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316c593-eedc-4561-90af-b6ebd07299cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:47:21.033548 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316c593-eedc-4561-90af-b6ebd07299cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:21.035148 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1316c593-eedc-4561-90af-b6ebd07299cd admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:21.047989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1175/2342] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:47:21.052146 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326541d-a649-45e7-a4b1-0b1b14920140 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:21.061991 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326541d-a649-45e7-a4b1-0b1b14920140 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:21.069635 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d12ac-2da1-4b3a-a339-ee4511c85383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:21.070297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d12ac-2da1-4b3a-a339-ee4511c85383 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:21.070587 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d12ac-2da1-4b3a-a339-ee4511c85383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:21.070860 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d12ac-2da1-4b3a-a339-ee4511c85383 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:21.071548 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d12ac-2da1-4b3a-a339-ee4511c85383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:21.073479 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d12ac-2da1-4b3a-a339-ee4511c85383 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:21.099849 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1168/2343] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:47:21 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:47:21.103644 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316c593-eedc-4561-90af-b6ebd07299cd admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:21.113951 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316c593-eedc-4561-90af-b6ebd07299cd admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:21.134524 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:21.172890 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a473b-f78e-46d1-8618-7afd957902eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:21.173591 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a473b-f78e-46d1-8618-7afd957902eb admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:21.173877 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a473b-f78e-46d1-8618-7afd957902eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:21.174154 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a473b-f78e-46d1-8618-7afd957902eb admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:21.174853 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a473b-f78e-46d1-8618-7afd957902eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:21.176765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a473b-f78e-46d1-8618-7afd957902eb admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:21.196455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1176/2344] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:47:21 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:47:21.200533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d12ac-2da1-4b3a-a339-ee4511c85383 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:21.211382 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d12ac-2da1-4b3a-a339-ee4511c85383 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:21.216306 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960be12a-1736-43f9-a526-261f9ea8f0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:21.216964 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960be12a-1736-43f9-a526-261f9ea8f0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:21.217251 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960be12a-1736-43f9-a526-261f9ea8f0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:21.217558 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960be12a-1736-43f9-a526-261f9ea8f0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:21.218277 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960be12a-1736-43f9-a526-261f9ea8f0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:21.219872 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960be12a-1736-43f9-a526-261f9ea8f0d4 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:21.230268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1169/2345] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:47:21.234018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a473b-f78e-46d1-8618-7afd957902eb admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:21.244146 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a473b-f78e-46d1-8618-7afd957902eb admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:21.248703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7898069-8082-4e68-bbfe-248c2ec8ecf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:21.249408 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7898069-8082-4e68-bbfe-248c2ec8ecf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:21.249696 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7898069-8082-4e68-bbfe-248c2ec8ecf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:21.249977 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7898069-8082-4e68-bbfe-248c2ec8ecf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:21.250702 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7898069-8082-4e68-bbfe-248c2ec8ecf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:21.252296 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7898069-8082-4e68-bbfe-248c2ec8ecf0 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:21.265085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1177/2346] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:47:21.269395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960be12a-1736-43f9-a526-261f9ea8f0d4 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:21.280410 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960be12a-1736-43f9-a526-261f9ea8f0d4 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:21.285086 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a3801-9f82-4b48-a354-6c6ac5b55721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:21.285983 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a3801-9f82-4b48-a354-6c6ac5b55721 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:21.286268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a3801-9f82-4b48-a354-6c6ac5b55721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:21.286546 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a3801-9f82-4b48-a354-6c6ac5b55721 admin admin] PATH_INFO: `/v3/projects/e748c5a8002a4784baefeaac261edd7c/users/b8ef0319498f4bdabc6263871966d74c/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:21.294688 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:21.302908 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a3801-9f82-4b48-a354-6c6ac5b55721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e748c5a8002a4784baefeaac261edd7c, user_id=b8ef0319498f4bdabc6263871966d74c, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:21.307384 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5a3801-9f82-4b48-a354-6c6ac5b55721 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:21.323157 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1170/2347] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:47:21 2022] PUT /identity/v3/projects/e748c5a8002a4784baefeaac261edd7c/users/b8ef0319498f4bdabc6263871966d74c/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:47:21.333292 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6413054-1429-4b28-a9bb-cd193527284c None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:21.333605 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6413054-1429-4b28-a9bb-cd193527284c None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:21.334600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6413054-1429-4b28-a9bb-cd193527284c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:21.360199 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-a6413054-1429-4b28-a9bb-cd193527284c None None] MFA Rules not processed for user `b8ef0319498f4bdabc6263871966d74c`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:21.361441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-a6413054-1429-4b28-a9bb-cd193527284c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:21.428957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1178/2348] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:21.433418 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a3801-9f82-4b48-a354-6c6ac5b55721 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:21.497455 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a3801-9f82-4b48-a354-6c6ac5b55721 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:21.502002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b5038-2c86-42a1-a931-3367fa65bca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:21.502655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b5038-2c86-42a1-a931-3367fa65bca1 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:21.502936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b5038-2c86-42a1-a931-3367fa65bca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:21.503210 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7b5038-2c86-42a1-a931-3367fa65bca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:21.503911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b5038-2c86-42a1-a931-3367fa65bca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:21.506073 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7b5038-2c86-42a1-a931-3367fa65bca1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:21.531455 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1171/2349] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:47:21 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:47:21.535567 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6413054-1429-4b28-a9bb-cd193527284c None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:21.548506 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6413054-1429-4b28-a9bb-cd193527284c None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:21.605888 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620bb68-0fc6-4829-9d00-bb926704ee04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:21.606549 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620bb68-0fc6-4829-9d00-bb926704ee04 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:21.606830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620bb68-0fc6-4829-9d00-bb926704ee04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:21.607104 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620bb68-0fc6-4829-9d00-bb926704ee04 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:21.607791 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620bb68-0fc6-4829-9d00-bb926704ee04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:21.609723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620bb68-0fc6-4829-9d00-bb926704ee04 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:21.630174 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1179/2350] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:47:21 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:47:21.634836 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b5038-2c86-42a1-a931-3367fa65bca1 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:21.645108 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7b5038-2c86-42a1-a931-3367fa65bca1 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:21.650078 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10df94-58bb-46c2-a2aa-759b86720b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:21.650728 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10df94-58bb-46c2-a2aa-759b86720b47 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:21.651017 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10df94-58bb-46c2-a2aa-759b86720b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:21.651299 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10df94-58bb-46c2-a2aa-759b86720b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:21.652025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10df94-58bb-46c2-a2aa-759b86720b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:21.653669 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10df94-58bb-46c2-a2aa-759b86720b47 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:21.664209 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1172/2351] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:47:21.668316 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620bb68-0fc6-4829-9d00-bb926704ee04 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:21.678798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620bb68-0fc6-4829-9d00-bb926704ee04 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:21.683397 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505a3b8-984a-41c4-9a12-3ad99596ad4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:21.684264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505a3b8-984a-41c4-9a12-3ad99596ad4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:21.684555 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505a3b8-984a-41c4-9a12-3ad99596ad4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:21.684833 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505a3b8-984a-41c4-9a12-3ad99596ad4f admin admin] PATH_INFO: `/v3/projects/f93c1f42454a42e09ec2c38325ec40d5/users/5e1f35877b7749f7877d6c03cec9724c/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:21.699869 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505a3b8-984a-41c4-9a12-3ad99596ad4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93c1f42454a42e09ec2c38325ec40d5, user_id=5e1f35877b7749f7877d6c03cec9724c, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:21.702544 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505a3b8-984a-41c4-9a12-3ad99596ad4f admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:21.710352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:21.716022 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1180/2352] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:47:21 2022] PUT /identity/v3/projects/f93c1f42454a42e09ec2c38325ec40d5/users/5e1f35877b7749f7877d6c03cec9724c/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:47:21.720151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10df94-58bb-46c2-a2aa-759b86720b47 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:21.730097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10df94-58bb-46c2-a2aa-759b86720b47 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:21.787439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3126570-b4bd-4556-806e-581c2a403533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:21.788028 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3126570-b4bd-4556-806e-581c2a403533 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:21.788308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3126570-b4bd-4556-806e-581c2a403533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:21.788582 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3126570-b4bd-4556-806e-581c2a403533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:21.789299 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3126570-b4bd-4556-806e-581c2a403533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:21.790936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3126570-b4bd-4556-806e-581c2a403533 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:21.800580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1173/2353] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:47:21.805621 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505a3b8-984a-41c4-9a12-3ad99596ad4f admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:21.815826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505a3b8-984a-41c4-9a12-3ad99596ad4f admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:21.820820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c58f0-db23-46c2-a6a5-d5fd78a46584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:21.821743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c58f0-db23-46c2-a6a5-d5fd78a46584 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:21.822060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c58f0-db23-46c2-a6a5-d5fd78a46584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:21.822365 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c58f0-db23-46c2-a6a5-d5fd78a46584 admin admin] PATH_INFO: `/v3/projects/f93c1f42454a42e09ec2c38325ec40d5/users/5e1f35877b7749f7877d6c03cec9724c/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:21.824400 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c58f0-db23-46c2-a6a5-d5fd78a46584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f93c1f42454a42e09ec2c38325ec40d5, user_id=5e1f35877b7749f7877d6c03cec9724c, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:21.827121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c58f0-db23-46c2-a6a5-d5fd78a46584 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:21.838655 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1181/2354] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:47:21 2022] PUT /identity/v3/projects/f93c1f42454a42e09ec2c38325ec40d5/users/5e1f35877b7749f7877d6c03cec9724c/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:47:21.850502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a754a-f49e-4b00-a1e0-8c4ae10deab3 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:21.850792 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a754a-f49e-4b00-a1e0-8c4ae10deab3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:21.851073 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a754a-f49e-4b00-a1e0-8c4ae10deab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:21.877093 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-358a754a-f49e-4b00-a1e0-8c4ae10deab3 None None] MFA Rules not processed for user `5e1f35877b7749f7877d6c03cec9724c`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:21.878339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-358a754a-f49e-4b00-a1e0-8c4ae10deab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:21.924703 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:21.949789 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1174/2355] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:21.962775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c58f0-db23-46c2-a6a5-d5fd78a46584 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:21.964547 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-563c58f0-db23-46c2-a6a5-d5fd78a46584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:22.021283 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c58f0-db23-46c2-a6a5-d5fd78a46584 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:22.025155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88e75f-87a4-4e6d-81a6-4bbeb8db4d54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:22.025818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88e75f-87a4-4e6d-81a6-4bbeb8db4d54 service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:22.026097 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88e75f-87a4-4e6d-81a6-4bbeb8db4d54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:22.026370 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88e75f-87a4-4e6d-81a6-4bbeb8db4d54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:22.035280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88e75f-87a4-4e6d-81a6-4bbeb8db4d54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:22.036709 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f88e75f-87a4-4e6d-81a6-4bbeb8db4d54 service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:22.047010 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1182/2356] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:47:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:47:22.350553 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a754a-f49e-4b00-a1e0-8c4ae10deab3 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:22.359778 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a754a-f49e-4b00-a1e0-8c4ae10deab3 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:22.364245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cba14f-177f-4701-9c6f-84c2e2420eb1 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e1f35877b7749f7877d6c03cec9724c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93c1f42454a42e09ec2c38325ec40d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:22.366005 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cba14f-177f-4701-9c6f-84c2e2420eb1 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:22.366288 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cba14f-177f-4701-9c6f-84c2e2420eb1 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:22.366570 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cba14f-177f-4701-9c6f-84c2e2420eb1 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:22.367293 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cba14f-177f-4701-9c6f-84c2e2420eb1 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:47:22.367597 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cba14f-177f-4701-9c6f-84c2e2420eb1 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:22.369189 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cba14f-177f-4701-9c6f-84c2e2420eb1 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:22.381479 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1175/2357] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:47:22.385837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88e75f-87a4-4e6d-81a6-4bbeb8db4d54 service cinder] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:22.394894 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88e75f-87a4-4e6d-81a6-4bbeb8db4d54 service cinder] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:22.400222 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8ec13-f99e-4b27-a002-2d85eca1b235 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e1f35877b7749f7877d6c03cec9724c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93c1f42454a42e09ec2c38325ec40d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:22.400857 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8ec13-f99e-4b27-a002-2d85eca1b235 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:22.401142 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8ec13-f99e-4b27-a002-2d85eca1b235 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:22.401458 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8ec13-f99e-4b27-a002-2d85eca1b235 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:22.402141 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8ec13-f99e-4b27-a002-2d85eca1b235 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:22.404004 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8ec13-f99e-4b27-a002-2d85eca1b235 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:22.430138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1183/2358] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:47:22 2022] POST /identity/v3/projects => generated 354 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:47:22.434195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cba14f-177f-4701-9c6f-84c2e2420eb1 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:22.444798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cba14f-177f-4701-9c6f-84c2e2420eb1 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:22.501891 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fda16-6103-45b4-a16b-d047904ef89a tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e1f35877b7749f7877d6c03cec9724c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93c1f42454a42e09ec2c38325ec40d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:22.502536 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fda16-6103-45b4-a16b-d047904ef89a tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:22.502820 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fda16-6103-45b4-a16b-d047904ef89a tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:22.503097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fda16-6103-45b4-a16b-d047904ef89a tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:22.503804 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fda16-6103-45b4-a16b-d047904ef89a tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:47:22.504108 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fda16-6103-45b4-a16b-d047904ef89a tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:22.507165 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fda16-6103-45b4-a16b-d047904ef89a tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:22.519658 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1176/2359] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:47:22.555954 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8ec13-f99e-4b27-a002-2d85eca1b235 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:22.566702 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8ec13-f99e-4b27-a002-2d85eca1b235 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:22.571529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7471e-c015-42d4-887d-4ac4e53510b2 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e1f35877b7749f7877d6c03cec9724c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f93c1f42454a42e09ec2c38325ec40d5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:22.572432 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7471e-c015-42d4-887d-4ac4e53510b2 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:22.572730 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7471e-c015-42d4-887d-4ac4e53510b2 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:22.573014 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7471e-c015-42d4-887d-4ac4e53510b2 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] PATH_INFO: `/v3/projects/e48f6ce863dc49fcb77d579341db2283` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:22.574264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7471e-c015-42d4-887d-4ac4e53510b2 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e48f6ce863dc49fcb77d579341db2283)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:22.576168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7471e-c015-42d4-887d-4ac4e53510b2 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:22.624262 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f9a7471e-c015-42d4-887d-4ac4e53510b2 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e48f6ce863dc49fcb77d579341db2283', 'request_id': 'req-f9a7471e-c015-42d4-887d-4ac4e53510b2'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:22.630586 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f9a7471e-c015-42d4-887d-4ac4e53510b2 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e48f6ce863dc49fcb77d579341db2283', 'request_id': 'req-f9a7471e-c015-42d4-887d-4ac4e53510b2'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:22.639366 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f9a7471e-c015-42d4-887d-4ac4e53510b2 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e48f6ce863dc49fcb77d579341db2283', 'request_id': 'req-f9a7471e-c015-42d4-887d-4ac4e53510b2'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:22.651675 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f9a7471e-c015-42d4-887d-4ac4e53510b2 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] The token cache is being invalidate because project e48f6ce863dc49fcb77d579341db2283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:47:22.652003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f9a7471e-c015-42d4-887d-4ac4e53510b2 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:22.652675 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-f9a7471e-c015-42d4-887d-4ac4e53510b2 tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:22.654333 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1184/2360] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:47:22 2022] DELETE /identity/v3/projects/e48f6ce863dc49fcb77d579341db2283 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:47:22.841252 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fda16-6103-45b4-a16b-d047904ef89a tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:22.843243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c79fda16-6103-45b4-a16b-d047904ef89a tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:22.911080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fda16-6103-45b4-a16b-d047904ef89a tempest-VolumeQuotaClassesTest-163054503 tempest-VolumeQuotaClassesTest-163054503-project-admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:22.968309 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e0bca-e870-4408-8b22-1d557648e542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:22.969168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e0bca-e870-4408-8b22-1d557648e542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:22.969477 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e0bca-e870-4408-8b22-1d557648e542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:22.969751 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e0bca-e870-4408-8b22-1d557648e542 admin admin] PATH_INFO: `/v3/users/b8ef0319498f4bdabc6263871966d74c` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:22.970911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e0bca-e870-4408-8b22-1d557648e542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8ef0319498f4bdabc6263871966d74c)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:22.972830 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e0bca-e870-4408-8b22-1d557648e542 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:22.985708 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:23.017984 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6c4e0bca-e870-4408-8b22-1d557648e542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ef0319498f4bdabc6263871966d74c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:23.018625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6c4e0bca-e870-4408-8b22-1d557648e542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ef0319498f4bdabc6263871966d74c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:23.026535 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6c4e0bca-e870-4408-8b22-1d557648e542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ef0319498f4bdabc6263871966d74c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:23.034250 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6c4e0bca-e870-4408-8b22-1d557648e542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ef0319498f4bdabc6263871966d74c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:23.046933 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6c4e0bca-e870-4408-8b22-1d557648e542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ef0319498f4bdabc6263871966d74c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:23.053119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1177/2361] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:47:22 2022] DELETE /identity/v3/users/b8ef0319498f4bdabc6263871966d74c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:47:23.057743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33124aa3-65dc-4f5f-8e63-7c3e33e663d1 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:23.058237 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33124aa3-65dc-4f5f-8e63-7c3e33e663d1 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:23.058397 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33124aa3-65dc-4f5f-8e63-7c3e33e663d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:23.076511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-33124aa3-65dc-4f5f-8e63-7c3e33e663d1 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:23.077744 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-33124aa3-65dc-4f5f-8e63-7c3e33e663d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:23.123487 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:23.140002 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1185/2362] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:47:23.150386 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e0bca-e870-4408-8b22-1d557648e542 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:23.151777 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6c4e0bca-e870-4408-8b22-1d557648e542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:23.208183 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e0bca-e870-4408-8b22-1d557648e542 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:23.212693 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0db8d-b9fc-44e8-8504-f15b7a237853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:23.213346 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0db8d-b9fc-44e8-8504-f15b7a237853 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:23.213645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0db8d-b9fc-44e8-8504-f15b7a237853 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:23.213928 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0db8d-b9fc-44e8-8504-f15b7a237853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:23.222919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0db8d-b9fc-44e8-8504-f15b7a237853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:23.224349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0db8d-b9fc-44e8-8504-f15b7a237853 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:23.234548 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1178/2363] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:47:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:47:23.501065 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33124aa3-65dc-4f5f-8e63-7c3e33e663d1 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:23.502548 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-33124aa3-65dc-4f5f-8e63-7c3e33e663d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:23.514921 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33124aa3-65dc-4f5f-8e63-7c3e33e663d1 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:23.519716 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de836070-2033-48e8-ae5d-6b04c2c40f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:23.520576 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de836070-2033-48e8-ae5d-6b04c2c40f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:23.520857 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de836070-2033-48e8-ae5d-6b04c2c40f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:23.521139 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de836070-2033-48e8-ae5d-6b04c2c40f94 admin admin] PATH_INFO: `/v3/projects/e748c5a8002a4784baefeaac261edd7c` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:23.522428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de836070-2033-48e8-ae5d-6b04c2c40f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e748c5a8002a4784baefeaac261edd7c)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:23.525444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de836070-2033-48e8-ae5d-6b04c2c40f94 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:23.572074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-de836070-2033-48e8-ae5d-6b04c2c40f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e748c5a8002a4784baefeaac261edd7c', 'request_id': 'req-de836070-2033-48e8-ae5d-6b04c2c40f94'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:23.577419 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-de836070-2033-48e8-ae5d-6b04c2c40f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e748c5a8002a4784baefeaac261edd7c', 'request_id': 'req-de836070-2033-48e8-ae5d-6b04c2c40f94'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:23.584208 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-de836070-2033-48e8-ae5d-6b04c2c40f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e748c5a8002a4784baefeaac261edd7c', 'request_id': 'req-de836070-2033-48e8-ae5d-6b04c2c40f94'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:23.595722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-de836070-2033-48e8-ae5d-6b04c2c40f94 admin admin] The token cache is being invalidate because project e748c5a8002a4784baefeaac261edd7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:47:23.596015 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-de836070-2033-48e8-ae5d-6b04c2c40f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:23.596643 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-de836070-2033-48e8-ae5d-6b04c2c40f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:23.598234 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1186/2364] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:47:23 2022] DELETE /identity/v3/projects/e748c5a8002a4784baefeaac261edd7c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:47:23.602575 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0db8d-b9fc-44e8-8504-f15b7a237853 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:23.612208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0db8d-b9fc-44e8-8504-f15b7a237853 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:23.668153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2fdf7-66dc-4666-8275-3f44d22b6c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:23.669067 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2fdf7-66dc-4666-8275-3f44d22b6c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:23.669355 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2fdf7-66dc-4666-8275-3f44d22b6c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:23.669826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2fdf7-66dc-4666-8275-3f44d22b6c8d admin admin] PATH_INFO: `/v3/users/5e1f35877b7749f7877d6c03cec9724c` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:23.671274 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2fdf7-66dc-4666-8275-3f44d22b6c8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e1f35877b7749f7877d6c03cec9724c)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:23.673703 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da2fdf7-66dc-4666-8275-3f44d22b6c8d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:23.710540 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:23.721358 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2da2fdf7-66dc-4666-8275-3f44d22b6c8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e1f35877b7749f7877d6c03cec9724c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:23.722038 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2da2fdf7-66dc-4666-8275-3f44d22b6c8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e1f35877b7749f7877d6c03cec9724c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:23.730300 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2da2fdf7-66dc-4666-8275-3f44d22b6c8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e1f35877b7749f7877d6c03cec9724c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:23.737503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2da2fdf7-66dc-4666-8275-3f44d22b6c8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e1f35877b7749f7877d6c03cec9724c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:23.751463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2da2fdf7-66dc-4666-8275-3f44d22b6c8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e1f35877b7749f7877d6c03cec9724c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:23.758104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1179/2365] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:47:23 2022] DELETE /identity/v3/users/5e1f35877b7749f7877d6c03cec9724c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:47:24.115948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de836070-2033-48e8-ae5d-6b04c2c40f94 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:24.117778 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-de836070-2033-48e8-ae5d-6b04c2c40f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:24.141291 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de836070-2033-48e8-ae5d-6b04c2c40f94 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:24.199115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a1e2a-fb69-4bb0-ad15-4743e025b20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:24.199974 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a1e2a-fb69-4bb0-ad15-4743e025b20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:24.200253 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a1e2a-fb69-4bb0-ad15-4743e025b20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:24.200527 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a1e2a-fb69-4bb0-ad15-4743e025b20e admin admin] PATH_INFO: `/v3/projects/f93c1f42454a42e09ec2c38325ec40d5` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:24.201718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a1e2a-fb69-4bb0-ad15-4743e025b20e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f93c1f42454a42e09ec2c38325ec40d5)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:24.203608 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a1e2a-fb69-4bb0-ad15-4743e025b20e admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:24.249948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-e10a1e2a-fb69-4bb0-ad15-4743e025b20e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f93c1f42454a42e09ec2c38325ec40d5', 'request_id': 'req-e10a1e2a-fb69-4bb0-ad15-4743e025b20e'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:24.255589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-e10a1e2a-fb69-4bb0-ad15-4743e025b20e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f93c1f42454a42e09ec2c38325ec40d5', 'request_id': 'req-e10a1e2a-fb69-4bb0-ad15-4743e025b20e'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:24.263526 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-e10a1e2a-fb69-4bb0-ad15-4743e025b20e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f93c1f42454a42e09ec2c38325ec40d5', 'request_id': 'req-e10a1e2a-fb69-4bb0-ad15-4743e025b20e'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:24.274724 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-e10a1e2a-fb69-4bb0-ad15-4743e025b20e admin admin] The token cache is being invalidate because project f93c1f42454a42e09ec2c38325ec40d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:47:24.275011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-e10a1e2a-fb69-4bb0-ad15-4743e025b20e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:24.275635 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-e10a1e2a-fb69-4bb0-ad15-4743e025b20e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:24.277160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1187/2366] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:47:24 2022] DELETE /identity/v3/projects/f93c1f42454a42e09ec2c38325ec40d5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:47:24.282843 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdc791-a632-4528-80d4-979d48c237bc None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:24.283138 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdc791-a632-4528-80d4-979d48c237bc None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:24.283423 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cdc791-a632-4528-80d4-979d48c237bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:24.301707 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b3cdc791-a632-4528-80d4-979d48c237bc None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:24.302900 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b3cdc791-a632-4528-80d4-979d48c237bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:24.360755 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1180/2367] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:24.369364 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04144d73-097e-48ee-8825-31c564fa17a6 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:24.369708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04144d73-097e-48ee-8825-31c564fa17a6 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:24.369988 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04144d73-097e-48ee-8825-31c564fa17a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:24.376288 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:24.389756 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-04144d73-097e-48ee-8825-31c564fa17a6 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:24.390959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-04144d73-097e-48ee-8825-31c564fa17a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:24.399845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1188/2368] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:24.404082 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdc791-a632-4528-80d4-979d48c237bc None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:24.414562 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cdc791-a632-4528-80d4-979d48c237bc None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:24.419244 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43181f6b-2dd0-4e9a-a233-5712b2a06e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:24.419893 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43181f6b-2dd0-4e9a-a233-5712b2a06e42 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:24.420179 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43181f6b-2dd0-4e9a-a233-5712b2a06e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:24.420456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43181f6b-2dd0-4e9a-a233-5712b2a06e42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:24.421185 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43181f6b-2dd0-4e9a-a233-5712b2a06e42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:47:24.421604 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43181f6b-2dd0-4e9a-a233-5712b2a06e42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:24.423215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43181f6b-2dd0-4e9a-a233-5712b2a06e42 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:24.434711 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1181/2369] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:47:24.438867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04144d73-097e-48ee-8825-31c564fa17a6 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:24.447949 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04144d73-097e-48ee-8825-31c564fa17a6 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:24.452543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f114ce-baec-45f0-b21c-61ad0dce7e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:24.453186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f114ce-baec-45f0-b21c-61ad0dce7e2f admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:24.453579 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f114ce-baec-45f0-b21c-61ad0dce7e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:24.453864 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f114ce-baec-45f0-b21c-61ad0dce7e2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:24.454571 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f114ce-baec-45f0-b21c-61ad0dce7e2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:24.456461 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f114ce-baec-45f0-b21c-61ad0dce7e2f admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:24.483028 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1189/2370] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:47:24 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:47:24.487167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43181f6b-2dd0-4e9a-a233-5712b2a06e42 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:24.496999 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43181f6b-2dd0-4e9a-a233-5712b2a06e42 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:24.552330 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf22cc-23e9-4084-9134-fe513c421881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:24.553013 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf22cc-23e9-4084-9134-fe513c421881 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:24.553312 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf22cc-23e9-4084-9134-fe513c421881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:24.553603 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf22cc-23e9-4084-9134-fe513c421881 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:24.554450 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf22cc-23e9-4084-9134-fe513c421881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:24.556404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf22cc-23e9-4084-9134-fe513c421881 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:24.576095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1182/2371] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:47:24 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:47:24.580230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f114ce-baec-45f0-b21c-61ad0dce7e2f admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:24.591125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f114ce-baec-45f0-b21c-61ad0dce7e2f admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:24.595773 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b22cd7-d8b3-4b08-9cac-b604c3a1ce8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:24.596426 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b22cd7-d8b3-4b08-9cac-b604c3a1ce8a admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:24.596716 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b22cd7-d8b3-4b08-9cac-b604c3a1ce8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:24.596999 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b22cd7-d8b3-4b08-9cac-b604c3a1ce8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:24.597796 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b22cd7-d8b3-4b08-9cac-b604c3a1ce8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:24.599387 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b22cd7-d8b3-4b08-9cac-b604c3a1ce8a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:24.610448 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1190/2372] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:47:24.614373 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf22cc-23e9-4084-9134-fe513c421881 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:24.624630 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf22cc-23e9-4084-9134-fe513c421881 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:24.629539 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047d94d-61ef-4d61-afd3-52a712b03ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:24.630179 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047d94d-61ef-4d61-afd3-52a712b03ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:24.630460 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047d94d-61ef-4d61-afd3-52a712b03ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:24.630735 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047d94d-61ef-4d61-afd3-52a712b03ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:24.631448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047d94d-61ef-4d61-afd3-52a712b03ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:24.633141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047d94d-61ef-4d61-afd3-52a712b03ca8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:24.643302 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1183/2373] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:47:24.647229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b22cd7-d8b3-4b08-9cac-b604c3a1ce8a admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:24.658122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b22cd7-d8b3-4b08-9cac-b604c3a1ce8a admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:24.662833 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce5231-c2ac-4225-a650-0dc515900d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:24.664487 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce5231-c2ac-4225-a650-0dc515900d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:24.664776 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce5231-c2ac-4225-a650-0dc515900d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:24.665060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce5231-c2ac-4225-a650-0dc515900d97 admin admin] PATH_INFO: `/v3/projects/adc37fa0c73b473a88e7e29eaa3a41a2/users/cf5def56acd540b5bb474bf9aedb4e68/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:24.681812 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce5231-c2ac-4225-a650-0dc515900d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adc37fa0c73b473a88e7e29eaa3a41a2, user_id=cf5def56acd540b5bb474bf9aedb4e68, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:24.684740 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce5231-c2ac-4225-a650-0dc515900d97 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:24.698635 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1191/2374] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:47:24 2022] PUT /identity/v3/projects/adc37fa0c73b473a88e7e29eaa3a41a2/users/cf5def56acd540b5bb474bf9aedb4e68/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:47:24.708945 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df795f-5cba-4f4f-a617-ead37168c9aa None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:24.709337 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df795f-5cba-4f4f-a617-ead37168c9aa None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:24.709763 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df795f-5cba-4f4f-a617-ead37168c9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:24.737903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-90df795f-5cba-4f4f-a617-ead37168c9aa None None] MFA Rules not processed for user `cf5def56acd540b5bb474bf9aedb4e68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:24.739100 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-90df795f-5cba-4f4f-a617-ead37168c9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:24.744129 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:24.814302 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1184/2375] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:24.823952 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce5231-c2ac-4225-a650-0dc515900d97 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:24.826241 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-06ce5231-c2ac-4225-a650-0dc515900d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:24.887484 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce5231-c2ac-4225-a650-0dc515900d97 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:24.891048 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f4dc4-533c-4a2b-8b19-585ea7dd8550 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:24.891689 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f4dc4-533c-4a2b-8b19-585ea7dd8550 service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:24.891972 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f4dc4-533c-4a2b-8b19-585ea7dd8550 service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:24.892247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f4dc4-533c-4a2b-8b19-585ea7dd8550 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:24.903159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f4dc4-533c-4a2b-8b19-585ea7dd8550 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:24.904662 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f4dc4-533c-4a2b-8b19-585ea7dd8550 service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:24.915787 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1192/2376] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:47:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:47:25.808332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fc616-6fd2-449c-a39d-99c1af37e067 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:25.808798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fc616-6fd2-449c-a39d-99c1af37e067 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:25.808907 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fc616-6fd2-449c-a39d-99c1af37e067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:25.827270 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1d2fc616-6fd2-449c-a39d-99c1af37e067 None None] MFA Rules not processed for user `d16be8774cb842199cfb9e3b9965bd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:25.828450 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1d2fc616-6fd2-449c-a39d-99c1af37e067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:25.885286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1185/2377] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jun 14 19:47:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:25.932621 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f4dc4-533c-4a2b-8b19-585ea7dd8550 service cinder] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:25.934052 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-f43f4dc4-533c-4a2b-8b19-585ea7dd8550 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:26.002617 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f4dc4-533c-4a2b-8b19-585ea7dd8550 service cinder] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:26.007624 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731af899-1117-4958-9555-962a8b145eea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fff5414195f4873bcc8752c914b6b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:26.008849 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731af899-1117-4958-9555-962a8b145eea service swift] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:26.009169 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731af899-1117-4958-9555-962a8b145eea service swift] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:26.009438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731af899-1117-4958-9555-962a8b145eea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:26.017365 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731af899-1117-4958-9555-962a8b145eea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:26.018969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731af899-1117-4958-9555-962a8b145eea service swift] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:26.027682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1193/2378] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jun 14 19:47:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 19:47:26.872212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fc616-6fd2-449c-a39d-99c1af37e067 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:26.874118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1d2fc616-6fd2-449c-a39d-99c1af37e067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:26.989864 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fc616-6fd2-449c-a39d-99c1af37e067 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:26.997302 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdf43b9-a9fc-4d41-b7ec-6873a551f404 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:26.998122 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf43b9-a9fc-4d41-b7ec-6873a551f404 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:26.998536 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf43b9-a9fc-4d41-b7ec-6873a551f404 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:26.998915 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdf43b9-a9fc-4d41-b7ec-6873a551f404 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:27.000863 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-dbdf43b9-a9fc-4d41-b7ec-6873a551f404 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:27.018003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf43b9-a9fc-4d41-b7ec-6873a551f404 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:27.019627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdf43b9-a9fc-4d41-b7ec-6873a551f404 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:27.031618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1186/2379] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:47:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:47:33.588033 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731af899-1117-4958-9555-962a8b145eea service swift] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:33.640432 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:33.680631 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731af899-1117-4958-9555-962a8b145eea service swift] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:33.685649 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acc1aa-f39c-4261-8955-d723eb39ec60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:33.686792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acc1aa-f39c-4261-8955-d723eb39ec60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:33.687290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acc1aa-f39c-4261-8955-d723eb39ec60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:33.687767 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58acc1aa-f39c-4261-8955-d723eb39ec60 admin admin] PATH_INFO: `/v3/users/cf5def56acd540b5bb474bf9aedb4e68` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:33.689157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acc1aa-f39c-4261-8955-d723eb39ec60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf5def56acd540b5bb474bf9aedb4e68)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:33.691203 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58acc1aa-f39c-4261-8955-d723eb39ec60 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:33.749440 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-58acc1aa-f39c-4261-8955-d723eb39ec60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf5def56acd540b5bb474bf9aedb4e68'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:33.750258 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-58acc1aa-f39c-4261-8955-d723eb39ec60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf5def56acd540b5bb474bf9aedb4e68'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:33.759035 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-58acc1aa-f39c-4261-8955-d723eb39ec60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf5def56acd540b5bb474bf9aedb4e68'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:33.769910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-58acc1aa-f39c-4261-8955-d723eb39ec60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf5def56acd540b5bb474bf9aedb4e68'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:33.787723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-58acc1aa-f39c-4261-8955-d723eb39ec60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf5def56acd540b5bb474bf9aedb4e68'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:33.795387 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1194/2380] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:47:33 2022] DELETE /identity/v3/users/cf5def56acd540b5bb474bf9aedb4e68 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:47:33.799858 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcad68a-080b-4f17-ba57-dd508217f7f6 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:33.800374 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcad68a-080b-4f17-ba57-dd508217f7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:33.800480 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcad68a-080b-4f17-ba57-dd508217f7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:33.823955 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-3dcad68a-080b-4f17-ba57-dd508217f7f6 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:33.825441 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3dcad68a-080b-4f17-ba57-dd508217f7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:33.864532 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:33.903176 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1187/2381] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:33.914453 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acc1aa-f39c-4261-8955-d723eb39ec60 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:33.916230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-58acc1aa-f39c-4261-8955-d723eb39ec60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:33.989645 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58acc1aa-f39c-4261-8955-d723eb39ec60 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:33.994287 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce4e703-9a18-4088-ac01-eb9ba9ed9a7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:33.995014 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4e703-9a18-4088-ac01-eb9ba9ed9a7c service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:33.995510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4e703-9a18-4088-ac01-eb9ba9ed9a7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:33.995852 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce4e703-9a18-4088-ac01-eb9ba9ed9a7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:34.006614 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4e703-9a18-4088-ac01-eb9ba9ed9a7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:34.008780 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce4e703-9a18-4088-ac01-eb9ba9ed9a7c service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:34.019739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1195/2382] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:47:34.380969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcad68a-080b-4f17-ba57-dd508217f7f6 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:34.382415 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3dcad68a-080b-4f17-ba57-dd508217f7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:34.428175 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcad68a-080b-4f17-ba57-dd508217f7f6 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:34.433814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd47edd-914b-419a-bcd9-41faa73cd730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:34.435212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd47edd-914b-419a-bcd9-41faa73cd730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:34.436303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd47edd-914b-419a-bcd9-41faa73cd730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:34.436636 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd47edd-914b-419a-bcd9-41faa73cd730 admin admin] PATH_INFO: `/v3/projects/adc37fa0c73b473a88e7e29eaa3a41a2` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:34.437988 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd47edd-914b-419a-bcd9-41faa73cd730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adc37fa0c73b473a88e7e29eaa3a41a2)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:34.439994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd47edd-914b-419a-bcd9-41faa73cd730 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:34.510150 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8cd47edd-914b-419a-bcd9-41faa73cd730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adc37fa0c73b473a88e7e29eaa3a41a2', 'request_id': 'req-8cd47edd-914b-419a-bcd9-41faa73cd730'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:34.516542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8cd47edd-914b-419a-bcd9-41faa73cd730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adc37fa0c73b473a88e7e29eaa3a41a2', 'request_id': 'req-8cd47edd-914b-419a-bcd9-41faa73cd730'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:34.526931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8cd47edd-914b-419a-bcd9-41faa73cd730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adc37fa0c73b473a88e7e29eaa3a41a2', 'request_id': 'req-8cd47edd-914b-419a-bcd9-41faa73cd730'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:34.542755 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8cd47edd-914b-419a-bcd9-41faa73cd730 admin admin] The token cache is being invalidate because project adc37fa0c73b473a88e7e29eaa3a41a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:47:34.543433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8cd47edd-914b-419a-bcd9-41faa73cd730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:34.544192 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8cd47edd-914b-419a-bcd9-41faa73cd730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:34.549208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1188/2383] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:47:34 2022] DELETE /identity/v3/projects/adc37fa0c73b473a88e7e29eaa3a41a2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:47:34.550938 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55cf86-1ee6-4dea-9d06-7c787a5e3e1b None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:34.551228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55cf86-1ee6-4dea-9d06-7c787a5e3e1b None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:34.551509 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55cf86-1ee6-4dea-9d06-7c787a5e3e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:34.574370 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-3f55cf86-1ee6-4dea-9d06-7c787a5e3e1b None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:34.578639 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-3f55cf86-1ee6-4dea-9d06-7c787a5e3e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:34.636757 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:34.655647 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1196/2384] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:34.664581 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152ed5b-e907-44f8-8654-329e58ceb290 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:34.664937 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152ed5b-e907-44f8-8654-329e58ceb290 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:34.665168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152ed5b-e907-44f8-8654-329e58ceb290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:34.689995 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-4152ed5b-e907-44f8-8654-329e58ceb290 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:34.691225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4152ed5b-e907-44f8-8654-329e58ceb290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:34.703800 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1189/2385] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:34.705703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55cf86-1ee6-4dea-9d06-7c787a5e3e1b None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:34.719252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55cf86-1ee6-4dea-9d06-7c787a5e3e1b None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:34.724444 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b807ec-4788-4e20-b926-1a8deb060bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:34.725127 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b807ec-4788-4e20-b926-1a8deb060bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:34.725439 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b807ec-4788-4e20-b926-1a8deb060bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:34.725723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b807ec-4788-4e20-b926-1a8deb060bd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:34.727075 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b807ec-4788-4e20-b926-1a8deb060bd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:47:34.727387 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b807ec-4788-4e20-b926-1a8deb060bd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:34.729012 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b807ec-4788-4e20-b926-1a8deb060bd0 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:34.749422 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1197/2386] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:47:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:47:34.751004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152ed5b-e907-44f8-8654-329e58ceb290 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:34.762706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152ed5b-e907-44f8-8654-329e58ceb290 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:34.768270 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5662e-46ee-4437-bfc7-8b39b59de4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:34.769217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5662e-46ee-4437-bfc7-8b39b59de4ab admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:34.769699 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5662e-46ee-4437-bfc7-8b39b59de4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:34.770280 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d5662e-46ee-4437-bfc7-8b39b59de4ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:34.771155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5662e-46ee-4437-bfc7-8b39b59de4ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:34.773222 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d5662e-46ee-4437-bfc7-8b39b59de4ab admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:34.809523 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1190/2387] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:47:34 2022] POST /identity/v3/projects => generated 361 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:47:34.816958 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b807ec-4788-4e20-b926-1a8deb060bd0 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:34.829885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b807ec-4788-4e20-b926-1a8deb060bd0 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:34.905244 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453d5cf-9ca2-44af-bc82-71af90ec1f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:34.910220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453d5cf-9ca2-44af-bc82-71af90ec1f7a admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:34.910514 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453d5cf-9ca2-44af-bc82-71af90ec1f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:34.910799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453d5cf-9ca2-44af-bc82-71af90ec1f7a admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:34.911698 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453d5cf-9ca2-44af-bc82-71af90ec1f7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:34.913682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453d5cf-9ca2-44af-bc82-71af90ec1f7a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:34.939878 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1198/2388] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:47:34 2022] POST /identity/v3/users => generated 281 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:47:34.941140 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5662e-46ee-4437-bfc7-8b39b59de4ab admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:34.952505 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d5662e-46ee-4437-bfc7-8b39b59de4ab admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:34.957287 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51080bc5-d104-4c56-a25b-c05b8fddadc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:34.957977 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51080bc5-d104-4c56-a25b-c05b8fddadc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:34.958258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51080bc5-d104-4c56-a25b-c05b8fddadc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:34.958558 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51080bc5-d104-4c56-a25b-c05b8fddadc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:34.959280 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51080bc5-d104-4c56-a25b-c05b8fddadc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:34.961449 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51080bc5-d104-4c56-a25b-c05b8fddadc6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:34.972448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1191/2389] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:47:34.976752 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453d5cf-9ca2-44af-bc82-71af90ec1f7a admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:34.989087 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453d5cf-9ca2-44af-bc82-71af90ec1f7a admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:34.998805 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9805b0df-79d8-4c68-b5f1-f80baa74b3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:34.999596 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805b0df-79d8-4c68-b5f1-f80baa74b3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:34.999945 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805b0df-79d8-4c68-b5f1-f80baa74b3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:35.000316 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9805b0df-79d8-4c68-b5f1-f80baa74b3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:35.001135 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805b0df-79d8-4c68-b5f1-f80baa74b3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:35.003082 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9805b0df-79d8-4c68-b5f1-f80baa74b3e4 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:35.015648 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1199/2390] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:47:35.019794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51080bc5-d104-4c56-a25b-c05b8fddadc6 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:35.033405 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51080bc5-d104-4c56-a25b-c05b8fddadc6 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:35.042701 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b62bc7-5768-4955-a741-a49640b8433a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:35.043580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b62bc7-5768-4955-a741-a49640b8433a admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:35.043857 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b62bc7-5768-4955-a741-a49640b8433a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:35.044129 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b62bc7-5768-4955-a741-a49640b8433a admin admin] PATH_INFO: `/v3/projects/10e7c974bb634202907f4b276fe7f122/users/61f1a532d2634b26bddbd8f6b055b089/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:35.060404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b62bc7-5768-4955-a741-a49640b8433a admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e7c974bb634202907f4b276fe7f122, user_id=61f1a532d2634b26bddbd8f6b055b089, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:35.063190 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b62bc7-5768-4955-a741-a49640b8433a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:35.077303 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1192/2391] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:47:35 2022] PUT /identity/v3/projects/10e7c974bb634202907f4b276fe7f122/users/61f1a532d2634b26bddbd8f6b055b089/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:47:35.088259 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93ea1c-4b11-48c3-bdd9-2b4373603901 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:35.088549 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93ea1c-4b11-48c3-bdd9-2b4373603901 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:35.088825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93ea1c-4b11-48c3-bdd9-2b4373603901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:35.116259 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-4f93ea1c-4b11-48c3-bdd9-2b4373603901 None None] MFA Rules not processed for user `61f1a532d2634b26bddbd8f6b055b089`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:35.117527 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-4f93ea1c-4b11-48c3-bdd9-2b4373603901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:35.188302 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1200/2392] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:35.220297 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b62bc7-5768-4955-a741-a49640b8433a admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:35.222013 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-17b62bc7-5768-4955-a741-a49640b8433a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:35.278571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b62bc7-5768-4955-a741-a49640b8433a admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:35.282151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def8c5d-6358-4e64-bba2-83f3751be29c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:35.282778 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def8c5d-6358-4e64-bba2-83f3751be29c service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:35.283057 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def8c5d-6358-4e64-bba2-83f3751be29c service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:35.283330 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def8c5d-6358-4e64-bba2-83f3751be29c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:35.291797 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def8c5d-6358-4e64-bba2-83f3751be29c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:35.293216 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def8c5d-6358-4e64-bba2-83f3751be29c service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:35.297761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:35.302880 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1193/2393] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:47:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:47:35.317695 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93ea1c-4b11-48c3-bdd9-2b4373603901 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:35.367722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:35.382909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93ea1c-4b11-48c3-bdd9-2b4373603901 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:35.387502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a1fd3-898c-41d7-a016-385f584ed062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:35.388370 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a1fd3-898c-41d7-a016-385f584ed062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:35.388650 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a1fd3-898c-41d7-a016-385f584ed062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:35.388920 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a1fd3-898c-41d7-a016-385f584ed062 admin admin] PATH_INFO: `/v3/users/61f1a532d2634b26bddbd8f6b055b089` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:35.390106 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a1fd3-898c-41d7-a016-385f584ed062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61f1a532d2634b26bddbd8f6b055b089)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:35.392015 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a1fd3-898c-41d7-a016-385f584ed062 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:35.440125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a35a1fd3-898c-41d7-a016-385f584ed062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61f1a532d2634b26bddbd8f6b055b089'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:35.440698 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a35a1fd3-898c-41d7-a016-385f584ed062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61f1a532d2634b26bddbd8f6b055b089'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:35.448009 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a35a1fd3-898c-41d7-a016-385f584ed062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61f1a532d2634b26bddbd8f6b055b089'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:35.454999 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a35a1fd3-898c-41d7-a016-385f584ed062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61f1a532d2634b26bddbd8f6b055b089'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:35.467088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a35a1fd3-898c-41d7-a016-385f584ed062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61f1a532d2634b26bddbd8f6b055b089'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:35.473146 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1201/2394] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:47:35 2022] DELETE /identity/v3/users/61f1a532d2634b26bddbd8f6b055b089 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:47:35.478735 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f91cdb-8cee-433e-9179-e0dedb9c0262 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:35.479036 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f91cdb-8cee-433e-9179-e0dedb9c0262 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:35.479304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f91cdb-8cee-433e-9179-e0dedb9c0262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:35.498516 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d5f91cdb-8cee-433e-9179-e0dedb9c0262 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:35.499798 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d5f91cdb-8cee-433e-9179-e0dedb9c0262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:35.560724 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1194/2395] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:35.573747 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a1fd3-898c-41d7-a016-385f584ed062 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:35.575200 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-a35a1fd3-898c-41d7-a016-385f584ed062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:35.642108 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a1fd3-898c-41d7-a016-385f584ed062 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:35.645803 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1316187-87d2-416e-9ea9-6559391f7602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:35.646453 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1316187-87d2-416e-9ea9-6559391f7602 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:35.646738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1316187-87d2-416e-9ea9-6559391f7602 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:35.647013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1316187-87d2-416e-9ea9-6559391f7602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:35.656753 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1316187-87d2-416e-9ea9-6559391f7602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:35.658215 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1316187-87d2-416e-9ea9-6559391f7602 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:35.668051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1202/2396] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:47:35.726227 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f91cdb-8cee-433e-9179-e0dedb9c0262 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:35.736837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f91cdb-8cee-433e-9179-e0dedb9c0262 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:35.740997 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecf486-5ecc-40d2-a10e-a2edc6b78aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:35.741590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecf486-5ecc-40d2-a10e-a2edc6b78aef service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:35.741871 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecf486-5ecc-40d2-a10e-a2edc6b78aef service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:35.742743 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecf486-5ecc-40d2-a10e-a2edc6b78aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:35.745090 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-65ecf486-5ecc-40d2-a10e-a2edc6b78aef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:35.755293 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ecf486-5ecc-40d2-a10e-a2edc6b78aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:35.756731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ecf486-5ecc-40d2-a10e-a2edc6b78aef service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:35.766786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1195/2397] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:47:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:47:36.087067 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1316187-87d2-416e-9ea9-6559391f7602 service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:36.088606 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e1316187-87d2-416e-9ea9-6559391f7602 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:36.106267 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1316187-87d2-416e-9ea9-6559391f7602 service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:36.111970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1befa-91ce-47e5-b2af-dabc0b75ad53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:36.112986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1befa-91ce-47e5-b2af-dabc0b75ad53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:36.113263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1befa-91ce-47e5-b2af-dabc0b75ad53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:36.113555 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1befa-91ce-47e5-b2af-dabc0b75ad53 admin admin] PATH_INFO: `/v3/projects/10e7c974bb634202907f4b276fe7f122` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:36.114737 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1befa-91ce-47e5-b2af-dabc0b75ad53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10e7c974bb634202907f4b276fe7f122)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:36.116668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1befa-91ce-47e5-b2af-dabc0b75ad53 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:36.165179 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-80e1befa-91ce-47e5-b2af-dabc0b75ad53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10e7c974bb634202907f4b276fe7f122', 'request_id': 'req-80e1befa-91ce-47e5-b2af-dabc0b75ad53'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:36.170594 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-80e1befa-91ce-47e5-b2af-dabc0b75ad53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10e7c974bb634202907f4b276fe7f122', 'request_id': 'req-80e1befa-91ce-47e5-b2af-dabc0b75ad53'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:36.179211 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-80e1befa-91ce-47e5-b2af-dabc0b75ad53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10e7c974bb634202907f4b276fe7f122', 'request_id': 'req-80e1befa-91ce-47e5-b2af-dabc0b75ad53'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:36.181507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:36.194422 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-80e1befa-91ce-47e5-b2af-dabc0b75ad53 admin admin] The token cache is being invalidate because project 10e7c974bb634202907f4b276fe7f122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:47:36.194772 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-80e1befa-91ce-47e5-b2af-dabc0b75ad53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:36.195811 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-80e1befa-91ce-47e5-b2af-dabc0b75ad53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:47:36.197339 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1203/2398] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:47:36 2022] DELETE /identity/v3/projects/10e7c974bb634202907f4b276fe7f122 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:47:36.202160 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7172de-6f0a-4cc2-a4d2-39bf438bed69 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:36.202640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7172de-6f0a-4cc2-a4d2-39bf438bed69 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:36.202852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7172de-6f0a-4cc2-a4d2-39bf438bed69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:36.221067 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-de7172de-6f0a-4cc2-a4d2-39bf438bed69 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:36.222301 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-de7172de-6f0a-4cc2-a4d2-39bf438bed69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:36.282177 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1196/2399] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:36.291602 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014f071-3667-4f88-aa0d-2ffab7b58837 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:36.291891 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014f071-3667-4f88-aa0d-2ffab7b58837 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:36.292175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014f071-3667-4f88-aa0d-2ffab7b58837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:36.311436 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-a014f071-3667-4f88-aa0d-2ffab7b58837 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:36.312667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-a014f071-3667-4f88-aa0d-2ffab7b58837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:36.321552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1204/2400] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:36.325582 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7172de-6f0a-4cc2-a4d2-39bf438bed69 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:36.335634 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7172de-6f0a-4cc2-a4d2-39bf438bed69 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:36.341930 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f1647-79a9-40c7-98bb-0a285b5f8de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:36.342657 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f1647-79a9-40c7-98bb-0a285b5f8de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:36.342965 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f1647-79a9-40c7-98bb-0a285b5f8de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:36.343245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f1647-79a9-40c7-98bb-0a285b5f8de5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:36.344134 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f1647-79a9-40c7-98bb-0a285b5f8de5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:47:36.344440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f1647-79a9-40c7-98bb-0a285b5f8de5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:36.346093 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f1647-79a9-40c7-98bb-0a285b5f8de5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:36.358248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1197/2401] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:47:36.362625 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014f071-3667-4f88-aa0d-2ffab7b58837 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:36.372374 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014f071-3667-4f88-aa0d-2ffab7b58837 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:36.376927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247cca8-9e8a-431a-a1cf-b0366f6b5526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:36.377592 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247cca8-9e8a-431a-a1cf-b0366f6b5526 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:36.377873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247cca8-9e8a-431a-a1cf-b0366f6b5526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:36.378148 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247cca8-9e8a-431a-a1cf-b0366f6b5526 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:36.378828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247cca8-9e8a-431a-a1cf-b0366f6b5526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:36.380771 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247cca8-9e8a-431a-a1cf-b0366f6b5526 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:36.406743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1205/2402] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:47:36 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:47:36.410820 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f1647-79a9-40c7-98bb-0a285b5f8de5 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:36.421497 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f1647-79a9-40c7-98bb-0a285b5f8de5 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:36.475107 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b4e24-1107-4b39-8366-5832b30223a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:36.475804 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b4e24-1107-4b39-8366-5832b30223a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:36.476132 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b4e24-1107-4b39-8366-5832b30223a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:36.477499 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715b4e24-1107-4b39-8366-5832b30223a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:36.478266 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b4e24-1107-4b39-8366-5832b30223a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:36.480166 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715b4e24-1107-4b39-8366-5832b30223a0 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:36.499882 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1198/2403] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:47:36 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:47:36.503963 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247cca8-9e8a-431a-a1cf-b0366f6b5526 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:36.514315 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247cca8-9e8a-431a-a1cf-b0366f6b5526 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:36.518986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b677d0-aacd-4448-a2cb-589f57406347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:36.519640 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b677d0-aacd-4448-a2cb-589f57406347 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:36.519922 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b677d0-aacd-4448-a2cb-589f57406347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:36.520198 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b677d0-aacd-4448-a2cb-589f57406347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:36.520921 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b677d0-aacd-4448-a2cb-589f57406347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:36.522545 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b677d0-aacd-4448-a2cb-589f57406347 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:36.533589 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1206/2404] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:47:36.537253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b4e24-1107-4b39-8366-5832b30223a0 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:36.544211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:36.548068 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715b4e24-1107-4b39-8366-5832b30223a0 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:36.553888 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c5de6-3212-44e1-9903-4b239c4f8d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:36.554606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c5de6-3212-44e1-9903-4b239c4f8d9a admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:36.554979 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c5de6-3212-44e1-9903-4b239c4f8d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:36.555263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c5de6-3212-44e1-9903-4b239c4f8d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:36.555988 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c5de6-3212-44e1-9903-4b239c4f8d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:36.557626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c5de6-3212-44e1-9903-4b239c4f8d9a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:36.567628 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1199/2405] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:47:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:47:36.571889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b677d0-aacd-4448-a2cb-589f57406347 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:36.581901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b677d0-aacd-4448-a2cb-589f57406347 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:36.587605 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdcf69-c28c-4b5a-8810-1485be7fa9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:36.588506 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdcf69-c28c-4b5a-8810-1485be7fa9ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:36.588779 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdcf69-c28c-4b5a-8810-1485be7fa9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:36.589061 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbdcf69-c28c-4b5a-8810-1485be7fa9ca admin admin] PATH_INFO: `/v3/projects/35a27fefe9ec41c09c01d67ec3d75683/users/2900dfb691734898a5fd1ac12207cebf/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:36.604532 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdcf69-c28c-4b5a-8810-1485be7fa9ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a27fefe9ec41c09c01d67ec3d75683, user_id=2900dfb691734898a5fd1ac12207cebf, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:36.607220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbdcf69-c28c-4b5a-8810-1485be7fa9ca admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:36.619887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1207/2406] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:47:36 2022] PUT /identity/v3/projects/35a27fefe9ec41c09c01d67ec3d75683/users/2900dfb691734898a5fd1ac12207cebf/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:47:36.624875 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da984454-881e-474a-9d5d-82c652ab9950 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:36.625458 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da984454-881e-474a-9d5d-82c652ab9950 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:36.625750 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da984454-881e-474a-9d5d-82c652ab9950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:36.643171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-da984454-881e-474a-9d5d-82c652ab9950 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:36.644372 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-da984454-881e-474a-9d5d-82c652ab9950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:36.707769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1200/2407] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:36.718386 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdcf69-c28c-4b5a-8810-1485be7fa9ca admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:36.720159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-4cbdcf69-c28c-4b5a-8810-1485be7fa9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:36.778960 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbdcf69-c28c-4b5a-8810-1485be7fa9ca admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:36.782539 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8146809-b8bf-4fde-b399-944b94cf69ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:36.783241 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8146809-b8bf-4fde-b399-944b94cf69ac service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:36.783572 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8146809-b8bf-4fde-b399-944b94cf69ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:36.783922 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8146809-b8bf-4fde-b399-944b94cf69ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:36.793627 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8146809-b8bf-4fde-b399-944b94cf69ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:36.795071 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8146809-b8bf-4fde-b399-944b94cf69ac service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:36.805694 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1208/2408] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:47:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:47:37.504851 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb86402-5d69-4485-8c08-a8e9706fdcf8 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:37.505418 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb86402-5d69-4485-8c08-a8e9706fdcf8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:37.505530 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb86402-5d69-4485-8c08-a8e9706fdcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:37.533729 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-7eb86402-5d69-4485-8c08-a8e9706fdcf8 None None] MFA Rules not processed for user `2900dfb691734898a5fd1ac12207cebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:37.534941 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7eb86402-5d69-4485-8c08-a8e9706fdcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:37.602602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1201/2409] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:37.613349 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8146809-b8bf-4fde-b399-944b94cf69ac service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:37.615624 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-a8146809-b8bf-4fde-b399-944b94cf69ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:37.674483 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8146809-b8bf-4fde-b399-944b94cf69ac service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:37.678089 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560da16-ccde-4a3c-bcd1-8a6a92350604 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:37.678737 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560da16-ccde-4a3c-bcd1-8a6a92350604 service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:37.679018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560da16-ccde-4a3c-bcd1-8a6a92350604 service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:37.679294 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560da16-ccde-4a3c-bcd1-8a6a92350604 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:37.688781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560da16-ccde-4a3c-bcd1-8a6a92350604 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:37.690226 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560da16-ccde-4a3c-bcd1-8a6a92350604 service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:37.700029 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1209/2410] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:47:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:47:39.056693 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b115ef5-d137-4da9-8a96-c44144688c77 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:39.057246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b115ef5-d137-4da9-8a96-c44144688c77 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:39.057246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b115ef5-d137-4da9-8a96-c44144688c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:39.075897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-3b115ef5-d137-4da9-8a96-c44144688c77 None None] MFA Rules not processed for user `2900dfb691734898a5fd1ac12207cebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:39.077169 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3b115ef5-d137-4da9-8a96-c44144688c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:39.084749 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1202/2411] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:47:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:39.418107 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560da16-ccde-4a3c-bcd1-8a6a92350604 service cinder] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:39.419578 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c560da16-ccde-4a3c-bcd1-8a6a92350604 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:39.434320 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560da16-ccde-4a3c-bcd1-8a6a92350604 service cinder] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:39.438100 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e740df1-58ae-4b37-a94d-7345e0fefb5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:39.438851 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e740df1-58ae-4b37-a94d-7345e0fefb5f service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:39.439199 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e740df1-58ae-4b37-a94d-7345e0fefb5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:39.439545 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e740df1-58ae-4b37-a94d-7345e0fefb5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:39.441449 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-9e740df1-58ae-4b37-a94d-7345e0fefb5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:39.452007 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e740df1-58ae-4b37-a94d-7345e0fefb5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:39.452943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e740df1-58ae-4b37-a94d-7345e0fefb5f service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:39.462904 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1210/2412] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:47:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:47:39.580548 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b115ef5-d137-4da9-8a96-c44144688c77 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:39.581946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3b115ef5-d137-4da9-8a96-c44144688c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:39.654371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b115ef5-d137-4da9-8a96-c44144688c77 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:39.659580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c515d-cd20-4696-860e-db87033a9efd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98915513674460485413c2dbee87fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:39.660304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c515d-cd20-4696-860e-db87033a9efd service placement] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:39.660734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c515d-cd20-4696-860e-db87033a9efd service placement] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:39.661011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c515d-cd20-4696-860e-db87033a9efd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:39.663477 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f03c515d-cd20-4696-860e-db87033a9efd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:39.678150 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c515d-cd20-4696-860e-db87033a9efd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:39.681403 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c515d-cd20-4696-860e-db87033a9efd service placement] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:39.693906 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1203/2413] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:47:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:47:39.723488 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e740df1-58ae-4b37-a94d-7345e0fefb5f service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:39.726774 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-9e740df1-58ae-4b37-a94d-7345e0fefb5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:39.768438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:39.882271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e740df1-58ae-4b37-a94d-7345e0fefb5f service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:39.891318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea0648-30e7-4507-8307-35f22ef004a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:39.892322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea0648-30e7-4507-8307-35f22ef004a5 service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:39.892929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea0648-30e7-4507-8307-35f22ef004a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:39.893187 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea0648-30e7-4507-8307-35f22ef004a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:39.895612 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-baea0648-30e7-4507-8307-35f22ef004a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:39.988448 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea0648-30e7-4507-8307-35f22ef004a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:39.990112 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea0648-30e7-4507-8307-35f22ef004a5 service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:40.000463 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1211/2414] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:47:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:47:43.486651 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52891774-7489-44a3-8528-48d74a89cdc0 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:43.487225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52891774-7489-44a3-8528-48d74a89cdc0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:43.487362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52891774-7489-44a3-8528-48d74a89cdc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:43.502954 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:43.510517 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-52891774-7489-44a3-8528-48d74a89cdc0 None None] MFA Rules not processed for user `d16be8774cb842199cfb9e3b9965bd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:47:43.512106 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-52891774-7489-44a3-8528-48d74a89cdc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:43.579141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1204/2415] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jun 14 19:47:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:47:43.591617 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea0648-30e7-4507-8307-35f22ef004a5 service nova] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:43.593037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-baea0648-30e7-4507-8307-35f22ef004a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:43.666298 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea0648-30e7-4507-8307-35f22ef004a5 service nova] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:43.671431 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1bc94-d79b-4583-ad6b-c4af9a1dfc8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fff5414195f4873bcc8752c914b6b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:43.672075 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1bc94-d79b-4583-ad6b-c4af9a1dfc8a service swift] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:43.672363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1bc94-d79b-4583-ad6b-c4af9a1dfc8a service swift] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:43.672767 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1bc94-d79b-4583-ad6b-c4af9a1dfc8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:43.682424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1bc94-d79b-4583-ad6b-c4af9a1dfc8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:43.684305 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1bc94-d79b-4583-ad6b-c4af9a1dfc8a service swift] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:43.693458 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1212/2416] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jun 14 19:47:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 14 19:47:44.400761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52891774-7489-44a3-8528-48d74a89cdc0 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:44.427357 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52891774-7489-44a3-8528-48d74a89cdc0 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:44.437930 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6e2f7-92d8-41a1-9b94-2288e12eea49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:44.438612 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6e2f7-92d8-41a1-9b94-2288e12eea49 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:44.438900 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6e2f7-92d8-41a1-9b94-2288e12eea49 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:44.441424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6e2f7-92d8-41a1-9b94-2288e12eea49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:44.447921 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d9f6e2f7-92d8-41a1-9b94-2288e12eea49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:44.461963 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6e2f7-92d8-41a1-9b94-2288e12eea49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:44.464215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f6e2f7-92d8-41a1-9b94-2288e12eea49 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:44.480634 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1205/2417] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:47:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:47:47.482617 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1bc94-d79b-4583-ad6b-c4af9a1dfc8a service swift] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:47:47.501610 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1bc94-d79b-4583-ad6b-c4af9a1dfc8a service swift] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:47:47.507435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aac1ab-b1f9-4dc1-8ba6-4128b740620d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:47:47.508111 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aac1ab-b1f9-4dc1-8ba6-4128b740620d service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:47:47.508454 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aac1ab-b1f9-4dc1-8ba6-4128b740620d service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:47:47.508739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aac1ab-b1f9-4dc1-8ba6-4128b740620d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:47:47.510716 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-45aac1ab-b1f9-4dc1-8ba6-4128b740620d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:47:47.565494 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:47.579010 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aac1ab-b1f9-4dc1-8ba6-4128b740620d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:47:47.580548 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aac1ab-b1f9-4dc1-8ba6-4128b740620d service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:47:47.591155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1213/2418] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:47:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:47:54.472225 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=28 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:47:57.586218 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=6 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:02.839561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b214fe9-a65b-4f1d-982b-94b79db529c7 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:02.840141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b214fe9-a65b-4f1d-982b-94b79db529c7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:02.840141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b214fe9-a65b-4f1d-982b-94b79db529c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:02.864246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-7b214fe9-a65b-4f1d-982b-94b79db529c7 None None] MFA Rules not processed for user `d16be8774cb842199cfb9e3b9965bd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:02.865635 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7b214fe9-a65b-4f1d-982b-94b79db529c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:02.875050 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1206/2419] 10.222.0.44 () {58 vars in 967 bytes} [Tue Jun 14 19:48:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:02.891632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aac1ab-b1f9-4dc1-8ba6-4128b740620d service nova] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:02.903574 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aac1ab-b1f9-4dc1-8ba6-4128b740620d service nova] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:02.912979 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe62c4c-6510-4809-be53-8349ad8ee774 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fff5414195f4873bcc8752c914b6b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:02.914337 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe62c4c-6510-4809-be53-8349ad8ee774 service swift] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:02.914584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe62c4c-6510-4809-be53-8349ad8ee774 service swift] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:02.915074 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe62c4c-6510-4809-be53-8349ad8ee774 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:02.924123 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe62c4c-6510-4809-be53-8349ad8ee774 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:02.925743 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe62c4c-6510-4809-be53-8349ad8ee774 service swift] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:02.934229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1214/2420] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jun 14 19:48:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 14 19:48:12.859024 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:12.931219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=6 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:14.158239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b214fe9-a65b-4f1d-982b-94b79db529c7 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:14.168527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b214fe9-a65b-4f1d-982b-94b79db529c7 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:14.172256 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade50d0-1dc3-48d8-9e22-785e73422c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:14.172898 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade50d0-1dc3-48d8-9e22-785e73422c0a service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:14.173183 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade50d0-1dc3-48d8-9e22-785e73422c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:14.173501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade50d0-1dc3-48d8-9e22-785e73422c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:14.175281 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0ade50d0-1dc3-48d8-9e22-785e73422c0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:14.187785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade50d0-1dc3-48d8-9e22-785e73422c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:14.189203 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ade50d0-1dc3-48d8-9e22-785e73422c0a service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:14.199145 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1207/2421] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:17.396056 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe62c4c-6510-4809-be53-8349ad8ee774 service swift] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:17.411034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe62c4c-6510-4809-be53-8349ad8ee774 service swift] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:17.417552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ee28a-5fb1-4623-8c1e-8c9b8c9a86dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98915513674460485413c2dbee87fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:17.418830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ee28a-5fb1-4623-8c1e-8c9b8c9a86dc service placement] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:17.419615 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ee28a-5fb1-4623-8c1e-8c9b8c9a86dc service placement] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:17.420085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ee28a-5fb1-4623-8c1e-8c9b8c9a86dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:17.422233 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-404ee28a-5fb1-4623-8c1e-8c9b8c9a86dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:17.447850 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ee28a-5fb1-4623-8c1e-8c9b8c9a86dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:17.449653 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ee28a-5fb1-4623-8c1e-8c9b8c9a86dc service placement] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:17.464780 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1215/2422] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:17.466022 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade50d0-1dc3-48d8-9e22-785e73422c0a service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:17.467577 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0ade50d0-1dc3-48d8-9e22-785e73422c0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:17.487610 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ade50d0-1dc3-48d8-9e22-785e73422c0a service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:17.494844 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc38b731-d8ad-4515-8e52-26eb336c6d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:17.495826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38b731-d8ad-4515-8e52-26eb336c6d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:17.496143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38b731-d8ad-4515-8e52-26eb336c6d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:17.496615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38b731-d8ad-4515-8e52-26eb336c6d1e admin admin] PATH_INFO: `/v3/users/323c51f037db4ecca2f66cb6e9879246` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:17.498256 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38b731-d8ad-4515-8e52-26eb336c6d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=323c51f037db4ecca2f66cb6e9879246)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:17.500548 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc38b731-d8ad-4515-8e52-26eb336c6d1e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:17.566220 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dc38b731-d8ad-4515-8e52-26eb336c6d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '323c51f037db4ecca2f66cb6e9879246'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:17.566874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dc38b731-d8ad-4515-8e52-26eb336c6d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '323c51f037db4ecca2f66cb6e9879246'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:17.578196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dc38b731-d8ad-4515-8e52-26eb336c6d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '323c51f037db4ecca2f66cb6e9879246'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:17.592089 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dc38b731-d8ad-4515-8e52-26eb336c6d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '323c51f037db4ecca2f66cb6e9879246'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:17.604929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dc38b731-d8ad-4515-8e52-26eb336c6d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '323c51f037db4ecca2f66cb6e9879246'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:17.612704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1208/2423] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:48:17 2022] DELETE /identity/v3/users/323c51f037db4ecca2f66cb6e9879246 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:17.819328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ee28a-5fb1-4623-8c1e-8c9b8c9a86dc service placement] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:17.838004 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ee28a-5fb1-4623-8c1e-8c9b8c9a86dc service placement] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:17.919108 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b35d7-b96c-4ceb-8f0e-82dc47eea5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:17.920066 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b35d7-b96c-4ceb-8f0e-82dc47eea5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:17.920598 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b35d7-b96c-4ceb-8f0e-82dc47eea5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:17.920726 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b35d7-b96c-4ceb-8f0e-82dc47eea5a8 admin admin] PATH_INFO: `/v3/projects/b2b0a8b4f1e44e2da0750dd3f12fbb18` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:17.921859 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b35d7-b96c-4ceb-8f0e-82dc47eea5a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b0a8b4f1e44e2da0750dd3f12fbb18)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:17.923767 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b35d7-b96c-4ceb-8f0e-82dc47eea5a8 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:17.971804 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-343b35d7-b96c-4ceb-8f0e-82dc47eea5a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'request_id': 'req-343b35d7-b96c-4ceb-8f0e-82dc47eea5a8'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:17.978790 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-343b35d7-b96c-4ceb-8f0e-82dc47eea5a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'request_id': 'req-343b35d7-b96c-4ceb-8f0e-82dc47eea5a8'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:17.986315 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-343b35d7-b96c-4ceb-8f0e-82dc47eea5a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b0a8b4f1e44e2da0750dd3f12fbb18', 'request_id': 'req-343b35d7-b96c-4ceb-8f0e-82dc47eea5a8'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:18.000275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-343b35d7-b96c-4ceb-8f0e-82dc47eea5a8 admin admin] The token cache is being invalidate because project b2b0a8b4f1e44e2da0750dd3f12fbb18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:48:18.000565 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-343b35d7-b96c-4ceb-8f0e-82dc47eea5a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:18.006092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-343b35d7-b96c-4ceb-8f0e-82dc47eea5a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:18.013122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1216/2424] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:48:17 2022] DELETE /identity/v3/projects/b2b0a8b4f1e44e2da0750dd3f12fbb18 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:18.014810 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cdad1-3f71-492a-aa91-777664b12f62 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:18.015132 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cdad1-3f71-492a-aa91-777664b12f62 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:18.015429 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cdad1-3f71-492a-aa91-777664b12f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:18.047467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-7f0cdad1-3f71-492a-aa91-777664b12f62 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:18.048671 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7f0cdad1-3f71-492a-aa91-777664b12f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:18.116730 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1209/2425] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:18.125216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efed7a-3350-4d84-bbe3-ca0afcb2da95 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:18.126045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efed7a-3350-4d84-bbe3-ca0afcb2da95 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:18.126328 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efed7a-3350-4d84-bbe3-ca0afcb2da95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:18.147520 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-c2efed7a-3350-4d84-bbe3-ca0afcb2da95 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:18.149352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c2efed7a-3350-4d84-bbe3-ca0afcb2da95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:18.158419 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1217/2426] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:48:18.164609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cdad1-3f71-492a-aa91-777664b12f62 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:18.176754 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cdad1-3f71-492a-aa91-777664b12f62 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:18.181568 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe82e59-1cbc-49a4-9bdc-c8e627683141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:18.182234 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe82e59-1cbc-49a4-9bdc-c8e627683141 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:18.182518 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe82e59-1cbc-49a4-9bdc-c8e627683141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:18.182791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe82e59-1cbc-49a4-9bdc-c8e627683141 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:18.183520 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe82e59-1cbc-49a4-9bdc-c8e627683141 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:48:18.183827 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe82e59-1cbc-49a4-9bdc-c8e627683141 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:18.185462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe82e59-1cbc-49a4-9bdc-c8e627683141 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:18.201550 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1210/2427] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:48:18.202720 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efed7a-3350-4d84-bbe3-ca0afcb2da95 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:18.213713 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efed7a-3350-4d84-bbe3-ca0afcb2da95 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:18.218938 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f15f0-6616-4522-9a02-0c4100e32d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:18.219684 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f15f0-6616-4522-9a02-0c4100e32d67 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:18.220089 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f15f0-6616-4522-9a02-0c4100e32d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:18.220389 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f15f0-6616-4522-9a02-0c4100e32d67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:18.221502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f15f0-6616-4522-9a02-0c4100e32d67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:18.223063 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f15f0-6616-4522-9a02-0c4100e32d67 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:18.267269 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1218/2428] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:48:18 2022] POST /identity/v3/projects => generated 403 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:18.268493 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe82e59-1cbc-49a4-9bdc-c8e627683141 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:18.282239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe82e59-1cbc-49a4-9bdc-c8e627683141 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:18.331742 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:18.349064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbfebc-3a93-46c2-a649-7112aa684894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:18.349770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbfebc-3a93-46c2-a649-7112aa684894 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:18.350064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbfebc-3a93-46c2-a649-7112aa684894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:18.350345 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cbfebc-3a93-46c2-a649-7112aa684894 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:18.351760 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbfebc-3a93-46c2-a649-7112aa684894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:18.353745 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cbfebc-3a93-46c2-a649-7112aa684894 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:18.377490 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1211/2429] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:48:18 2022] POST /identity/v3/users => generated 302 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:18.380337 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f15f0-6616-4522-9a02-0c4100e32d67 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:18.391289 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f15f0-6616-4522-9a02-0c4100e32d67 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:18.395863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6610810-bb97-4a9a-8808-8f193c5a3cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:18.396514 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6610810-bb97-4a9a-8808-8f193c5a3cde admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:18.397320 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6610810-bb97-4a9a-8808-8f193c5a3cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:18.397320 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6610810-bb97-4a9a-8808-8f193c5a3cde admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:18.398142 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6610810-bb97-4a9a-8808-8f193c5a3cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:18.399727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6610810-bb97-4a9a-8808-8f193c5a3cde admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:18.409736 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1219/2430] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:18.413815 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbfebc-3a93-46c2-a649-7112aa684894 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:18.423947 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cbfebc-3a93-46c2-a649-7112aa684894 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:18.428850 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e8811-879a-44fd-8aba-9912cedcad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:18.430203 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e8811-879a-44fd-8aba-9912cedcad9e admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:18.430485 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e8811-879a-44fd-8aba-9912cedcad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:18.430751 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e8811-879a-44fd-8aba-9912cedcad9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:18.431499 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e8811-879a-44fd-8aba-9912cedcad9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:18.433267 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e8811-879a-44fd-8aba-9912cedcad9e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:18.448914 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6610810-bb97-4a9a-8808-8f193c5a3cde admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:18.449498 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1212/2431] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:18.459767 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6610810-bb97-4a9a-8808-8f193c5a3cde admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:18.464456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5d71e-3b8e-463f-87e7-83e4ae9cc64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:18.465333 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5d71e-3b8e-463f-87e7-83e4ae9cc64d admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:18.465645 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5d71e-3b8e-463f-87e7-83e4ae9cc64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:18.465926 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5d71e-3b8e-463f-87e7-83e4ae9cc64d admin admin] PATH_INFO: `/v3/projects/f378cb0a8d1c4fd98debe38a8d0f963a/users/4b6ccae356514b83a29899d9623b6cca/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:18.483273 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5d71e-3b8e-463f-87e7-83e4ae9cc64d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f378cb0a8d1c4fd98debe38a8d0f963a, user_id=4b6ccae356514b83a29899d9623b6cca, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:18.486305 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5d71e-3b8e-463f-87e7-83e4ae9cc64d admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:18.505471 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1220/2432] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:48:18 2022] PUT /identity/v3/projects/f378cb0a8d1c4fd98debe38a8d0f963a/users/4b6ccae356514b83a29899d9623b6cca/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:18.515843 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90178054-b12d-47fb-a05c-ed83484d5687 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:18.516318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90178054-b12d-47fb-a05c-ed83484d5687 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:18.516643 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90178054-b12d-47fb-a05c-ed83484d5687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:18.545695 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-90178054-b12d-47fb-a05c-ed83484d5687 None None] MFA Rules not processed for user `4b6ccae356514b83a29899d9623b6cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:18.546813 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-90178054-b12d-47fb-a05c-ed83484d5687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:18.611504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1213/2433] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:18.615954 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5d71e-3b8e-463f-87e7-83e4ae9cc64d admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:18.622255 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:18.684953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5d71e-3b8e-463f-87e7-83e4ae9cc64d admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:18.689651 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc298a92-7fdf-46ff-bdfd-cfa35aa4c9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:18.690312 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc298a92-7fdf-46ff-bdfd-cfa35aa4c9fe admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:18.690599 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc298a92-7fdf-46ff-bdfd-cfa35aa4c9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:18.690901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc298a92-7fdf-46ff-bdfd-cfa35aa4c9fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:18.691599 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc298a92-7fdf-46ff-bdfd-cfa35aa4c9fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:18.693524 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc298a92-7fdf-46ff-bdfd-cfa35aa4c9fe admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:18.718454 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1221/2434] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:48:18 2022] POST /identity/v3/projects => generated 405 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:18.722437 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90178054-b12d-47fb-a05c-ed83484d5687 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:18.733612 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90178054-b12d-47fb-a05c-ed83484d5687 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:18.789770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce97e7-89b5-4fc9-a9d7-5600149c51e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:18.790351 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce97e7-89b5-4fc9-a9d7-5600149c51e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:18.790637 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce97e7-89b5-4fc9-a9d7-5600149c51e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:18.790917 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce97e7-89b5-4fc9-a9d7-5600149c51e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:18.791613 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce97e7-89b5-4fc9-a9d7-5600149c51e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:18.793575 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce97e7-89b5-4fc9-a9d7-5600149c51e3 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:18.813581 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1214/2435] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:48:18 2022] POST /identity/v3/users => generated 309 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:18.817443 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc298a92-7fdf-46ff-bdfd-cfa35aa4c9fe admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:18.828155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc298a92-7fdf-46ff-bdfd-cfa35aa4c9fe admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:18.832760 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ce8f8-9551-428f-ae41-c3ff430a31a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:18.833441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ce8f8-9551-428f-ae41-c3ff430a31a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:18.833726 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ce8f8-9551-428f-ae41-c3ff430a31a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:18.834000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2ce8f8-9551-428f-ae41-c3ff430a31a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:18.834720 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ce8f8-9551-428f-ae41-c3ff430a31a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:18.836564 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2ce8f8-9551-428f-ae41-c3ff430a31a3 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:18.847059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1222/2436] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:18.852109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce97e7-89b5-4fc9-a9d7-5600149c51e3 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:18.861701 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce97e7-89b5-4fc9-a9d7-5600149c51e3 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:18.866296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cf60f-83d2-405f-a15a-22048c175752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:18.867851 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cf60f-83d2-405f-a15a-22048c175752 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:18.868216 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cf60f-83d2-405f-a15a-22048c175752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:18.868526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cf60f-83d2-405f-a15a-22048c175752 admin admin] PATH_INFO: `/v3/projects/ca590317f39d4af89d0d5e75476da8e0/users/30822ad51c814b91a47fe43656a873cf/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:18.883286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cf60f-83d2-405f-a15a-22048c175752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca590317f39d4af89d0d5e75476da8e0, user_id=30822ad51c814b91a47fe43656a873cf, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:18.886017 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cf60f-83d2-405f-a15a-22048c175752 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:18.898696 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1215/2437] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:48:18 2022] PUT /identity/v3/projects/ca590317f39d4af89d0d5e75476da8e0/users/30822ad51c814b91a47fe43656a873cf/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:18.902687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ce8f8-9551-428f-ae41-c3ff430a31a3 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:18.912905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2ce8f8-9551-428f-ae41-c3ff430a31a3 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:18.971562 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bef06-61b0-4e74-a52c-14f0b14eee4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:18.972226 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bef06-61b0-4e74-a52c-14f0b14eee4e admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:18.972507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bef06-61b0-4e74-a52c-14f0b14eee4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:18.972784 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bef06-61b0-4e74-a52c-14f0b14eee4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:18.973533 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bef06-61b0-4e74-a52c-14f0b14eee4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:18.975105 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70bef06-61b0-4e74-a52c-14f0b14eee4e admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:18.985269 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1223/2438] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:18.989280 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cf60f-83d2-405f-a15a-22048c175752 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:19.000248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cf60f-83d2-405f-a15a-22048c175752 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:19.004901 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e01c91-df39-4b45-b52b-76aa9f44df5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:19.005811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e01c91-df39-4b45-b52b-76aa9f44df5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:19.006107 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e01c91-df39-4b45-b52b-76aa9f44df5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:19.006369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e01c91-df39-4b45-b52b-76aa9f44df5f admin admin] PATH_INFO: `/v3/projects/ca590317f39d4af89d0d5e75476da8e0/users/30822ad51c814b91a47fe43656a873cf/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:19.008348 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e01c91-df39-4b45-b52b-76aa9f44df5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca590317f39d4af89d0d5e75476da8e0, user_id=30822ad51c814b91a47fe43656a873cf, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:19.011028 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e01c91-df39-4b45-b52b-76aa9f44df5f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:19.021475 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1216/2439] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:48:18 2022] PUT /identity/v3/projects/ca590317f39d4af89d0d5e75476da8e0/users/30822ad51c814b91a47fe43656a873cf/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:19.033622 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054722b9-9340-43ee-b8ae-f6a76bcb1c90 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:19.034015 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054722b9-9340-43ee-b8ae-f6a76bcb1c90 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:19.034378 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054722b9-9340-43ee-b8ae-f6a76bcb1c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:19.061453 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-054722b9-9340-43ee-b8ae-f6a76bcb1c90 None None] MFA Rules not processed for user `30822ad51c814b91a47fe43656a873cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:19.063195 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-054722b9-9340-43ee-b8ae-f6a76bcb1c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:19.127140 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:19.133960 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1224/2440] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:19 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:19.142205 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e01c91-df39-4b45-b52b-76aa9f44df5f admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:19.143944 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-27e01c91-df39-4b45-b52b-76aa9f44df5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:19.154708 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:19.203722 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e01c91-df39-4b45-b52b-76aa9f44df5f admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:19.207354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f50617-8686-481c-b8e7-eabd48a38a10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:19.207987 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f50617-8686-481c-b8e7-eabd48a38a10 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:19.208270 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f50617-8686-481c-b8e7-eabd48a38a10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:19.208549 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f50617-8686-481c-b8e7-eabd48a38a10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:19.218177 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f50617-8686-481c-b8e7-eabd48a38a10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:19.219613 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f50617-8686-481c-b8e7-eabd48a38a10 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:19.229737 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1217/2441] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:19 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:19.360986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054722b9-9340-43ee-b8ae-f6a76bcb1c90 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:19.425130 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054722b9-9340-43ee-b8ae-f6a76bcb1c90 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:19.430564 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683475a1-3568-4779-9cb7-1087f00af51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:19.431460 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683475a1-3568-4779-9cb7-1087f00af51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:19.431744 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683475a1-3568-4779-9cb7-1087f00af51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:19.432024 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683475a1-3568-4779-9cb7-1087f00af51d admin admin] PATH_INFO: `/v3/users/4b6ccae356514b83a29899d9623b6cca` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:19.433236 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683475a1-3568-4779-9cb7-1087f00af51d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b6ccae356514b83a29899d9623b6cca)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:19.435222 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683475a1-3568-4779-9cb7-1087f00af51d admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:19.481713 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-683475a1-3568-4779-9cb7-1087f00af51d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b6ccae356514b83a29899d9623b6cca'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:19.482371 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-683475a1-3568-4779-9cb7-1087f00af51d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b6ccae356514b83a29899d9623b6cca'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:19.489205 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-683475a1-3568-4779-9cb7-1087f00af51d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b6ccae356514b83a29899d9623b6cca'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:19.496625 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-683475a1-3568-4779-9cb7-1087f00af51d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b6ccae356514b83a29899d9623b6cca'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:19.509052 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-683475a1-3568-4779-9cb7-1087f00af51d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b6ccae356514b83a29899d9623b6cca'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:19.514934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1225/2442] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:48:19 2022] DELETE /identity/v3/users/4b6ccae356514b83a29899d9623b6cca => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:19.519370 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b6ad2-87bb-48be-b3b0-8a2b25a81ecb None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:19.519909 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b6ad2-87bb-48be-b3b0-8a2b25a81ecb None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:19.519909 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b6ad2-87bb-48be-b3b0-8a2b25a81ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:19.538092 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-675b6ad2-87bb-48be-b3b0-8a2b25a81ecb None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:19.539423 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-675b6ad2-87bb-48be-b3b0-8a2b25a81ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:19.599214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1218/2443] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:19.609560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683475a1-3568-4779-9cb7-1087f00af51d admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:19.611017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-683475a1-3568-4779-9cb7-1087f00af51d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:19.669418 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683475a1-3568-4779-9cb7-1087f00af51d admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:19.673354 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8958a-6b89-4ed0-a4ea-8e7ca57a807a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:19.674175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8958a-6b89-4ed0-a4ea-8e7ca57a807a service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:19.674760 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8958a-6b89-4ed0-a4ea-8e7ca57a807a service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:19.674855 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8958a-6b89-4ed0-a4ea-8e7ca57a807a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:19.686457 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8958a-6b89-4ed0-a4ea-8e7ca57a807a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:19.687884 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b8958a-6b89-4ed0-a4ea-8e7ca57a807a service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:19.697870 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1226/2444] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:20.052346 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b6ad2-87bb-48be-b3b0-8a2b25a81ecb None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:20.054520 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-675b6ad2-87bb-48be-b3b0-8a2b25a81ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:20.067243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b6ad2-87bb-48be-b3b0-8a2b25a81ecb None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:20.072289 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a32e9-1609-4b95-9a3b-fd5608dfbe9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:20.073148 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a32e9-1609-4b95-9a3b-fd5608dfbe9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:20.074020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a32e9-1609-4b95-9a3b-fd5608dfbe9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:20.074299 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a32e9-1609-4b95-9a3b-fd5608dfbe9b admin admin] PATH_INFO: `/v3/projects/f378cb0a8d1c4fd98debe38a8d0f963a` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:20.075673 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a32e9-1609-4b95-9a3b-fd5608dfbe9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f378cb0a8d1c4fd98debe38a8d0f963a)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:20.077785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1a32e9-1609-4b95-9a3b-fd5608dfbe9b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:20.125232 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3c1a32e9-1609-4b95-9a3b-fd5608dfbe9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f378cb0a8d1c4fd98debe38a8d0f963a', 'request_id': 'req-3c1a32e9-1609-4b95-9a3b-fd5608dfbe9b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:20.130675 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3c1a32e9-1609-4b95-9a3b-fd5608dfbe9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f378cb0a8d1c4fd98debe38a8d0f963a', 'request_id': 'req-3c1a32e9-1609-4b95-9a3b-fd5608dfbe9b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:20.138081 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3c1a32e9-1609-4b95-9a3b-fd5608dfbe9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f378cb0a8d1c4fd98debe38a8d0f963a', 'request_id': 'req-3c1a32e9-1609-4b95-9a3b-fd5608dfbe9b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:20.150312 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3c1a32e9-1609-4b95-9a3b-fd5608dfbe9b admin admin] The token cache is being invalidate because project f378cb0a8d1c4fd98debe38a8d0f963a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:48:20.150603 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3c1a32e9-1609-4b95-9a3b-fd5608dfbe9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:20.151235 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-3c1a32e9-1609-4b95-9a3b-fd5608dfbe9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:20.152757 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1219/2445] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:48:20 2022] DELETE /identity/v3/projects/f378cb0a8d1c4fd98debe38a8d0f963a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:20.156813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8958a-6b89-4ed0-a4ea-8e7ca57a807a service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:20.167282 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8958a-6b89-4ed0-a4ea-8e7ca57a807a service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:20.185042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:20.225676 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19829019-8a5f-492d-b43f-7ee4da7b1bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:20.226691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19829019-8a5f-492d-b43f-7ee4da7b1bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:20.226978 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19829019-8a5f-492d-b43f-7ee4da7b1bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:20.227261 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19829019-8a5f-492d-b43f-7ee4da7b1bdb admin admin] PATH_INFO: `/v3/users/30822ad51c814b91a47fe43656a873cf` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:20.228441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19829019-8a5f-492d-b43f-7ee4da7b1bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=30822ad51c814b91a47fe43656a873cf)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:20.230404 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19829019-8a5f-492d-b43f-7ee4da7b1bdb admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:20.276315 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-19829019-8a5f-492d-b43f-7ee4da7b1bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30822ad51c814b91a47fe43656a873cf'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:20.276959 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-19829019-8a5f-492d-b43f-7ee4da7b1bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30822ad51c814b91a47fe43656a873cf'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:20.284411 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-19829019-8a5f-492d-b43f-7ee4da7b1bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30822ad51c814b91a47fe43656a873cf'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:20.291845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-19829019-8a5f-492d-b43f-7ee4da7b1bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30822ad51c814b91a47fe43656a873cf'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:20.305037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-19829019-8a5f-492d-b43f-7ee4da7b1bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30822ad51c814b91a47fe43656a873cf'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:20.311068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1227/2446] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:48:20 2022] DELETE /identity/v3/users/30822ad51c814b91a47fe43656a873cf => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:20.615652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a32e9-1609-4b95-9a3b-fd5608dfbe9b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:20.617772 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3c1a32e9-1609-4b95-9a3b-fd5608dfbe9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:20.631142 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1a32e9-1609-4b95-9a3b-fd5608dfbe9b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:20.668386 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:20.697472 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf213e-e9a9-4df2-94be-1e924e1e3364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:20.698413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf213e-e9a9-4df2-94be-1e924e1e3364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:20.698779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf213e-e9a9-4df2-94be-1e924e1e3364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:20.699116 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf213e-e9a9-4df2-94be-1e924e1e3364 admin admin] PATH_INFO: `/v3/projects/ca590317f39d4af89d0d5e75476da8e0` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:20.700388 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf213e-e9a9-4df2-94be-1e924e1e3364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca590317f39d4af89d0d5e75476da8e0)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:20.702417 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf213e-e9a9-4df2-94be-1e924e1e3364 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:20.750183 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9baf213e-e9a9-4df2-94be-1e924e1e3364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca590317f39d4af89d0d5e75476da8e0', 'request_id': 'req-9baf213e-e9a9-4df2-94be-1e924e1e3364'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:20.755831 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9baf213e-e9a9-4df2-94be-1e924e1e3364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca590317f39d4af89d0d5e75476da8e0', 'request_id': 'req-9baf213e-e9a9-4df2-94be-1e924e1e3364'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:20.763784 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9baf213e-e9a9-4df2-94be-1e924e1e3364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca590317f39d4af89d0d5e75476da8e0', 'request_id': 'req-9baf213e-e9a9-4df2-94be-1e924e1e3364'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:20.776414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9baf213e-e9a9-4df2-94be-1e924e1e3364 admin admin] The token cache is being invalidate because project ca590317f39d4af89d0d5e75476da8e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:48:20.776701 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9baf213e-e9a9-4df2-94be-1e924e1e3364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:20.777334 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9baf213e-e9a9-4df2-94be-1e924e1e3364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:20.778895 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1220/2447] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:48:20 2022] DELETE /identity/v3/projects/ca590317f39d4af89d0d5e75476da8e0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:20.783799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768344f-1a01-4951-a077-1ed7753dff84 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:20.784276 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768344f-1a01-4951-a077-1ed7753dff84 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:20.784437 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768344f-1a01-4951-a077-1ed7753dff84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:20.803498 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-4768344f-1a01-4951-a077-1ed7753dff84 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:20.805523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-4768344f-1a01-4951-a077-1ed7753dff84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:20.875413 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1228/2448] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:20.883438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98565df3-e8af-4f42-852c-9c438179378c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:20.883835 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98565df3-e8af-4f42-852c-9c438179378c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:20.884209 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98565df3-e8af-4f42-852c-9c438179378c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:20.903881 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-98565df3-e8af-4f42-852c-9c438179378c None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:20.905232 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-98565df3-e8af-4f42-852c-9c438179378c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:20.917610 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1221/2449] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:20.920472 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768344f-1a01-4951-a077-1ed7753dff84 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:20.937749 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768344f-1a01-4951-a077-1ed7753dff84 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:20.943552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773154bd-3d8b-4fd5-a2e1-0f4193f1ff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:20.944267 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773154bd-3d8b-4fd5-a2e1-0f4193f1ff4a admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:20.945352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773154bd-3d8b-4fd5-a2e1-0f4193f1ff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:20.945732 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773154bd-3d8b-4fd5-a2e1-0f4193f1ff4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:20.946750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773154bd-3d8b-4fd5-a2e1-0f4193f1ff4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:48:20.947088 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773154bd-3d8b-4fd5-a2e1-0f4193f1ff4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:20.949208 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773154bd-3d8b-4fd5-a2e1-0f4193f1ff4a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:20.964851 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1229/2450] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:48:20.969468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98565df3-e8af-4f42-852c-9c438179378c None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:20.980191 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98565df3-e8af-4f42-852c-9c438179378c None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:20.985773 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14734883-48dd-4cf3-9a0a-706da4ce87a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:20.986526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14734883-48dd-4cf3-9a0a-706da4ce87a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:20.987318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14734883-48dd-4cf3-9a0a-706da4ce87a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:20.987318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14734883-48dd-4cf3-9a0a-706da4ce87a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:20.988634 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14734883-48dd-4cf3-9a0a-706da4ce87a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:20.993580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14734883-48dd-4cf3-9a0a-706da4ce87a3 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:21.028859 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1222/2451] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:48:20 2022] POST /identity/v3/projects => generated 353 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:21.029424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773154bd-3d8b-4fd5-a2e1-0f4193f1ff4a admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:21.052465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773154bd-3d8b-4fd5-a2e1-0f4193f1ff4a admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:21.108478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:21.143360 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfd16f-5049-4616-92c4-796b3fdee7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:21.144064 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfd16f-5049-4616-92c4-796b3fdee7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:21.144354 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfd16f-5049-4616-92c4-796b3fdee7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:21.144637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cfd16f-5049-4616-92c4-796b3fdee7d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:21.145411 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfd16f-5049-4616-92c4-796b3fdee7d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:21.147624 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cfd16f-5049-4616-92c4-796b3fdee7d3 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:21.172503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1230/2452] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:48:21 2022] POST /identity/v3/users => generated 277 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:48:21.173797 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14734883-48dd-4cf3-9a0a-706da4ce87a3 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:21.185007 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14734883-48dd-4cf3-9a0a-706da4ce87a3 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:21.189677 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ab894-934f-4482-9149-409663aef1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:21.190330 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ab894-934f-4482-9149-409663aef1ef admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:21.190612 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ab894-934f-4482-9149-409663aef1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:21.190889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ab894-934f-4482-9149-409663aef1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:21.191607 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ab894-934f-4482-9149-409663aef1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:21.193192 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ab894-934f-4482-9149-409663aef1ef admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:21.204238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1223/2453] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:21.208577 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfd16f-5049-4616-92c4-796b3fdee7d3 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:21.219090 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cfd16f-5049-4616-92c4-796b3fdee7d3 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:21.223621 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a796b6-0b79-4af1-96b4-77d9c01f0bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:21.224274 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a796b6-0b79-4af1-96b4-77d9c01f0bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:21.224552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a796b6-0b79-4af1-96b4-77d9c01f0bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:21.224838 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a796b6-0b79-4af1-96b4-77d9c01f0bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:21.225573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a796b6-0b79-4af1-96b4-77d9c01f0bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:21.228277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a796b6-0b79-4af1-96b4-77d9c01f0bd8 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:21.238523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1231/2454] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:48:21.244628 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ab894-934f-4482-9149-409663aef1ef admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:21.255347 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ab894-934f-4482-9149-409663aef1ef admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:21.260520 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb689e3-fa91-4bf1-a1a1-33a47116d8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:21.261440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb689e3-fa91-4bf1-a1a1-33a47116d8fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:21.261723 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb689e3-fa91-4bf1-a1a1-33a47116d8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:21.261998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb689e3-fa91-4bf1-a1a1-33a47116d8fc admin admin] PATH_INFO: `/v3/projects/28b1942d408d4f9f8e5b0cc28ed0e7b9/users/454d3ef42bd7472494d6ac436a07e560/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:21.278614 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb689e3-fa91-4bf1-a1a1-33a47116d8fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b1942d408d4f9f8e5b0cc28ed0e7b9, user_id=454d3ef42bd7472494d6ac436a07e560, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:21.281304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb689e3-fa91-4bf1-a1a1-33a47116d8fc admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:21.297712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1224/2455] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:48:21 2022] PUT /identity/v3/projects/28b1942d408d4f9f8e5b0cc28ed0e7b9/users/454d3ef42bd7472494d6ac436a07e560/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:21.308596 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8a472-8419-4d00-acac-6335f0c35a07 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:21.308908 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8a472-8419-4d00-acac-6335f0c35a07 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:21.309172 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8a472-8419-4d00-acac-6335f0c35a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:21.341828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-71a8a472-8419-4d00-acac-6335f0c35a07 None None] MFA Rules not processed for user `454d3ef42bd7472494d6ac436a07e560`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:21.343049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-71a8a472-8419-4d00-acac-6335f0c35a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:21.462250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1232/2456] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:21 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:21.466283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb689e3-fa91-4bf1-a1a1-33a47116d8fc admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:21.548248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb689e3-fa91-4bf1-a1a1-33a47116d8fc admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:21.560019 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106089a-afa7-46dd-b636-5f55c8f3024e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:21.560995 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106089a-afa7-46dd-b636-5f55c8f3024e admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:21.561470 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106089a-afa7-46dd-b636-5f55c8f3024e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:21.561912 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106089a-afa7-46dd-b636-5f55c8f3024e admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:21.562786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106089a-afa7-46dd-b636-5f55c8f3024e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:21.564913 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e106089a-afa7-46dd-b636-5f55c8f3024e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:21.568740 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:21.597430 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1225/2457] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:48:21 2022] POST /identity/v3/projects => generated 355 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:21.601828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8a472-8419-4d00-acac-6335f0c35a07 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:21.613725 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8a472-8419-4d00-acac-6335f0c35a07 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:21.672878 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385e1b1-041d-42f7-81a4-434d99cec384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:21.673653 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385e1b1-041d-42f7-81a4-434d99cec384 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:21.673940 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385e1b1-041d-42f7-81a4-434d99cec384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:21.674239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385e1b1-041d-42f7-81a4-434d99cec384 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:21.674907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385e1b1-041d-42f7-81a4-434d99cec384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:21.677002 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385e1b1-041d-42f7-81a4-434d99cec384 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:21.700957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1233/2458] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:48:21 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:21.702164 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106089a-afa7-46dd-b636-5f55c8f3024e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:21.712442 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106089a-afa7-46dd-b636-5f55c8f3024e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:21.717216 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8ca60-7e7a-4034-86c5-f383d7b2da48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:21.717900 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8ca60-7e7a-4034-86c5-f383d7b2da48 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:21.718185 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8ca60-7e7a-4034-86c5-f383d7b2da48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:21.718461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8ca60-7e7a-4034-86c5-f383d7b2da48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:21.719187 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8ca60-7e7a-4034-86c5-f383d7b2da48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:21.720787 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8ca60-7e7a-4034-86c5-f383d7b2da48 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:21.731933 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1226/2459] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:21.736345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385e1b1-041d-42f7-81a4-434d99cec384 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:21.747889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385e1b1-041d-42f7-81a4-434d99cec384 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:21.752506 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c152db0-fe78-463b-948c-2d99defcc49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:21.753400 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c152db0-fe78-463b-948c-2d99defcc49e admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:21.753688 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c152db0-fe78-463b-948c-2d99defcc49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:21.753970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c152db0-fe78-463b-948c-2d99defcc49e admin admin] PATH_INFO: `/v3/projects/6364d8dbb1e3454682e15063f403aaf1/users/2fc28eb8dd77410d8fc7d8875e0d410d/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:21.770300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c152db0-fe78-463b-948c-2d99defcc49e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6364d8dbb1e3454682e15063f403aaf1, user_id=2fc28eb8dd77410d8fc7d8875e0d410d, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:21.773464 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c152db0-fe78-463b-948c-2d99defcc49e admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:21.786814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1234/2460] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:48:21 2022] PUT /identity/v3/projects/6364d8dbb1e3454682e15063f403aaf1/users/2fc28eb8dd77410d8fc7d8875e0d410d/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:21.792244 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8ca60-7e7a-4034-86c5-f383d7b2da48 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:21.802816 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8ca60-7e7a-4034-86c5-f383d7b2da48 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:21.873441 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44d97d-4033-4cf3-a9ba-a5160ba79303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:21.874120 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44d97d-4033-4cf3-a9ba-a5160ba79303 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:21.874408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44d97d-4033-4cf3-a9ba-a5160ba79303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:21.874835 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44d97d-4033-4cf3-a9ba-a5160ba79303 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:21.875566 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44d97d-4033-4cf3-a9ba-a5160ba79303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:21.877234 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44d97d-4033-4cf3-a9ba-a5160ba79303 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:21.888161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1227/2461] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:21.892245 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c152db0-fe78-463b-948c-2d99defcc49e admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:21.898882 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:21.904518 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c152db0-fe78-463b-948c-2d99defcc49e admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:21.910664 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48304bb7-2cfc-4d6d-a0f1-82b0cfa11fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:21.912096 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48304bb7-2cfc-4d6d-a0f1-82b0cfa11fac admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:21.912480 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48304bb7-2cfc-4d6d-a0f1-82b0cfa11fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:21.912829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48304bb7-2cfc-4d6d-a0f1-82b0cfa11fac admin admin] PATH_INFO: `/v3/projects/6364d8dbb1e3454682e15063f403aaf1/users/2fc28eb8dd77410d8fc7d8875e0d410d/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:21.916778 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48304bb7-2cfc-4d6d-a0f1-82b0cfa11fac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6364d8dbb1e3454682e15063f403aaf1, user_id=2fc28eb8dd77410d8fc7d8875e0d410d, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:21.919690 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48304bb7-2cfc-4d6d-a0f1-82b0cfa11fac admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:21.934072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1235/2462] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:48:21 2022] PUT /identity/v3/projects/6364d8dbb1e3454682e15063f403aaf1/users/2fc28eb8dd77410d8fc7d8875e0d410d/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:21.945443 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269c6fd-82ec-4237-baf3-a9f4a27c22c5 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:21.945812 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269c6fd-82ec-4237-baf3-a9f4a27c22c5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:21.946082 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269c6fd-82ec-4237-baf3-a9f4a27c22c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:21.974219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0269c6fd-82ec-4237-baf3-a9f4a27c22c5 None None] MFA Rules not processed for user `2fc28eb8dd77410d8fc7d8875e0d410d`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:21.975423 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0269c6fd-82ec-4237-baf3-a9f4a27c22c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:22.046603 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1228/2463] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:21 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:22.058255 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48304bb7-2cfc-4d6d-a0f1-82b0cfa11fac admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:22.060149 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-48304bb7-2cfc-4d6d-a0f1-82b0cfa11fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:22.142711 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48304bb7-2cfc-4d6d-a0f1-82b0cfa11fac admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:22.146898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd92f93-dc7a-4978-8b6b-741fde331fb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:22.147904 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd92f93-dc7a-4978-8b6b-741fde331fb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:22.148331 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd92f93-dc7a-4978-8b6b-741fde331fb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:22.148700 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd92f93-dc7a-4978-8b6b-741fde331fb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:22.159860 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd92f93-dc7a-4978-8b6b-741fde331fb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:22.161322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd92f93-dc7a-4978-8b6b-741fde331fb7 service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:22.171723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1236/2464] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:22 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:22.247864 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269c6fd-82ec-4237-baf3-a9f4a27c22c5 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:22.259222 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269c6fd-82ec-4237-baf3-a9f4a27c22c5 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:22.265184 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af9dcf-0f3b-452f-9097-7f83695f9e66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:22.266113 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af9dcf-0f3b-452f-9097-7f83695f9e66 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:22.266400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af9dcf-0f3b-452f-9097-7f83695f9e66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:22.266678 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af9dcf-0f3b-452f-9097-7f83695f9e66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:22.338378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:22.342630 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af9dcf-0f3b-452f-9097-7f83695f9e66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:22.347076 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af9dcf-0f3b-452f-9097-7f83695f9e66 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:22.358287 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1229/2465] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:22 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:26.339502 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd92f93-dc7a-4978-8b6b-741fde331fb7 service cinder] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:26.340907 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-cbd92f93-dc7a-4978-8b6b-741fde331fb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:26.400224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd92f93-dc7a-4978-8b6b-741fde331fb7 service cinder] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:26.404052 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06b3d7-4b42-45af-98bf-7e6cd62e4358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:26.404700 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06b3d7-4b42-45af-98bf-7e6cd62e4358 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:26.404988 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06b3d7-4b42-45af-98bf-7e6cd62e4358 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:26.405268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06b3d7-4b42-45af-98bf-7e6cd62e4358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:26.407125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-5e06b3d7-4b42-45af-98bf-7e6cd62e4358 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:26.476089 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06b3d7-4b42-45af-98bf-7e6cd62e4358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:26.478653 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06b3d7-4b42-45af-98bf-7e6cd62e4358 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:26.489750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1237/2466] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:29.681920 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af9dcf-0f3b-452f-9097-7f83695f9e66 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:29.683902 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-96af9dcf-0f3b-452f-9097-7f83695f9e66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:29.699530 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af9dcf-0f3b-452f-9097-7f83695f9e66 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:29.706178 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0183a0-579d-4560-af50-3f3c040005ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:29.707444 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0183a0-579d-4560-af50-3f3c040005ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:29.707731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0183a0-579d-4560-af50-3f3c040005ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:29.708131 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0183a0-579d-4560-af50-3f3c040005ec admin admin] PATH_INFO: `/v3/users/18261f10678a4ce99626794c39bb5d7f` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:29.709341 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0183a0-579d-4560-af50-3f3c040005ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=18261f10678a4ce99626794c39bb5d7f)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:29.711983 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0183a0-579d-4560-af50-3f3c040005ec admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:29.768332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0d0183a0-579d-4560-af50-3f3c040005ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18261f10678a4ce99626794c39bb5d7f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:29.768997 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0d0183a0-579d-4560-af50-3f3c040005ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18261f10678a4ce99626794c39bb5d7f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:29.779604 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0d0183a0-579d-4560-af50-3f3c040005ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18261f10678a4ce99626794c39bb5d7f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:29.790687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0d0183a0-579d-4560-af50-3f3c040005ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18261f10678a4ce99626794c39bb5d7f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:29.807270 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0d0183a0-579d-4560-af50-3f3c040005ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18261f10678a4ce99626794c39bb5d7f'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:29.813659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1230/2467] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:48:29 2022] DELETE /identity/v3/users/18261f10678a4ce99626794c39bb5d7f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:30.018792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06b3d7-4b42-45af-98bf-7e6cd62e4358 service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:30.030315 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06b3d7-4b42-45af-98bf-7e6cd62e4358 service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:30.083441 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:30.102311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8a413-0f92-4cdf-a67b-1ae57fa1bd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:30.103185 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8a413-0f92-4cdf-a67b-1ae57fa1bd54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:30.103471 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8a413-0f92-4cdf-a67b-1ae57fa1bd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:30.103753 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8a413-0f92-4cdf-a67b-1ae57fa1bd54 admin admin] PATH_INFO: `/v3/projects/f4aa8aab8447434b8619c3b7bb0b585a` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:30.104936 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8a413-0f92-4cdf-a67b-1ae57fa1bd54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4aa8aab8447434b8619c3b7bb0b585a)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:30.106858 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8a413-0f92-4cdf-a67b-1ae57fa1bd54 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:30.155525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-cda8a413-0f92-4cdf-a67b-1ae57fa1bd54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4aa8aab8447434b8619c3b7bb0b585a', 'request_id': 'req-cda8a413-0f92-4cdf-a67b-1ae57fa1bd54'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:30.161165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-cda8a413-0f92-4cdf-a67b-1ae57fa1bd54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4aa8aab8447434b8619c3b7bb0b585a', 'request_id': 'req-cda8a413-0f92-4cdf-a67b-1ae57fa1bd54'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:30.168921 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-cda8a413-0f92-4cdf-a67b-1ae57fa1bd54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4aa8aab8447434b8619c3b7bb0b585a', 'request_id': 'req-cda8a413-0f92-4cdf-a67b-1ae57fa1bd54'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:30.179896 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-cda8a413-0f92-4cdf-a67b-1ae57fa1bd54 admin admin] The token cache is being invalidate because project f4aa8aab8447434b8619c3b7bb0b585a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:48:30.180187 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-cda8a413-0f92-4cdf-a67b-1ae57fa1bd54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:30.180793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-cda8a413-0f92-4cdf-a67b-1ae57fa1bd54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:30.182349 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1238/2468] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:48:30 2022] DELETE /identity/v3/projects/f4aa8aab8447434b8619c3b7bb0b585a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:30.187979 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368eb964-6dd0-4726-b5fe-32724d98345e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:30.188269 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368eb964-6dd0-4726-b5fe-32724d98345e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:30.188548 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368eb964-6dd0-4726-b5fe-32724d98345e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:30.206708 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-368eb964-6dd0-4726-b5fe-32724d98345e None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:30.207905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-368eb964-6dd0-4726-b5fe-32724d98345e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:30.265629 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1231/2469] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:30.274474 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29f904-72e0-4ded-ab91-f93033f3ea43 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:30.274700 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29f904-72e0-4ded-ab91-f93033f3ea43 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:30.274973 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af29f904-72e0-4ded-ab91-f93033f3ea43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:30.293125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-af29f904-72e0-4ded-ab91-f93033f3ea43 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:30.294345 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-af29f904-72e0-4ded-ab91-f93033f3ea43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:30.302094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1239/2470] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:30.306582 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368eb964-6dd0-4726-b5fe-32724d98345e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:30.316113 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368eb964-6dd0-4726-b5fe-32724d98345e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:30.321469 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92231a2-fcc5-45c2-b46f-7c880a4587ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:30.322119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92231a2-fcc5-45c2-b46f-7c880a4587ef admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:30.322401 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92231a2-fcc5-45c2-b46f-7c880a4587ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:30.322675 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92231a2-fcc5-45c2-b46f-7c880a4587ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:30.323393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92231a2-fcc5-45c2-b46f-7c880a4587ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:48:30.323700 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92231a2-fcc5-45c2-b46f-7c880a4587ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:30.325290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92231a2-fcc5-45c2-b46f-7c880a4587ef admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:30.336611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1232/2471] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:48:30.340695 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29f904-72e0-4ded-ab91-f93033f3ea43 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:30.349772 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af29f904-72e0-4ded-ab91-f93033f3ea43 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:30.354769 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef263a-8d94-4452-96fb-446d608d3a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:30.355427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef263a-8d94-4452-96fb-446d608d3a30 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:30.355711 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef263a-8d94-4452-96fb-446d608d3a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:30.355991 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef263a-8d94-4452-96fb-446d608d3a30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:30.356689 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef263a-8d94-4452-96fb-446d608d3a30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:30.358612 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef263a-8d94-4452-96fb-446d608d3a30 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:30.388868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1240/2472] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:48:30 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:30.389966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92231a2-fcc5-45c2-b46f-7c880a4587ef admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:30.400317 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92231a2-fcc5-45c2-b46f-7c880a4587ef admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:30.447352 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:30.458024 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018d2c3-0e7d-43b7-be8a-e454e247bc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:30.458892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018d2c3-0e7d-43b7-be8a-e454e247bc34 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:30.459352 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018d2c3-0e7d-43b7-be8a-e454e247bc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:30.460144 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018d2c3-0e7d-43b7-be8a-e454e247bc34 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:30.460737 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018d2c3-0e7d-43b7-be8a-e454e247bc34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:30.462728 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018d2c3-0e7d-43b7-be8a-e454e247bc34 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:30.481464 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1233/2473] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:48:30 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:48:30.485555 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef263a-8d94-4452-96fb-446d608d3a30 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:30.496419 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef263a-8d94-4452-96fb-446d608d3a30 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:30.500961 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf97243-a035-44d6-ad7e-03bcdcf236b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:30.501639 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf97243-a035-44d6-ad7e-03bcdcf236b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:30.501928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf97243-a035-44d6-ad7e-03bcdcf236b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:30.502206 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf97243-a035-44d6-ad7e-03bcdcf236b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:30.502925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf97243-a035-44d6-ad7e-03bcdcf236b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:30.504508 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf97243-a035-44d6-ad7e-03bcdcf236b5 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:30.515637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1241/2474] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:30.519426 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018d2c3-0e7d-43b7-be8a-e454e247bc34 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:30.529542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018d2c3-0e7d-43b7-be8a-e454e247bc34 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:30.534026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9aa97-2869-43f8-bc69-5870b41fd3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:30.534668 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9aa97-2869-43f8-bc69-5870b41fd3be admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:30.534951 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9aa97-2869-43f8-bc69-5870b41fd3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:30.535230 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9aa97-2869-43f8-bc69-5870b41fd3be admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:30.535951 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9aa97-2869-43f8-bc69-5870b41fd3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:30.537573 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9aa97-2869-43f8-bc69-5870b41fd3be admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:30.547324 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1234/2475] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:30.551224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf97243-a035-44d6-ad7e-03bcdcf236b5 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:30.561581 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf97243-a035-44d6-ad7e-03bcdcf236b5 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:30.566200 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ce61c-6ff4-4ec1-b9ee-814757c941c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:30.567070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ce61c-6ff4-4ec1-b9ee-814757c941c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:30.567360 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ce61c-6ff4-4ec1-b9ee-814757c941c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:30.567642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ce61c-6ff4-4ec1-b9ee-814757c941c4 admin admin] PATH_INFO: `/v3/projects/04eae318b7944fba870faa806f7810d6/users/23a1962c47be441f8a5b425a2416af48/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:30.583274 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ce61c-6ff4-4ec1-b9ee-814757c941c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04eae318b7944fba870faa806f7810d6, user_id=23a1962c47be441f8a5b425a2416af48, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:30.586085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ce61c-6ff4-4ec1-b9ee-814757c941c4 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:30.598451 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1242/2476] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:48:30 2022] PUT /identity/v3/projects/04eae318b7944fba870faa806f7810d6/users/23a1962c47be441f8a5b425a2416af48/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:30.608900 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5718c-eaaf-4241-bdc9-790bd333c8f0 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:30.609195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5718c-eaaf-4241-bdc9-790bd333c8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:30.609515 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5718c-eaaf-4241-bdc9-790bd333c8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:30.636671 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-3dd5718c-eaaf-4241-bdc9-790bd333c8f0 None None] MFA Rules not processed for user `23a1962c47be441f8a5b425a2416af48`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:30.637899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3dd5718c-eaaf-4241-bdc9-790bd333c8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:30.703072 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1235/2477] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:30.707846 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ce61c-6ff4-4ec1-b9ee-814757c941c4 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:30.767812 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ce61c-6ff4-4ec1-b9ee-814757c941c4 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:30.772799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd56996-f293-4361-8cfd-7edae5f5253e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:30.773461 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd56996-f293-4361-8cfd-7edae5f5253e admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:30.773744 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd56996-f293-4361-8cfd-7edae5f5253e admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:30.774020 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd56996-f293-4361-8cfd-7edae5f5253e admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:30.774701 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd56996-f293-4361-8cfd-7edae5f5253e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:30.776575 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd56996-f293-4361-8cfd-7edae5f5253e admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:30.789531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:30.804072 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1243/2478] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:48:30 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:30.808058 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5718c-eaaf-4241-bdc9-790bd333c8f0 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:30.820816 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5718c-eaaf-4241-bdc9-790bd333c8f0 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:30.876107 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b3ae5-0b7f-45bd-9c1d-f191acd2da30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:30.876767 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b3ae5-0b7f-45bd-9c1d-f191acd2da30 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:30.877048 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b3ae5-0b7f-45bd-9c1d-f191acd2da30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:30.877323 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b3ae5-0b7f-45bd-9c1d-f191acd2da30 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:30.878045 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b3ae5-0b7f-45bd-9c1d-f191acd2da30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:30.879959 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b3ae5-0b7f-45bd-9c1d-f191acd2da30 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:30.901612 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1236/2479] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:48:30 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:30.903607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd56996-f293-4361-8cfd-7edae5f5253e admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:30.914331 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd56996-f293-4361-8cfd-7edae5f5253e admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:30.920738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3c82a-b7db-4a7e-a17d-14c76815a558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:30.921188 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c82a-b7db-4a7e-a17d-14c76815a558 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:30.921517 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c82a-b7db-4a7e-a17d-14c76815a558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:30.921843 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3c82a-b7db-4a7e-a17d-14c76815a558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:30.922597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3c82a-b7db-4a7e-a17d-14c76815a558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:30.924178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3c82a-b7db-4a7e-a17d-14c76815a558 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:30.936268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1244/2480] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:30.940454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b3ae5-0b7f-45bd-9c1d-f191acd2da30 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:30.950782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b3ae5-0b7f-45bd-9c1d-f191acd2da30 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:30.955799 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35b4de-a13f-4be8-af2b-03c9a6322197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:30.956710 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35b4de-a13f-4be8-af2b-03c9a6322197 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:30.956995 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35b4de-a13f-4be8-af2b-03c9a6322197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:30.957273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35b4de-a13f-4be8-af2b-03c9a6322197 admin admin] PATH_INFO: `/v3/projects/c8e2e789e4074d3182816cc1d6bf91f4/users/0f6c747ae2054dda8b8c031f61864480/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:30.972756 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35b4de-a13f-4be8-af2b-03c9a6322197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e2e789e4074d3182816cc1d6bf91f4, user_id=0f6c747ae2054dda8b8c031f61864480, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:30.976003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35b4de-a13f-4be8-af2b-03c9a6322197 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:30.989487 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1237/2481] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:48:30 2022] PUT /identity/v3/projects/c8e2e789e4074d3182816cc1d6bf91f4/users/0f6c747ae2054dda8b8c031f61864480/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:30.994093 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3c82a-b7db-4a7e-a17d-14c76815a558 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:31.006467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3c82a-b7db-4a7e-a17d-14c76815a558 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:31.066429 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04384a4a-6f19-42b1-af7d-e45bb471c9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:31.067096 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04384a4a-6f19-42b1-af7d-e45bb471c9cd admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:31.067377 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04384a4a-6f19-42b1-af7d-e45bb471c9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:31.067656 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04384a4a-6f19-42b1-af7d-e45bb471c9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:31.068376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04384a4a-6f19-42b1-af7d-e45bb471c9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:31.070357 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04384a4a-6f19-42b1-af7d-e45bb471c9cd admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:31.083988 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1245/2482] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:48:31.086332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35b4de-a13f-4be8-af2b-03c9a6322197 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:31.096788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35b4de-a13f-4be8-af2b-03c9a6322197 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:31.102478 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61d468-3433-4a7b-8dba-931e1fa10b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:31.103365 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61d468-3433-4a7b-8dba-931e1fa10b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:31.103638 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61d468-3433-4a7b-8dba-931e1fa10b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:31.103908 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a61d468-3433-4a7b-8dba-931e1fa10b15 admin admin] PATH_INFO: `/v3/projects/c8e2e789e4074d3182816cc1d6bf91f4/users/0f6c747ae2054dda8b8c031f61864480/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:31.105938 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61d468-3433-4a7b-8dba-931e1fa10b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e2e789e4074d3182816cc1d6bf91f4, user_id=0f6c747ae2054dda8b8c031f61864480, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:31.108567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a61d468-3433-4a7b-8dba-931e1fa10b15 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:31.119869 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1238/2483] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:48:31 2022] PUT /identity/v3/projects/c8e2e789e4074d3182816cc1d6bf91f4/users/0f6c747ae2054dda8b8c031f61864480/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:48:31.130687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ce765-08ac-47ab-9bf7-3e9565f31363 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:31.130900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ce765-08ac-47ab-9bf7-3e9565f31363 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:31.131182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ce765-08ac-47ab-9bf7-3e9565f31363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:31.164592 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-372ce765-08ac-47ab-9bf7-3e9565f31363 None None] MFA Rules not processed for user `0f6c747ae2054dda8b8c031f61864480`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:31.165888 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-372ce765-08ac-47ab-9bf7-3e9565f31363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:31.249597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1246/2484] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:31.260856 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61d468-3433-4a7b-8dba-931e1fa10b15 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:31.262667 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9a61d468-3433-4a7b-8dba-931e1fa10b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:31.277624 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:31.325748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a61d468-3433-4a7b-8dba-931e1fa10b15 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:31.333619 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7130d-dd0c-46a3-9516-b03a311b0922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:31.334322 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7130d-dd0c-46a3-9516-b03a311b0922 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:31.335192 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7130d-dd0c-46a3-9516-b03a311b0922 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:31.335492 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7130d-dd0c-46a3-9516-b03a311b0922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:31.345759 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7130d-dd0c-46a3-9516-b03a311b0922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:31.347250 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7130d-dd0c-46a3-9516-b03a311b0922 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:31.358312 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1239/2485] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:31 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:31.406427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ce765-08ac-47ab-9bf7-3e9565f31363 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:31.407810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-372ce765-08ac-47ab-9bf7-3e9565f31363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:31.424281 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ce765-08ac-47ab-9bf7-3e9565f31363 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:31.427854 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89434206-6140-4ce8-915e-05f5714da598 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:31.429016 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89434206-6140-4ce8-915e-05f5714da598 service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:31.429304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89434206-6140-4ce8-915e-05f5714da598 service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:31.429688 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89434206-6140-4ce8-915e-05f5714da598 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:31.487212 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89434206-6140-4ce8-915e-05f5714da598 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:31.488653 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89434206-6140-4ce8-915e-05f5714da598 service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:31.497477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1247/2486] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:31 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:34.764783 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7130d-dd0c-46a3-9516-b03a311b0922 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:34.829685 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7130d-dd0c-46a3-9516-b03a311b0922 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:34.834440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630c9a3-af61-4b6f-bd81-baa8f4a088e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:34.835338 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630c9a3-af61-4b6f-bd81-baa8f4a088e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:34.835631 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630c9a3-af61-4b6f-bd81-baa8f4a088e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:34.835909 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0630c9a3-af61-4b6f-bd81-baa8f4a088e3 admin admin] PATH_INFO: `/v3/users/23a1962c47be441f8a5b425a2416af48` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:34.837108 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630c9a3-af61-4b6f-bd81-baa8f4a088e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a1962c47be441f8a5b425a2416af48)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:34.839077 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0630c9a3-af61-4b6f-bd81-baa8f4a088e3 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:34.892714 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0630c9a3-af61-4b6f-bd81-baa8f4a088e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a1962c47be441f8a5b425a2416af48'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:34.893389 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0630c9a3-af61-4b6f-bd81-baa8f4a088e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a1962c47be441f8a5b425a2416af48'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:34.902994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0630c9a3-af61-4b6f-bd81-baa8f4a088e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a1962c47be441f8a5b425a2416af48'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:34.912164 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0630c9a3-af61-4b6f-bd81-baa8f4a088e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a1962c47be441f8a5b425a2416af48'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:34.925566 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-0630c9a3-af61-4b6f-bd81-baa8f4a088e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a1962c47be441f8a5b425a2416af48'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:34.932909 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1240/2487] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:48:34 2022] DELETE /identity/v3/users/23a1962c47be441f8a5b425a2416af48 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:34.937557 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c83498-5208-48b2-9cca-5e0f55649c8e None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:34.938053 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c83498-5208-48b2-9cca-5e0f55649c8e None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:34.938173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c83498-5208-48b2-9cca-5e0f55649c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:34.944752 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:34.958192 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-63c83498-5208-48b2-9cca-5e0f55649c8e None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:34.959482 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-63c83498-5208-48b2-9cca-5e0f55649c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:35.028713 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1248/2488] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:48:35.035819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630c9a3-af61-4b6f-bd81-baa8f4a088e3 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:35.037284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0630c9a3-af61-4b6f-bd81-baa8f4a088e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:35.081269 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:35.102112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0630c9a3-af61-4b6f-bd81-baa8f4a088e3 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:35.106581 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936bbc4-e87f-48bb-a230-b4e979cee22b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:35.107238 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936bbc4-e87f-48bb-a230-b4e979cee22b service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:35.107527 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936bbc4-e87f-48bb-a230-b4e979cee22b service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:35.107805 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936bbc4-e87f-48bb-a230-b4e979cee22b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:35.121361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936bbc4-e87f-48bb-a230-b4e979cee22b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:35.122973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936bbc4-e87f-48bb-a230-b4e979cee22b service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:35.136300 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1241/2489] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:35.431929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c83498-5208-48b2-9cca-5e0f55649c8e None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:35.433636 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-63c83498-5208-48b2-9cca-5e0f55649c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:35.457103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c83498-5208-48b2-9cca-5e0f55649c8e None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:35.463794 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de214f-a50e-4c07-ac9e-0cc9099a0ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:35.464677 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de214f-a50e-4c07-ac9e-0cc9099a0ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:35.465001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de214f-a50e-4c07-ac9e-0cc9099a0ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:35.465232 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de214f-a50e-4c07-ac9e-0cc9099a0ec2 admin admin] PATH_INFO: `/v3/projects/04eae318b7944fba870faa806f7810d6` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:35.466507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de214f-a50e-4c07-ac9e-0cc9099a0ec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04eae318b7944fba870faa806f7810d6)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:35.468814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de214f-a50e-4c07-ac9e-0cc9099a0ec2 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:35.515408 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-28de214f-a50e-4c07-ac9e-0cc9099a0ec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04eae318b7944fba870faa806f7810d6', 'request_id': 'req-28de214f-a50e-4c07-ac9e-0cc9099a0ec2'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:35.520856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-28de214f-a50e-4c07-ac9e-0cc9099a0ec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04eae318b7944fba870faa806f7810d6', 'request_id': 'req-28de214f-a50e-4c07-ac9e-0cc9099a0ec2'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:35.529268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-28de214f-a50e-4c07-ac9e-0cc9099a0ec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04eae318b7944fba870faa806f7810d6', 'request_id': 'req-28de214f-a50e-4c07-ac9e-0cc9099a0ec2'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:35.540229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-28de214f-a50e-4c07-ac9e-0cc9099a0ec2 admin admin] The token cache is being invalidate because project 04eae318b7944fba870faa806f7810d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:48:35.540512 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-28de214f-a50e-4c07-ac9e-0cc9099a0ec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:35.541129 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-28de214f-a50e-4c07-ac9e-0cc9099a0ec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:35.542670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1249/2490] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:48:35 2022] DELETE /identity/v3/projects/04eae318b7944fba870faa806f7810d6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:35.546823 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936bbc4-e87f-48bb-a230-b4e979cee22b service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:35.556901 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936bbc4-e87f-48bb-a230-b4e979cee22b service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:35.612555 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ae74d-dca8-4c81-afa2-6a64f7791f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:35.613433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ae74d-dca8-4c81-afa2-6a64f7791f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:35.613718 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ae74d-dca8-4c81-afa2-6a64f7791f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:35.613992 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ae74d-dca8-4c81-afa2-6a64f7791f5f admin admin] PATH_INFO: `/v3/users/0f6c747ae2054dda8b8c031f61864480` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:35.615155 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ae74d-dca8-4c81-afa2-6a64f7791f5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f6c747ae2054dda8b8c031f61864480)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:35.617939 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ae74d-dca8-4c81-afa2-6a64f7791f5f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:35.662594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4a3ae74d-dca8-4c81-afa2-6a64f7791f5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f6c747ae2054dda8b8c031f61864480'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:35.663336 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4a3ae74d-dca8-4c81-afa2-6a64f7791f5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f6c747ae2054dda8b8c031f61864480'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:35.670056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4a3ae74d-dca8-4c81-afa2-6a64f7791f5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f6c747ae2054dda8b8c031f61864480'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:35.677460 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4a3ae74d-dca8-4c81-afa2-6a64f7791f5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f6c747ae2054dda8b8c031f61864480'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:35.690360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4a3ae74d-dca8-4c81-afa2-6a64f7791f5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f6c747ae2054dda8b8c031f61864480'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:35.696894 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1242/2491] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:48:35 2022] DELETE /identity/v3/users/0f6c747ae2054dda8b8c031f61864480 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:35.969655 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de214f-a50e-4c07-ac9e-0cc9099a0ec2 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:35.971155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-28de214f-a50e-4c07-ac9e-0cc9099a0ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:35.984689 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de214f-a50e-4c07-ac9e-0cc9099a0ec2 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:36.047135 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce93463-4618-46a4-b50d-f81605bb5781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:36.047917 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce93463-4618-46a4-b50d-f81605bb5781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:36.048201 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce93463-4618-46a4-b50d-f81605bb5781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:36.048478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce93463-4618-46a4-b50d-f81605bb5781 admin admin] PATH_INFO: `/v3/projects/c8e2e789e4074d3182816cc1d6bf91f4` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:36.049668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce93463-4618-46a4-b50d-f81605bb5781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e2e789e4074d3182816cc1d6bf91f4)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:36.051594 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce93463-4618-46a4-b50d-f81605bb5781 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:36.081893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:36.097898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0ce93463-4618-46a4-b50d-f81605bb5781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e2e789e4074d3182816cc1d6bf91f4', 'request_id': 'req-0ce93463-4618-46a4-b50d-f81605bb5781'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:36.104125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0ce93463-4618-46a4-b50d-f81605bb5781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e2e789e4074d3182816cc1d6bf91f4', 'request_id': 'req-0ce93463-4618-46a4-b50d-f81605bb5781'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:36.111409 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0ce93463-4618-46a4-b50d-f81605bb5781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e2e789e4074d3182816cc1d6bf91f4', 'request_id': 'req-0ce93463-4618-46a4-b50d-f81605bb5781'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:36.122712 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0ce93463-4618-46a4-b50d-f81605bb5781 admin admin] The token cache is being invalidate because project c8e2e789e4074d3182816cc1d6bf91f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:48:36.122993 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0ce93463-4618-46a4-b50d-f81605bb5781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:36.123620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0ce93463-4618-46a4-b50d-f81605bb5781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:36.125125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1250/2492] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:48:35 2022] DELETE /identity/v3/projects/c8e2e789e4074d3182816cc1d6bf91f4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:36.129906 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2092068-b4aa-43dd-b3e8-2633466ca02a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:36.130385 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2092068-b4aa-43dd-b3e8-2633466ca02a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:36.130485 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2092068-b4aa-43dd-b3e8-2633466ca02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:36.148973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b2092068-b4aa-43dd-b3e8-2633466ca02a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:36.150185 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b2092068-b4aa-43dd-b3e8-2633466ca02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:36.200254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:36.211243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1243/2493] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:36.219270 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76ab7a-8ea0-46bf-8b12-f73b1fa949eb None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:36.219270 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76ab7a-8ea0-46bf-8b12-f73b1fa949eb None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:36.219490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76ab7a-8ea0-46bf-8b12-f73b1fa949eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:36.239300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-3c76ab7a-8ea0-46bf-8b12-f73b1fa949eb None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:36.240543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-3c76ab7a-8ea0-46bf-8b12-f73b1fa949eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:36.249288 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1251/2494] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:36.253407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2092068-b4aa-43dd-b3e8-2633466ca02a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:36.263256 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2092068-b4aa-43dd-b3e8-2633466ca02a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:36.268106 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa77e89-dbdd-49b8-965f-de7c53eaa32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:36.268845 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa77e89-dbdd-49b8-965f-de7c53eaa32e admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:36.269200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa77e89-dbdd-49b8-965f-de7c53eaa32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:36.269524 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa77e89-dbdd-49b8-965f-de7c53eaa32e admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:36.270258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa77e89-dbdd-49b8-965f-de7c53eaa32e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:48:36.270570 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa77e89-dbdd-49b8-965f-de7c53eaa32e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:36.273276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa77e89-dbdd-49b8-965f-de7c53eaa32e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:36.290853 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1244/2495] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:48:36.292031 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76ab7a-8ea0-46bf-8b12-f73b1fa949eb None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:36.301919 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76ab7a-8ea0-46bf-8b12-f73b1fa949eb None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:36.307150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e05ed-5626-4359-8c43-e980cff71706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:36.307798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e05ed-5626-4359-8c43-e980cff71706 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:36.308078 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e05ed-5626-4359-8c43-e980cff71706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:36.308355 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e05ed-5626-4359-8c43-e980cff71706 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:36.309092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e05ed-5626-4359-8c43-e980cff71706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:36.311133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e05ed-5626-4359-8c43-e980cff71706 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:36.337195 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1252/2496] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:48:36 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:36.341357 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa77e89-dbdd-49b8-965f-de7c53eaa32e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:36.351825 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa77e89-dbdd-49b8-965f-de7c53eaa32e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:36.407166 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd684c8-d266-4c1a-b8dd-ebe6760e0e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:36.407829 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd684c8-d266-4c1a-b8dd-ebe6760e0e06 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:36.408119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd684c8-d266-4c1a-b8dd-ebe6760e0e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:36.408401 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd684c8-d266-4c1a-b8dd-ebe6760e0e06 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:36.409098 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd684c8-d266-4c1a-b8dd-ebe6760e0e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:36.411071 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd684c8-d266-4c1a-b8dd-ebe6760e0e06 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:36.431162 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1245/2497] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:48:36 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:48:36.435213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e05ed-5626-4359-8c43-e980cff71706 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:36.445645 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e05ed-5626-4359-8c43-e980cff71706 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:36.450195 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722edff-d18a-4087-9b9f-f4d0d6dc105e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:36.450846 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722edff-d18a-4087-9b9f-f4d0d6dc105e admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:36.451130 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722edff-d18a-4087-9b9f-f4d0d6dc105e admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:36.451409 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722edff-d18a-4087-9b9f-f4d0d6dc105e admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:36.452161 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722edff-d18a-4087-9b9f-f4d0d6dc105e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:36.453789 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722edff-d18a-4087-9b9f-f4d0d6dc105e admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:36.464613 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1253/2498] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:36.468433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd684c8-d266-4c1a-b8dd-ebe6760e0e06 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:36.479122 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd684c8-d266-4c1a-b8dd-ebe6760e0e06 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:36.483743 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37258f-a207-4433-beec-c79cf927033f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:36.484387 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37258f-a207-4433-beec-c79cf927033f admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:36.484674 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37258f-a207-4433-beec-c79cf927033f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:36.484957 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37258f-a207-4433-beec-c79cf927033f admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:36.485797 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37258f-a207-4433-beec-c79cf927033f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:36.487397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37258f-a207-4433-beec-c79cf927033f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:36.497137 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1246/2499] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:36.501225 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722edff-d18a-4087-9b9f-f4d0d6dc105e admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:36.511230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722edff-d18a-4087-9b9f-f4d0d6dc105e admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:36.515732 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517a7db-b487-440a-82fe-a7a5e85acb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:36.516593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517a7db-b487-440a-82fe-a7a5e85acb4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:36.516881 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517a7db-b487-440a-82fe-a7a5e85acb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:36.517152 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517a7db-b487-440a-82fe-a7a5e85acb4a admin admin] PATH_INFO: `/v3/projects/882704c9db4d4fe6ba47eef8dc43bca6/users/e2b5dd6534684904a019bc2742d66f86/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:36.532042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517a7db-b487-440a-82fe-a7a5e85acb4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=882704c9db4d4fe6ba47eef8dc43bca6, user_id=e2b5dd6534684904a019bc2742d66f86, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:36.534731 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517a7db-b487-440a-82fe-a7a5e85acb4a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:36.548509 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1254/2500] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:48:36 2022] PUT /identity/v3/projects/882704c9db4d4fe6ba47eef8dc43bca6/users/e2b5dd6534684904a019bc2742d66f86/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:36.559976 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60656032-0134-4b4c-a543-c7f7444b2825 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:36.560210 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60656032-0134-4b4c-a543-c7f7444b2825 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:36.560492 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60656032-0134-4b4c-a543-c7f7444b2825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:36.587123 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-60656032-0134-4b4c-a543-c7f7444b2825 None None] MFA Rules not processed for user `e2b5dd6534684904a019bc2742d66f86`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:36.588325 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-60656032-0134-4b4c-a543-c7f7444b2825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:36.651136 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1247/2501] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:36.655755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517a7db-b487-440a-82fe-a7a5e85acb4a admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:36.718325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517a7db-b487-440a-82fe-a7a5e85acb4a admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:36.722916 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1d418-4a36-4969-8df3-fb736bba1433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:36.723576 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1d418-4a36-4969-8df3-fb736bba1433 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:36.723893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1d418-4a36-4969-8df3-fb736bba1433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:36.724172 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1d418-4a36-4969-8df3-fb736bba1433 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:36.725447 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1d418-4a36-4969-8df3-fb736bba1433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:36.727356 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1d418-4a36-4969-8df3-fb736bba1433 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:36.752012 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1255/2502] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:48:36 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:36.756127 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60656032-0134-4b4c-a543-c7f7444b2825 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:36.767235 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60656032-0134-4b4c-a543-c7f7444b2825 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:36.815018 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:36.826372 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfa036-4503-40cc-95b6-035fbc9bac83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:36.827046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfa036-4503-40cc-95b6-035fbc9bac83 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:36.827362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfa036-4503-40cc-95b6-035fbc9bac83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:36.827642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfa036-4503-40cc-95b6-035fbc9bac83 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:36.828336 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbfa036-4503-40cc-95b6-035fbc9bac83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:36.830326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbfa036-4503-40cc-95b6-035fbc9bac83 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:36.849486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1248/2503] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:48:36 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:48:36.854099 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1d418-4a36-4969-8df3-fb736bba1433 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:36.864538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1d418-4a36-4969-8df3-fb736bba1433 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:36.870011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de93ea1-8167-4bf1-a872-9e51278e3c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:36.870670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de93ea1-8167-4bf1-a872-9e51278e3c4b admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:36.870958 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de93ea1-8167-4bf1-a872-9e51278e3c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:36.871265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de93ea1-8167-4bf1-a872-9e51278e3c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:36.871992 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de93ea1-8167-4bf1-a872-9e51278e3c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:36.873625 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de93ea1-8167-4bf1-a872-9e51278e3c4b admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:36.884210 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1256/2504] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:36.888290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfa036-4503-40cc-95b6-035fbc9bac83 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:36.898546 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfa036-4503-40cc-95b6-035fbc9bac83 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:36.903168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f4b06-17da-4e1e-af13-c0c9cfe321a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:36.904034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f4b06-17da-4e1e-af13-c0c9cfe321a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:36.904317 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f4b06-17da-4e1e-af13-c0c9cfe321a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:36.904596 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f4b06-17da-4e1e-af13-c0c9cfe321a8 admin admin] PATH_INFO: `/v3/projects/a8fc485e8883422a9928f5566a788b7e/users/4a3dd41919034e39a6f7815c50237f93/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:36.919598 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f4b06-17da-4e1e-af13-c0c9cfe321a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8fc485e8883422a9928f5566a788b7e, user_id=4a3dd41919034e39a6f7815c50237f93, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:36.922285 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f4b06-17da-4e1e-af13-c0c9cfe321a8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:36.935135 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1249/2505] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:48:36 2022] PUT /identity/v3/projects/a8fc485e8883422a9928f5566a788b7e/users/4a3dd41919034e39a6f7815c50237f93/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:48:36.938924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de93ea1-8167-4bf1-a872-9e51278e3c4b admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:36.949582 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de93ea1-8167-4bf1-a872-9e51278e3c4b admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:36.973844 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:37.008476 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8990b-c05d-4a9e-911b-644dee6f8fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:37.009132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8990b-c05d-4a9e-911b-644dee6f8fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:37.009443 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8990b-c05d-4a9e-911b-644dee6f8fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:37.009726 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8990b-c05d-4a9e-911b-644dee6f8fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:37.010438 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8990b-c05d-4a9e-911b-644dee6f8fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:37.012024 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8990b-c05d-4a9e-911b-644dee6f8fa9 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:37.022825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1257/2506] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:37.026639 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f4b06-17da-4e1e-af13-c0c9cfe321a8 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:37.036704 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f4b06-17da-4e1e-af13-c0c9cfe321a8 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:37.041347 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2d8ce-94ee-42f0-9820-5912f49f9993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:37.042242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2d8ce-94ee-42f0-9820-5912f49f9993 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:37.042523 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2d8ce-94ee-42f0-9820-5912f49f9993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:37.042794 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2d8ce-94ee-42f0-9820-5912f49f9993 admin admin] PATH_INFO: `/v3/projects/a8fc485e8883422a9928f5566a788b7e/users/4a3dd41919034e39a6f7815c50237f93/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:37.044737 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2d8ce-94ee-42f0-9820-5912f49f9993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8fc485e8883422a9928f5566a788b7e, user_id=4a3dd41919034e39a6f7815c50237f93, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:37.047395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2d8ce-94ee-42f0-9820-5912f49f9993 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:37.057871 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1250/2507] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:48:37 2022] PUT /identity/v3/projects/a8fc485e8883422a9928f5566a788b7e/users/4a3dd41919034e39a6f7815c50237f93/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:37.067766 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec5353-ded3-496f-a156-91261a1b80c6 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:37.067999 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec5353-ded3-496f-a156-91261a1b80c6 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:37.068283 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec5353-ded3-496f-a156-91261a1b80c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:37.096142 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-29ec5353-ded3-496f-a156-91261a1b80c6 None None] MFA Rules not processed for user `4a3dd41919034e39a6f7815c50237f93`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:37.097524 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-29ec5353-ded3-496f-a156-91261a1b80c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:37.165965 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1258/2508] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:37.177301 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2d8ce-94ee-42f0-9820-5912f49f9993 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:37.179557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a1e2d8ce-94ee-42f0-9820-5912f49f9993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:37.237882 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2d8ce-94ee-42f0-9820-5912f49f9993 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:37.241712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1a154-3aad-4cc7-8dda-18708f09dec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:37.242355 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1a154-3aad-4cc7-8dda-18708f09dec9 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:37.242641 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1a154-3aad-4cc7-8dda-18708f09dec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:37.242919 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1a154-3aad-4cc7-8dda-18708f09dec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:37.252660 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1a154-3aad-4cc7-8dda-18708f09dec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:37.254147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1a154-3aad-4cc7-8dda-18708f09dec9 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:37.267694 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1251/2509] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:37.349264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec5353-ded3-496f-a156-91261a1b80c6 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:37.351795 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-29ec5353-ded3-496f-a156-91261a1b80c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:37.364133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec5353-ded3-496f-a156-91261a1b80c6 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:37.368395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bccdaf-fca3-4654-acb0-87347850a3e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:37.369049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bccdaf-fca3-4654-acb0-87347850a3e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:37.369324 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bccdaf-fca3-4654-acb0-87347850a3e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:37.369664 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bccdaf-fca3-4654-acb0-87347850a3e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:37.427579 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bccdaf-fca3-4654-acb0-87347850a3e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:37.429036 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bccdaf-fca3-4654-acb0-87347850a3e6 service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:37.437967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1259/2510] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:37.699540 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1a154-3aad-4cc7-8dda-18708f09dec9 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:37.760263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1a154-3aad-4cc7-8dda-18708f09dec9 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:37.764709 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f81b2-1284-40b5-bc70-5b3a6b2fd9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:37.765590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f81b2-1284-40b5-bc70-5b3a6b2fd9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:37.765871 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f81b2-1284-40b5-bc70-5b3a6b2fd9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:37.766142 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f81b2-1284-40b5-bc70-5b3a6b2fd9e9 admin admin] PATH_INFO: `/v3/users/e2b5dd6534684904a019bc2742d66f86` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:37.767296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f81b2-1284-40b5-bc70-5b3a6b2fd9e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b5dd6534684904a019bc2742d66f86)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:37.769255 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f81b2-1284-40b5-bc70-5b3a6b2fd9e9 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:37.816254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6c6f81b2-1284-40b5-bc70-5b3a6b2fd9e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b5dd6534684904a019bc2742d66f86'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:37.816925 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6c6f81b2-1284-40b5-bc70-5b3a6b2fd9e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b5dd6534684904a019bc2742d66f86'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:37.820739 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:37.825747 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6c6f81b2-1284-40b5-bc70-5b3a6b2fd9e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b5dd6534684904a019bc2742d66f86'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:37.834665 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6c6f81b2-1284-40b5-bc70-5b3a6b2fd9e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b5dd6534684904a019bc2742d66f86'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:37.846349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6c6f81b2-1284-40b5-bc70-5b3a6b2fd9e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b5dd6534684904a019bc2742d66f86'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:37.852730 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1252/2511] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:48:37 2022] DELETE /identity/v3/users/e2b5dd6534684904a019bc2742d66f86 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:37.857151 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472afb3-53c4-4cbd-b18b-c57115111970 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:37.857483 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472afb3-53c4-4cbd-b18b-c57115111970 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:37.857773 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472afb3-53c4-4cbd-b18b-c57115111970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:37.875340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-f472afb3-53c4-4cbd-b18b-c57115111970 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:37.876477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-f472afb3-53c4-4cbd-b18b-c57115111970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:37.918644 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:37.936788 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1260/2512] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:37.947002 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f81b2-1284-40b5-bc70-5b3a6b2fd9e9 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:37.948399 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6c6f81b2-1284-40b5-bc70-5b3a6b2fd9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:38.005338 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f81b2-1284-40b5-bc70-5b3a6b2fd9e9 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:38.009676 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8f8ea-a4cb-4593-900f-bc45715b0529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:38.010308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8f8ea-a4cb-4593-900f-bc45715b0529 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:38.010589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8f8ea-a4cb-4593-900f-bc45715b0529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:38.010863 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8f8ea-a4cb-4593-900f-bc45715b0529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:38.019894 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8f8ea-a4cb-4593-900f-bc45715b0529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:38.021322 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8f8ea-a4cb-4593-900f-bc45715b0529 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:38.031227 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1253/2513] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:38.301340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472afb3-53c4-4cbd-b18b-c57115111970 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:38.304014 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-f472afb3-53c4-4cbd-b18b-c57115111970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:38.316904 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472afb3-53c4-4cbd-b18b-c57115111970 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:38.332713 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338c0cb-1f1f-4b34-8afc-a2a10ef6123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:38.333652 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338c0cb-1f1f-4b34-8afc-a2a10ef6123a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:38.333941 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338c0cb-1f1f-4b34-8afc-a2a10ef6123a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:38.334218 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338c0cb-1f1f-4b34-8afc-a2a10ef6123a admin admin] PATH_INFO: `/v3/projects/882704c9db4d4fe6ba47eef8dc43bca6` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:38.336045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338c0cb-1f1f-4b34-8afc-a2a10ef6123a admin admin] RBAC: Authorizing `identity:delete_project(project_id=882704c9db4d4fe6ba47eef8dc43bca6)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:38.338293 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338c0cb-1f1f-4b34-8afc-a2a10ef6123a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:38.395598 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-d338c0cb-1f1f-4b34-8afc-a2a10ef6123a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '882704c9db4d4fe6ba47eef8dc43bca6', 'request_id': 'req-d338c0cb-1f1f-4b34-8afc-a2a10ef6123a'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:38.402132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-d338c0cb-1f1f-4b34-8afc-a2a10ef6123a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '882704c9db4d4fe6ba47eef8dc43bca6', 'request_id': 'req-d338c0cb-1f1f-4b34-8afc-a2a10ef6123a'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:38.410126 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-d338c0cb-1f1f-4b34-8afc-a2a10ef6123a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '882704c9db4d4fe6ba47eef8dc43bca6', 'request_id': 'req-d338c0cb-1f1f-4b34-8afc-a2a10ef6123a'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:38.422392 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-d338c0cb-1f1f-4b34-8afc-a2a10ef6123a admin admin] The token cache is being invalidate because project 882704c9db4d4fe6ba47eef8dc43bca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:48:38.422684 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-d338c0cb-1f1f-4b34-8afc-a2a10ef6123a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:38.423343 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-d338c0cb-1f1f-4b34-8afc-a2a10ef6123a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:38.424879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1261/2514] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:48:38 2022] DELETE /identity/v3/projects/882704c9db4d4fe6ba47eef8dc43bca6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:38.429500 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8f8ea-a4cb-4593-900f-bc45715b0529 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:38.439556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8f8ea-a4cb-4593-900f-bc45715b0529 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:38.502451 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2c0cd-2ce8-40dd-8e0a-2ecfc48b2300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:38.503440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2c0cd-2ce8-40dd-8e0a-2ecfc48b2300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:38.503801 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2c0cd-2ce8-40dd-8e0a-2ecfc48b2300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:38.504079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2c0cd-2ce8-40dd-8e0a-2ecfc48b2300 admin admin] PATH_INFO: `/v3/users/4a3dd41919034e39a6f7815c50237f93` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:38.505338 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2c0cd-2ce8-40dd-8e0a-2ecfc48b2300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a3dd41919034e39a6f7815c50237f93)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:38.508001 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c2c0cd-2ce8-40dd-8e0a-2ecfc48b2300 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:38.564918 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-07c2c0cd-2ce8-40dd-8e0a-2ecfc48b2300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a3dd41919034e39a6f7815c50237f93'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:38.565661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-07c2c0cd-2ce8-40dd-8e0a-2ecfc48b2300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a3dd41919034e39a6f7815c50237f93'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:38.574440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-07c2c0cd-2ce8-40dd-8e0a-2ecfc48b2300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a3dd41919034e39a6f7815c50237f93'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:38.581813 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-07c2c0cd-2ce8-40dd-8e0a-2ecfc48b2300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a3dd41919034e39a6f7815c50237f93'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:38.589578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:38.596734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-07c2c0cd-2ce8-40dd-8e0a-2ecfc48b2300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a3dd41919034e39a6f7815c50237f93'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:38.603136 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1254/2515] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:48:38 2022] DELETE /identity/v3/users/4a3dd41919034e39a6f7815c50237f93 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:48:38.877504 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338c0cb-1f1f-4b34-8afc-a2a10ef6123a admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:38.879046 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-d338c0cb-1f1f-4b34-8afc-a2a10ef6123a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:38.899149 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338c0cb-1f1f-4b34-8afc-a2a10ef6123a admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:38.959546 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2cb3f-c463-449a-b054-5df497033659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:38.960336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2cb3f-c463-449a-b054-5df497033659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:38.960618 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2cb3f-c463-449a-b054-5df497033659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:38.960890 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2cb3f-c463-449a-b054-5df497033659 admin admin] PATH_INFO: `/v3/projects/a8fc485e8883422a9928f5566a788b7e` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:38.962125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2cb3f-c463-449a-b054-5df497033659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8fc485e8883422a9928f5566a788b7e)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:38.964020 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2cb3f-c463-449a-b054-5df497033659 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:39.009845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-33c2cb3f-c463-449a-b054-5df497033659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8fc485e8883422a9928f5566a788b7e', 'request_id': 'req-33c2cb3f-c463-449a-b054-5df497033659'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:39.015653 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-33c2cb3f-c463-449a-b054-5df497033659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8fc485e8883422a9928f5566a788b7e', 'request_id': 'req-33c2cb3f-c463-449a-b054-5df497033659'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:39.023001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-33c2cb3f-c463-449a-b054-5df497033659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8fc485e8883422a9928f5566a788b7e', 'request_id': 'req-33c2cb3f-c463-449a-b054-5df497033659'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:39.030690 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:39.035058 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-33c2cb3f-c463-449a-b054-5df497033659 admin admin] The token cache is being invalidate because project a8fc485e8883422a9928f5566a788b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:48:39.035571 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-33c2cb3f-c463-449a-b054-5df497033659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:39.036646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-33c2cb3f-c463-449a-b054-5df497033659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:39.038943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1262/2516] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:48:38 2022] DELETE /identity/v3/projects/a8fc485e8883422a9928f5566a788b7e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:39.043892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93685d20-5ad8-4923-b64a-2893164cdc62 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:39.044214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93685d20-5ad8-4923-b64a-2893164cdc62 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:39.044501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93685d20-5ad8-4923-b64a-2893164cdc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:39.062430 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-93685d20-5ad8-4923-b64a-2893164cdc62 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:39.063666 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-93685d20-5ad8-4923-b64a-2893164cdc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:39.122233 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1255/2517] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:39.129976 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8562a4-25fe-4f05-b170-7246ba16b2fb None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:39.130269 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8562a4-25fe-4f05-b170-7246ba16b2fb None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:39.130556 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8562a4-25fe-4f05-b170-7246ba16b2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:39.149878 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-4b8562a4-25fe-4f05-b170-7246ba16b2fb None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:39.151078 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-4b8562a4-25fe-4f05-b170-7246ba16b2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:39.158983 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1263/2518] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:39.164154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93685d20-5ad8-4923-b64a-2893164cdc62 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:39.174099 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93685d20-5ad8-4923-b64a-2893164cdc62 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:39.178723 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31254c1-b1ba-4f0f-80c0-59348e453955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:39.179380 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31254c1-b1ba-4f0f-80c0-59348e453955 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:39.179668 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31254c1-b1ba-4f0f-80c0-59348e453955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:39.179949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31254c1-b1ba-4f0f-80c0-59348e453955 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:39.180675 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31254c1-b1ba-4f0f-80c0-59348e453955 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:48:39.180986 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31254c1-b1ba-4f0f-80c0-59348e453955 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:39.182622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31254c1-b1ba-4f0f-80c0-59348e453955 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:39.194668 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1256/2519] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:48:39.198958 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8562a4-25fe-4f05-b170-7246ba16b2fb None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:39.208305 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8562a4-25fe-4f05-b170-7246ba16b2fb None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:39.214141 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682afb7-d8aa-4e4a-8e55-abda547d31a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:39.214735 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682afb7-d8aa-4e4a-8e55-abda547d31a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:39.215016 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682afb7-d8aa-4e4a-8e55-abda547d31a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:39.215291 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682afb7-d8aa-4e4a-8e55-abda547d31a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:39.215973 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682afb7-d8aa-4e4a-8e55-abda547d31a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:39.217895 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682afb7-d8aa-4e4a-8e55-abda547d31a4 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:39.242868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1264/2520] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:48:39 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:39.246966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31254c1-b1ba-4f0f-80c0-59348e453955 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:39.257860 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31254c1-b1ba-4f0f-80c0-59348e453955 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:39.313189 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cfde5-d405-4879-98c5-cb48f2be9397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:39.313873 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cfde5-d405-4879-98c5-cb48f2be9397 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:39.314159 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cfde5-d405-4879-98c5-cb48f2be9397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:39.314433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cfde5-d405-4879-98c5-cb48f2be9397 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:39.315123 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cfde5-d405-4879-98c5-cb48f2be9397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:39.317032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cfde5-d405-4879-98c5-cb48f2be9397 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:39.336834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1257/2521] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:48:39 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:39.340919 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682afb7-d8aa-4e4a-8e55-abda547d31a4 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:39.351239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682afb7-d8aa-4e4a-8e55-abda547d31a4 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:39.355882 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bf220-0fab-4d0c-8b93-371051db1604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:39.356532 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bf220-0fab-4d0c-8b93-371051db1604 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:39.356824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bf220-0fab-4d0c-8b93-371051db1604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:39.357103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bf220-0fab-4d0c-8b93-371051db1604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:39.357866 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bf220-0fab-4d0c-8b93-371051db1604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:39.359450 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bf220-0fab-4d0c-8b93-371051db1604 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:39.370376 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1265/2522] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:39.374197 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cfde5-d405-4879-98c5-cb48f2be9397 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:39.384858 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cfde5-d405-4879-98c5-cb48f2be9397 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:39.389433 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762afa84-e8d5-4b0b-a5cc-f86ef50334a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:39.390078 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762afa84-e8d5-4b0b-a5cc-f86ef50334a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:39.390362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762afa84-e8d5-4b0b-a5cc-f86ef50334a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:39.390636 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762afa84-e8d5-4b0b-a5cc-f86ef50334a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:39.391345 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762afa84-e8d5-4b0b-a5cc-f86ef50334a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:39.393088 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762afa84-e8d5-4b0b-a5cc-f86ef50334a7 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:39.404047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1258/2523] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:39.408099 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bf220-0fab-4d0c-8b93-371051db1604 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:39.418630 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bf220-0fab-4d0c-8b93-371051db1604 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:39.423563 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3855ec1-0cbc-4fc1-9a2b-73616d3271df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:39.424448 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3855ec1-0cbc-4fc1-9a2b-73616d3271df admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:39.424739 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3855ec1-0cbc-4fc1-9a2b-73616d3271df admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:39.425022 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3855ec1-0cbc-4fc1-9a2b-73616d3271df admin admin] PATH_INFO: `/v3/projects/b0c735e77146401097c16c5f5587340c/users/9eb45cce82d146d88c414fa10dfa7b05/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:39.440990 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3855ec1-0cbc-4fc1-9a2b-73616d3271df admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c735e77146401097c16c5f5587340c, user_id=9eb45cce82d146d88c414fa10dfa7b05, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:39.444318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3855ec1-0cbc-4fc1-9a2b-73616d3271df admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:39.457640 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1266/2524] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:48:39 2022] PUT /identity/v3/projects/b0c735e77146401097c16c5f5587340c/users/9eb45cce82d146d88c414fa10dfa7b05/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:39.469903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c91a4-f57a-4b42-818f-f59b0d88eb6d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:39.470334 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c91a4-f57a-4b42-818f-f59b0d88eb6d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:39.470415 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c91a4-f57a-4b42-818f-f59b0d88eb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:39.499901 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-bd3c91a4-f57a-4b42-818f-f59b0d88eb6d None None] MFA Rules not processed for user `9eb45cce82d146d88c414fa10dfa7b05`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:39.501141 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bd3c91a4-f57a-4b42-818f-f59b0d88eb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:39.545235 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:39.573617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1259/2525] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:39.585259 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3855ec1-0cbc-4fc1-9a2b-73616d3271df admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:39.587015 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-a3855ec1-0cbc-4fc1-9a2b-73616d3271df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:39.655943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3855ec1-0cbc-4fc1-9a2b-73616d3271df admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:39.660122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc26d7a-de20-4f62-92d8-806545159da4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:39.660890 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc26d7a-de20-4f62-92d8-806545159da4 service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:39.661146 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc26d7a-de20-4f62-92d8-806545159da4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:39.661634 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc26d7a-de20-4f62-92d8-806545159da4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:39.672096 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc26d7a-de20-4f62-92d8-806545159da4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:39.673622 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc26d7a-de20-4f62-92d8-806545159da4 service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:39.684078 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1267/2526] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:39.702953 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c91a4-f57a-4b42-818f-f59b0d88eb6d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:39.770169 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c91a4-f57a-4b42-818f-f59b0d88eb6d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:39.775222 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a622a-d5a1-4e67-8dff-226430f5f8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:39.776097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a622a-d5a1-4e67-8dff-226430f5f8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:39.777295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a622a-d5a1-4e67-8dff-226430f5f8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:39.777295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a622a-d5a1-4e67-8dff-226430f5f8e4 admin admin] PATH_INFO: `/v3/users/9eb45cce82d146d88c414fa10dfa7b05` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:39.777927 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a622a-d5a1-4e67-8dff-226430f5f8e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eb45cce82d146d88c414fa10dfa7b05)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:39.779850 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a622a-d5a1-4e67-8dff-226430f5f8e4 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:39.836787 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ba0a622a-d5a1-4e67-8dff-226430f5f8e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eb45cce82d146d88c414fa10dfa7b05'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:39.837491 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ba0a622a-d5a1-4e67-8dff-226430f5f8e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eb45cce82d146d88c414fa10dfa7b05'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:39.845251 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ba0a622a-d5a1-4e67-8dff-226430f5f8e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eb45cce82d146d88c414fa10dfa7b05'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:39.853405 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ba0a622a-d5a1-4e67-8dff-226430f5f8e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eb45cce82d146d88c414fa10dfa7b05'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:39.865613 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ba0a622a-d5a1-4e67-8dff-226430f5f8e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eb45cce82d146d88c414fa10dfa7b05'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:39.872403 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1260/2527] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:48:39 2022] DELETE /identity/v3/users/9eb45cce82d146d88c414fa10dfa7b05 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:39.877659 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae0ace-b37f-4ebb-9eec-01aa546de767 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:39.877957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae0ace-b37f-4ebb-9eec-01aa546de767 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:39.878244 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae0ace-b37f-4ebb-9eec-01aa546de767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:39.895402 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-7bae0ace-b37f-4ebb-9eec-01aa546de767 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:39.897674 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7bae0ace-b37f-4ebb-9eec-01aa546de767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:39.954623 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1268/2528] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:39.964826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a622a-d5a1-4e67-8dff-226430f5f8e4 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:39.966242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ba0a622a-d5a1-4e67-8dff-226430f5f8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:40.024728 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a622a-d5a1-4e67-8dff-226430f5f8e4 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:40.028421 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c4726-9707-4266-9fa8-f626c59bb6ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:40.029064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c4726-9707-4266-9fa8-f626c59bb6ab service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:40.029351 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c4726-9707-4266-9fa8-f626c59bb6ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:40.029666 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c4726-9707-4266-9fa8-f626c59bb6ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:40.038786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c4726-9707-4266-9fa8-f626c59bb6ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:40.040220 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c4726-9707-4266-9fa8-f626c59bb6ab service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:40.049598 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1261/2529] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:40.317018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae0ace-b37f-4ebb-9eec-01aa546de767 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:40.318580 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7bae0ace-b37f-4ebb-9eec-01aa546de767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:40.333097 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae0ace-b37f-4ebb-9eec-01aa546de767 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:40.339071 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748fcf8-fd2e-4443-affb-e3719a4d8c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:40.340108 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748fcf8-fd2e-4443-affb-e3719a4d8c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:40.340433 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748fcf8-fd2e-4443-affb-e3719a4d8c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:40.340942 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748fcf8-fd2e-4443-affb-e3719a4d8c38 admin admin] PATH_INFO: `/v3/projects/b0c735e77146401097c16c5f5587340c` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:40.342390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0748fcf8-fd2e-4443-affb-e3719a4d8c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c735e77146401097c16c5f5587340c)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:40.344897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0748fcf8-fd2e-4443-affb-e3719a4d8c38 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:40.382935 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:40.394054 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0748fcf8-fd2e-4443-affb-e3719a4d8c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c735e77146401097c16c5f5587340c', 'request_id': 'req-0748fcf8-fd2e-4443-affb-e3719a4d8c38'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:40.400309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0748fcf8-fd2e-4443-affb-e3719a4d8c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c735e77146401097c16c5f5587340c', 'request_id': 'req-0748fcf8-fd2e-4443-affb-e3719a4d8c38'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:40.407464 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0748fcf8-fd2e-4443-affb-e3719a4d8c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c735e77146401097c16c5f5587340c', 'request_id': 'req-0748fcf8-fd2e-4443-affb-e3719a4d8c38'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:40.419305 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0748fcf8-fd2e-4443-affb-e3719a4d8c38 admin admin] The token cache is being invalidate because project b0c735e77146401097c16c5f5587340c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:48:40.419593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0748fcf8-fd2e-4443-affb-e3719a4d8c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:40.420218 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0748fcf8-fd2e-4443-affb-e3719a4d8c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:40.421848 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1269/2530] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:48:40 2022] DELETE /identity/v3/projects/b0c735e77146401097c16c5f5587340c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:40.426659 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff177b-437e-4b80-985d-31cafb0301d3 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:40.426949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff177b-437e-4b80-985d-31cafb0301d3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:40.427229 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ff177b-437e-4b80-985d-31cafb0301d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:40.439413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:40.446454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-46ff177b-437e-4b80-985d-31cafb0301d3 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:40.448252 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-46ff177b-437e-4b80-985d-31cafb0301d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:40.508068 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1262/2531] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:40.516428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6418d06-e0c0-4309-988c-ebf083a0c4c4 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:40.516428 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6418d06-e0c0-4309-988c-ebf083a0c4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:40.516629 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6418d06-e0c0-4309-988c-ebf083a0c4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:40.536177 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-e6418d06-e0c0-4309-988c-ebf083a0c4c4 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:40.537580 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e6418d06-e0c0-4309-988c-ebf083a0c4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:40.545455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1270/2532] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:40.549721 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff177b-437e-4b80-985d-31cafb0301d3 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:40.559426 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ff177b-437e-4b80-985d-31cafb0301d3 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:40.564159 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd252c-2480-4ebb-9391-8f99055a5f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:40.564818 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd252c-2480-4ebb-9391-8f99055a5f71 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:40.565104 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd252c-2480-4ebb-9391-8f99055a5f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:40.565407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd252c-2480-4ebb-9391-8f99055a5f71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:40.566156 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd252c-2480-4ebb-9391-8f99055a5f71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:48:40.566466 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd252c-2480-4ebb-9391-8f99055a5f71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:40.571107 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd252c-2480-4ebb-9391-8f99055a5f71 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:40.581281 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1263/2533] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:48:40.586283 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6418d06-e0c0-4309-988c-ebf083a0c4c4 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:40.595992 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6418d06-e0c0-4309-988c-ebf083a0c4c4 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:40.600961 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117c386-3468-4ac0-9c10-e74c37c87b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:40.601774 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117c386-3468-4ac0-9c10-e74c37c87b0d admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:40.602061 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117c386-3468-4ac0-9c10-e74c37c87b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:40.602342 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117c386-3468-4ac0-9c10-e74c37c87b0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:40.603043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117c386-3468-4ac0-9c10-e74c37c87b0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:40.604939 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e117c386-3468-4ac0-9c10-e74c37c87b0d admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:40.630528 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1271/2534] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:48:40 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:48:40.635293 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd252c-2480-4ebb-9391-8f99055a5f71 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:40.645081 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd252c-2480-4ebb-9391-8f99055a5f71 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:40.702628 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e58d31-3119-4e20-953c-1efb6525ae1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:40.703295 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e58d31-3119-4e20-953c-1efb6525ae1d admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:40.703584 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e58d31-3119-4e20-953c-1efb6525ae1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:40.703865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e58d31-3119-4e20-953c-1efb6525ae1d admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:40.704609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e58d31-3119-4e20-953c-1efb6525ae1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:40.706670 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e58d31-3119-4e20-953c-1efb6525ae1d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:40.726996 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1264/2535] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:48:40 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:40.731602 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117c386-3468-4ac0-9c10-e74c37c87b0d admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:40.742939 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117c386-3468-4ac0-9c10-e74c37c87b0d admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:40.748290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26ca55-688d-4db2-a23a-f1f701776e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:40.749024 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26ca55-688d-4db2-a23a-f1f701776e48 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:40.749530 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26ca55-688d-4db2-a23a-f1f701776e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:40.749811 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26ca55-688d-4db2-a23a-f1f701776e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:40.750534 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26ca55-688d-4db2-a23a-f1f701776e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:40.752119 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b26ca55-688d-4db2-a23a-f1f701776e48 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:40.763891 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1272/2536] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:40.767892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e58d31-3119-4e20-953c-1efb6525ae1d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:40.779688 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e58d31-3119-4e20-953c-1efb6525ae1d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:40.785028 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c1bac-11d8-4d99-b95d-81a11f56ff64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:40.785795 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c1bac-11d8-4d99-b95d-81a11f56ff64 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:40.786118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c1bac-11d8-4d99-b95d-81a11f56ff64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:40.786418 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c1bac-11d8-4d99-b95d-81a11f56ff64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:40.787296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c1bac-11d8-4d99-b95d-81a11f56ff64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:40.789065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c1bac-11d8-4d99-b95d-81a11f56ff64 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:40.799529 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1265/2537] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:40.804254 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26ca55-688d-4db2-a23a-f1f701776e48 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:40.814220 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26ca55-688d-4db2-a23a-f1f701776e48 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:40.819459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bc25c-7afa-48be-9773-c5f5b00afde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:40.820337 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bc25c-7afa-48be-9773-c5f5b00afde8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:40.820622 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bc25c-7afa-48be-9773-c5f5b00afde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:40.820898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61bc25c-7afa-48be-9773-c5f5b00afde8 admin admin] PATH_INFO: `/v3/projects/db7e220ccd5d454c893012c1edb394d3/users/bb9503fc73f040c7aba7d3af29ef6176/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:40.835968 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bc25c-7afa-48be-9773-c5f5b00afde8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db7e220ccd5d454c893012c1edb394d3, user_id=bb9503fc73f040c7aba7d3af29ef6176, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:40.838666 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61bc25c-7afa-48be-9773-c5f5b00afde8 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:40.851483 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1273/2538] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:48:40 2022] PUT /identity/v3/projects/db7e220ccd5d454c893012c1edb394d3/users/bb9503fc73f040c7aba7d3af29ef6176/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:40.862972 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c7de6-2f41-4e9f-af85-3bf8e6cea240 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:40.863293 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c7de6-2f41-4e9f-af85-3bf8e6cea240 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:40.863553 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c7de6-2f41-4e9f-af85-3bf8e6cea240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:40.895213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-8f2c7de6-2f41-4e9f-af85-3bf8e6cea240 None None] MFA Rules not processed for user `bb9503fc73f040c7aba7d3af29ef6176`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:40.896899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8f2c7de6-2f41-4e9f-af85-3bf8e6cea240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:40.963920 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1266/2539] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:40.974901 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bc25c-7afa-48be-9773-c5f5b00afde8 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:40.976615 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-f61bc25c-7afa-48be-9773-c5f5b00afde8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:41.059484 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61bc25c-7afa-48be-9773-c5f5b00afde8 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:41.063207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae663dc-40af-41bd-9df7-490185a5b2bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa134b748854fb3b4de54b04390eec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:41.063853 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae663dc-40af-41bd-9df7-490185a5b2bb service glance] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:41.064140 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae663dc-40af-41bd-9df7-490185a5b2bb service glance] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:41.064419 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae663dc-40af-41bd-9df7-490185a5b2bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:41.073203 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae663dc-40af-41bd-9df7-490185a5b2bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:41.074786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae663dc-40af-41bd-9df7-490185a5b2bb service glance] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:41.085496 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1274/2540] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:42.610542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c7de6-2f41-4e9f-af85-3bf8e6cea240 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:42.612013 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8f2c7de6-2f41-4e9f-af85-3bf8e6cea240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:42.618233 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:42.685070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c7de6-2f41-4e9f-af85-3bf8e6cea240 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:42.691573 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e1d5a-b0d8-4fcd-9ec3-a60a0093f6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:42.692853 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e1d5a-b0d8-4fcd-9ec3-a60a0093f6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:42.693140 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e1d5a-b0d8-4fcd-9ec3-a60a0093f6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:42.693978 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e1d5a-b0d8-4fcd-9ec3-a60a0093f6e8 admin admin] PATH_INFO: `/v3/users/454d3ef42bd7472494d6ac436a07e560` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:42.695246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e1d5a-b0d8-4fcd-9ec3-a60a0093f6e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=454d3ef42bd7472494d6ac436a07e560)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:42.697226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e1d5a-b0d8-4fcd-9ec3-a60a0093f6e8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:42.743487 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-476e1d5a-b0d8-4fcd-9ec3-a60a0093f6e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '454d3ef42bd7472494d6ac436a07e560'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:42.744146 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-476e1d5a-b0d8-4fcd-9ec3-a60a0093f6e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '454d3ef42bd7472494d6ac436a07e560'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:42.750952 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-476e1d5a-b0d8-4fcd-9ec3-a60a0093f6e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '454d3ef42bd7472494d6ac436a07e560'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:42.758612 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-476e1d5a-b0d8-4fcd-9ec3-a60a0093f6e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '454d3ef42bd7472494d6ac436a07e560'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:42.770091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-476e1d5a-b0d8-4fcd-9ec3-a60a0093f6e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '454d3ef42bd7472494d6ac436a07e560'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:42.777083 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1267/2541] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:48:42 2022] DELETE /identity/v3/users/454d3ef42bd7472494d6ac436a07e560 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:42.781720 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb339e0-1848-4060-8eec-95d1cf9d29e4 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:42.782205 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb339e0-1848-4060-8eec-95d1cf9d29e4 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:42.782322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb339e0-1848-4060-8eec-95d1cf9d29e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:42.799826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-9bb339e0-1848-4060-8eec-95d1cf9d29e4 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:42.801033 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-9bb339e0-1848-4060-8eec-95d1cf9d29e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:42.842025 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:42.864601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1275/2542] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:48:42.874397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e1d5a-b0d8-4fcd-9ec3-a60a0093f6e8 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:42.875844 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-476e1d5a-b0d8-4fcd-9ec3-a60a0093f6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:42.938543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e1d5a-b0d8-4fcd-9ec3-a60a0093f6e8 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:42.942241 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f5c8c-a93f-4fa0-b2fe-017f6b157a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:42.942886 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f5c8c-a93f-4fa0-b2fe-017f6b157a65 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:42.943761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f5c8c-a93f-4fa0-b2fe-017f6b157a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:42.944143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f5c8c-a93f-4fa0-b2fe-017f6b157a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:42.953711 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f5c8c-a93f-4fa0-b2fe-017f6b157a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:42.955149 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f5c8c-a93f-4fa0-b2fe-017f6b157a65 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:42.973065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1268/2543] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:43.289306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb339e0-1848-4060-8eec-95d1cf9d29e4 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:43.290841 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-9bb339e0-1848-4060-8eec-95d1cf9d29e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:43.312763 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb339e0-1848-4060-8eec-95d1cf9d29e4 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:43.320001 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63ebda-8719-4eef-8e29-e7c7a234f9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:43.320900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63ebda-8719-4eef-8e29-e7c7a234f9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:43.321123 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63ebda-8719-4eef-8e29-e7c7a234f9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:43.321427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63ebda-8719-4eef-8e29-e7c7a234f9b8 admin admin] PATH_INFO: `/v3/projects/28b1942d408d4f9f8e5b0cc28ed0e7b9` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:43.322615 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63ebda-8719-4eef-8e29-e7c7a234f9b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28b1942d408d4f9f8e5b0cc28ed0e7b9)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:43.324562 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63ebda-8719-4eef-8e29-e7c7a234f9b8 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:43.373689 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1d63ebda-8719-4eef-8e29-e7c7a234f9b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28b1942d408d4f9f8e5b0cc28ed0e7b9', 'request_id': 'req-1d63ebda-8719-4eef-8e29-e7c7a234f9b8'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:43.379697 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1d63ebda-8719-4eef-8e29-e7c7a234f9b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28b1942d408d4f9f8e5b0cc28ed0e7b9', 'request_id': 'req-1d63ebda-8719-4eef-8e29-e7c7a234f9b8'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:43.389468 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1d63ebda-8719-4eef-8e29-e7c7a234f9b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28b1942d408d4f9f8e5b0cc28ed0e7b9', 'request_id': 'req-1d63ebda-8719-4eef-8e29-e7c7a234f9b8'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:43.401317 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1d63ebda-8719-4eef-8e29-e7c7a234f9b8 admin admin] The token cache is being invalidate because project 28b1942d408d4f9f8e5b0cc28ed0e7b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:48:43.401699 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1d63ebda-8719-4eef-8e29-e7c7a234f9b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:43.402337 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1d63ebda-8719-4eef-8e29-e7c7a234f9b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:43.403872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1276/2544] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:48:43 2022] DELETE /identity/v3/projects/28b1942d408d4f9f8e5b0cc28ed0e7b9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:43.407855 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f5c8c-a93f-4fa0-b2fe-017f6b157a65 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:43.418779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f5c8c-a93f-4fa0-b2fe-017f6b157a65 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:43.441467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:43.490870 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b238ee0-5f67-4c1d-80d5-81407bcb6b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:43.491776 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b238ee0-5f67-4c1d-80d5-81407bcb6b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:43.492057 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b238ee0-5f67-4c1d-80d5-81407bcb6b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:43.492329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b238ee0-5f67-4c1d-80d5-81407bcb6b98 admin admin] PATH_INFO: `/v3/users/2fc28eb8dd77410d8fc7d8875e0d410d` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:43.493899 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b238ee0-5f67-4c1d-80d5-81407bcb6b98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fc28eb8dd77410d8fc7d8875e0d410d)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:43.495847 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b238ee0-5f67-4c1d-80d5-81407bcb6b98 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:43.564086 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-5b238ee0-5f67-4c1d-80d5-81407bcb6b98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fc28eb8dd77410d8fc7d8875e0d410d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:43.564739 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-5b238ee0-5f67-4c1d-80d5-81407bcb6b98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fc28eb8dd77410d8fc7d8875e0d410d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:43.573478 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-5b238ee0-5f67-4c1d-80d5-81407bcb6b98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fc28eb8dd77410d8fc7d8875e0d410d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:43.580526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-5b238ee0-5f67-4c1d-80d5-81407bcb6b98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fc28eb8dd77410d8fc7d8875e0d410d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:43.592648 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-5b238ee0-5f67-4c1d-80d5-81407bcb6b98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fc28eb8dd77410d8fc7d8875e0d410d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:43.598660 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1269/2545] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:48:43 2022] DELETE /identity/v3/users/2fc28eb8dd77410d8fc7d8875e0d410d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:43.914341 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63ebda-8719-4eef-8e29-e7c7a234f9b8 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:43.915780 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-1d63ebda-8719-4eef-8e29-e7c7a234f9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:43.928862 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63ebda-8719-4eef-8e29-e7c7a234f9b8 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:43.990689 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671a8e9-b790-4d80-a2e0-344bf1f9f7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:43.991556 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671a8e9-b790-4d80-a2e0-344bf1f9f7fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:43.991839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671a8e9-b790-4d80-a2e0-344bf1f9f7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:43.992183 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671a8e9-b790-4d80-a2e0-344bf1f9f7fb admin admin] PATH_INFO: `/v3/projects/6364d8dbb1e3454682e15063f403aaf1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:43.993313 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671a8e9-b790-4d80-a2e0-344bf1f9f7fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6364d8dbb1e3454682e15063f403aaf1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:43.995319 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671a8e9-b790-4d80-a2e0-344bf1f9f7fb admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:44.043892 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-8671a8e9-b790-4d80-a2e0-344bf1f9f7fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6364d8dbb1e3454682e15063f403aaf1', 'request_id': 'req-8671a8e9-b790-4d80-a2e0-344bf1f9f7fb'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:44.049397 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-8671a8e9-b790-4d80-a2e0-344bf1f9f7fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6364d8dbb1e3454682e15063f403aaf1', 'request_id': 'req-8671a8e9-b790-4d80-a2e0-344bf1f9f7fb'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:44.056911 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-8671a8e9-b790-4d80-a2e0-344bf1f9f7fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6364d8dbb1e3454682e15063f403aaf1', 'request_id': 'req-8671a8e9-b790-4d80-a2e0-344bf1f9f7fb'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:44.058931 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:44.070202 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-8671a8e9-b790-4d80-a2e0-344bf1f9f7fb admin admin] The token cache is being invalidate because project 6364d8dbb1e3454682e15063f403aaf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:48:44.070494 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-8671a8e9-b790-4d80-a2e0-344bf1f9f7fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:44.071133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-8671a8e9-b790-4d80-a2e0-344bf1f9f7fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:44.072746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1277/2546] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:48:43 2022] DELETE /identity/v3/projects/6364d8dbb1e3454682e15063f403aaf1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:44.077795 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484eeb55-5923-42e9-bf72-2acef674e6cb None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:44.078256 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484eeb55-5923-42e9-bf72-2acef674e6cb None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:44.078377 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484eeb55-5923-42e9-bf72-2acef674e6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:44.098079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-484eeb55-5923-42e9-bf72-2acef674e6cb None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:44.099221 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-484eeb55-5923-42e9-bf72-2acef674e6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:44.163594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1270/2547] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:48:44.171188 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383814a-1665-4d70-ad27-b730b1758d41 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:44.171484 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383814a-1665-4d70-ad27-b730b1758d41 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:44.171767 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383814a-1665-4d70-ad27-b730b1758d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:44.190030 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-3383814a-1665-4d70-ad27-b730b1758d41 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:44.191242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-3383814a-1665-4d70-ad27-b730b1758d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:44.200318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1278/2548] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:44.204697 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484eeb55-5923-42e9-bf72-2acef674e6cb None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:44.215292 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484eeb55-5923-42e9-bf72-2acef674e6cb None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:44.220218 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8385ed-8f44-48ee-b526-6ccb04c3b778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:44.220911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8385ed-8f44-48ee-b526-6ccb04c3b778 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:44.221408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8385ed-8f44-48ee-b526-6ccb04c3b778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:44.221619 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8385ed-8f44-48ee-b526-6ccb04c3b778 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:44.222371 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8385ed-8f44-48ee-b526-6ccb04c3b778 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:48:44.222672 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8385ed-8f44-48ee-b526-6ccb04c3b778 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:44.224615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8385ed-8f44-48ee-b526-6ccb04c3b778 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:44.237536 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1271/2549] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:48:44.242073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383814a-1665-4d70-ad27-b730b1758d41 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:44.251272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383814a-1665-4d70-ad27-b730b1758d41 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:44.256461 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c5cc2-dab9-4bb4-9836-7d4629405510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:44.257107 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c5cc2-dab9-4bb4-9836-7d4629405510 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:44.257424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c5cc2-dab9-4bb4-9836-7d4629405510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:44.257708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933c5cc2-dab9-4bb4-9836-7d4629405510 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:44.258395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c5cc2-dab9-4bb4-9836-7d4629405510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:44.260302 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933c5cc2-dab9-4bb4-9836-7d4629405510 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:44.287342 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1279/2550] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:48:44 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:44.291358 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8385ed-8f44-48ee-b526-6ccb04c3b778 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:44.301555 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8385ed-8f44-48ee-b526-6ccb04c3b778 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:44.334440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:44.369978 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce0efe-54ad-4eb8-a40d-c23ae5715c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:44.370583 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce0efe-54ad-4eb8-a40d-c23ae5715c9d admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:44.370865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce0efe-54ad-4eb8-a40d-c23ae5715c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:44.371142 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce0efe-54ad-4eb8-a40d-c23ae5715c9d admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:44.371826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce0efe-54ad-4eb8-a40d-c23ae5715c9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:44.374013 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce0efe-54ad-4eb8-a40d-c23ae5715c9d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:44.400114 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1272/2551] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:48:44 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:44.401410 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c5cc2-dab9-4bb4-9836-7d4629405510 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:44.411670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933c5cc2-dab9-4bb4-9836-7d4629405510 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:44.417113 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02e6a9-2a81-4910-912d-610a6b3da177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:44.417926 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02e6a9-2a81-4910-912d-610a6b3da177 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:44.418304 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02e6a9-2a81-4910-912d-610a6b3da177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:44.418710 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02e6a9-2a81-4910-912d-610a6b3da177 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:44.419538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02e6a9-2a81-4910-912d-610a6b3da177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:44.421352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02e6a9-2a81-4910-912d-610a6b3da177 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:44.434283 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1280/2552] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:44.438311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce0efe-54ad-4eb8-a40d-c23ae5715c9d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:44.449106 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce0efe-54ad-4eb8-a40d-c23ae5715c9d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:44.453834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99884a1-a2d2-4af4-b034-f12813297b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:44.454493 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99884a1-a2d2-4af4-b034-f12813297b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:44.454800 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99884a1-a2d2-4af4-b034-f12813297b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:44.455059 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99884a1-a2d2-4af4-b034-f12813297b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:44.455813 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99884a1-a2d2-4af4-b034-f12813297b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:44.457469 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99884a1-a2d2-4af4-b034-f12813297b60 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:44.470507 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1273/2553] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:44.474794 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02e6a9-2a81-4910-912d-610a6b3da177 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:44.484949 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02e6a9-2a81-4910-912d-610a6b3da177 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:44.490166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e4d98-5649-40d6-8f83-1bb82e6153d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:44.491013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e4d98-5649-40d6-8f83-1bb82e6153d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:44.491410 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e4d98-5649-40d6-8f83-1bb82e6153d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:44.491697 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e4d98-5649-40d6-8f83-1bb82e6153d3 admin admin] PATH_INFO: `/v3/projects/448661ff134343298a32059a07014402/users/7d701d135fc94d22b6f275e7e2e41d2c/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:44.507628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e4d98-5649-40d6-8f83-1bb82e6153d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=448661ff134343298a32059a07014402, user_id=7d701d135fc94d22b6f275e7e2e41d2c, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:44.510317 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e4d98-5649-40d6-8f83-1bb82e6153d3 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:44.523452 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1281/2554] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:48:44 2022] PUT /identity/v3/projects/448661ff134343298a32059a07014402/users/7d701d135fc94d22b6f275e7e2e41d2c/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:44.533698 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d85ad5-55eb-4d71-b4c5-f5eaacbd0ebe None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:44.534124 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d85ad5-55eb-4d71-b4c5-f5eaacbd0ebe None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:44.534413 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d85ad5-55eb-4d71-b4c5-f5eaacbd0ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:44.563559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-16d85ad5-55eb-4d71-b4c5-f5eaacbd0ebe None None] MFA Rules not processed for user `7d701d135fc94d22b6f275e7e2e41d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:44.564779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-16d85ad5-55eb-4d71-b4c5-f5eaacbd0ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:44.633513 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1274/2555] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:44 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:44.637969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e4d98-5649-40d6-8f83-1bb82e6153d3 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:44.706296 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e4d98-5649-40d6-8f83-1bb82e6153d3 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:44.711127 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd5c58-7fdf-4c13-a8d4-7073341dd718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:44.711818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd5c58-7fdf-4c13-a8d4-7073341dd718 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:44.712103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd5c58-7fdf-4c13-a8d4-7073341dd718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:44.712382 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd5c58-7fdf-4c13-a8d4-7073341dd718 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:44.713070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd5c58-7fdf-4c13-a8d4-7073341dd718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:44.715208 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd5c58-7fdf-4c13-a8d4-7073341dd718 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:44.740521 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1282/2556] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:48:44 2022] POST /identity/v3/projects => generated 361 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:44.744457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d85ad5-55eb-4d71-b4c5-f5eaacbd0ebe None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:44.755094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d85ad5-55eb-4d71-b4c5-f5eaacbd0ebe None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:44.819050 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e0744-cbf2-481b-8eb0-97c600609bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:44.819283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e0744-cbf2-481b-8eb0-97c600609bbf admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:44.819668 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e0744-cbf2-481b-8eb0-97c600609bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:44.819863 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e0744-cbf2-481b-8eb0-97c600609bbf admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:44.820545 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e0744-cbf2-481b-8eb0-97c600609bbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:44.822513 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e0744-cbf2-481b-8eb0-97c600609bbf admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:44.842838 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1275/2557] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:48:44 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:44.846742 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd5c58-7fdf-4c13-a8d4-7073341dd718 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:44.857994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd5c58-7fdf-4c13-a8d4-7073341dd718 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:44.862859 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818dbc4c-0242-4dcd-bc09-79009ed6c882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:44.863538 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dbc4c-0242-4dcd-bc09-79009ed6c882 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:44.863825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dbc4c-0242-4dcd-bc09-79009ed6c882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:44.864126 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818dbc4c-0242-4dcd-bc09-79009ed6c882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:44.864839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818dbc4c-0242-4dcd-bc09-79009ed6c882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:44.867010 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818dbc4c-0242-4dcd-bc09-79009ed6c882 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:44.878196 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1283/2558] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:44.883167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e0744-cbf2-481b-8eb0-97c600609bbf admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:44.893440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e0744-cbf2-481b-8eb0-97c600609bbf admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:44.898348 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25045b6d-a23f-4a0d-ac72-c63518afa814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:44.899218 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25045b6d-a23f-4a0d-ac72-c63518afa814 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:44.899501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25045b6d-a23f-4a0d-ac72-c63518afa814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:44.899782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25045b6d-a23f-4a0d-ac72-c63518afa814 admin admin] PATH_INFO: `/v3/projects/382fb1e08564491195d3b3c81ab980ea/users/0f864d8acce74d23b2218bf0776d371c/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:44.914983 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25045b6d-a23f-4a0d-ac72-c63518afa814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=382fb1e08564491195d3b3c81ab980ea, user_id=0f864d8acce74d23b2218bf0776d371c, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:44.917716 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25045b6d-a23f-4a0d-ac72-c63518afa814 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:44.933422 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1276/2559] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:48:44 2022] PUT /identity/v3/projects/382fb1e08564491195d3b3c81ab980ea/users/0f864d8acce74d23b2218bf0776d371c/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:44.937422 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818dbc4c-0242-4dcd-bc09-79009ed6c882 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:44.947313 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818dbc4c-0242-4dcd-bc09-79009ed6c882 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:45.005969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e81a3-256b-4580-9318-8c757fbbacd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:45.006644 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e81a3-256b-4580-9318-8c757fbbacd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:45.006929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e81a3-256b-4580-9318-8c757fbbacd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:45.007239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e81a3-256b-4580-9318-8c757fbbacd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:45.007967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e81a3-256b-4580-9318-8c757fbbacd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:45.009618 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505e81a3-256b-4580-9318-8c757fbbacd2 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:45.019939 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1284/2560] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:45.024556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25045b6d-a23f-4a0d-ac72-c63518afa814 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:45.035000 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:45.041921 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25045b6d-a23f-4a0d-ac72-c63518afa814 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:45.047502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c0d9f-9e2c-4cf8-b78b-555b63ed53df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:45.048389 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c0d9f-9e2c-4cf8-b78b-555b63ed53df admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:45.048672 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c0d9f-9e2c-4cf8-b78b-555b63ed53df admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:45.048948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c0d9f-9e2c-4cf8-b78b-555b63ed53df admin admin] PATH_INFO: `/v3/projects/382fb1e08564491195d3b3c81ab980ea/users/0f864d8acce74d23b2218bf0776d371c/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:45.050986 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c0d9f-9e2c-4cf8-b78b-555b63ed53df admin admin] RBAC: Authorizing `identity:create_grant(project_id=382fb1e08564491195d3b3c81ab980ea, user_id=0f864d8acce74d23b2218bf0776d371c, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:45.053792 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c0d9f-9e2c-4cf8-b78b-555b63ed53df admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:45.064785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1277/2561] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:48:45 2022] PUT /identity/v3/projects/382fb1e08564491195d3b3c81ab980ea/users/0f864d8acce74d23b2218bf0776d371c/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:45.076215 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dd183-1909-4ca2-89b2-51e7dbecad01 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:45.076507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dd183-1909-4ca2-89b2-51e7dbecad01 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:45.076792 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08dd183-1909-4ca2-89b2-51e7dbecad01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:45.082713 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:45.114452 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-e08dd183-1909-4ca2-89b2-51e7dbecad01 None None] MFA Rules not processed for user `0f864d8acce74d23b2218bf0776d371c`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:45.116681 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e08dd183-1909-4ca2-89b2-51e7dbecad01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:45.212753 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1285/2562] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:45 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:45.223729 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c0d9f-9e2c-4cf8-b78b-555b63ed53df admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:45.226216 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-648c0d9f-9e2c-4cf8-b78b-555b63ed53df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:45.289735 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c0d9f-9e2c-4cf8-b78b-555b63ed53df admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:45.293605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095a1ad-9bd2-41e0-aa68-6ad40d3f97f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:45.296395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095a1ad-9bd2-41e0-aa68-6ad40d3f97f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:45.296395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095a1ad-9bd2-41e0-aa68-6ad40d3f97f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:45.296395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095a1ad-9bd2-41e0-aa68-6ad40d3f97f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:45.305955 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095a1ad-9bd2-41e0-aa68-6ad40d3f97f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:45.307418 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095a1ad-9bd2-41e0-aa68-6ad40d3f97f4 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:45.317885 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1278/2563] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:45 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:45.398981 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08dd183-1909-4ca2-89b2-51e7dbecad01 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:45.409189 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08dd183-1909-4ca2-89b2-51e7dbecad01 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:45.413600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4d036-13b0-45d1-b9d1-ac0a43afae3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:45.414273 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4d036-13b0-45d1-b9d1-ac0a43afae3c service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:45.414557 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4d036-13b0-45d1-b9d1-ac0a43afae3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:45.414832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4d036-13b0-45d1-b9d1-ac0a43afae3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:45.498906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4d036-13b0-45d1-b9d1-ac0a43afae3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:45.500352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4d036-13b0-45d1-b9d1-ac0a43afae3c service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:45.519165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1286/2564] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:45 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:48.310524 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095a1ad-9bd2-41e0-aa68-6ad40d3f97f4 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:48.371234 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095a1ad-9bd2-41e0-aa68-6ad40d3f97f4 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:48.375762 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613bca8-ecc3-495c-a9a7-92e1629f5335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:48.376622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613bca8-ecc3-495c-a9a7-92e1629f5335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:48.376943 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613bca8-ecc3-495c-a9a7-92e1629f5335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:48.377222 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613bca8-ecc3-495c-a9a7-92e1629f5335 admin admin] PATH_INFO: `/v3/users/7d701d135fc94d22b6f275e7e2e41d2c` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:48.378432 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613bca8-ecc3-495c-a9a7-92e1629f5335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d701d135fc94d22b6f275e7e2e41d2c)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:48.380388 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613bca8-ecc3-495c-a9a7-92e1629f5335 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:48.424502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2613bca8-ecc3-495c-a9a7-92e1629f5335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d701d135fc94d22b6f275e7e2e41d2c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:48.425145 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2613bca8-ecc3-495c-a9a7-92e1629f5335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d701d135fc94d22b6f275e7e2e41d2c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:48.432269 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2613bca8-ecc3-495c-a9a7-92e1629f5335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d701d135fc94d22b6f275e7e2e41d2c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:48.438980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2613bca8-ecc3-495c-a9a7-92e1629f5335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d701d135fc94d22b6f275e7e2e41d2c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:48.450937 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2613bca8-ecc3-495c-a9a7-92e1629f5335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d701d135fc94d22b6f275e7e2e41d2c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:48.456613 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1279/2565] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:48:48 2022] DELETE /identity/v3/users/7d701d135fc94d22b6f275e7e2e41d2c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:48.462075 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6c360-ed21-4142-b2bd-8578c24ffcab None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:48.462541 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6c360-ed21-4142-b2bd-8578c24ffcab None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:48.462657 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6c360-ed21-4142-b2bd-8578c24ffcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:48.480432 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-0cf6c360-ed21-4142-b2bd-8578c24ffcab None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:48.481662 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-0cf6c360-ed21-4142-b2bd-8578c24ffcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:48.541775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1287/2566] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:48.551245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613bca8-ecc3-495c-a9a7-92e1629f5335 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:48.552876 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2613bca8-ecc3-495c-a9a7-92e1629f5335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:48.567342 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:48.613240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613bca8-ecc3-495c-a9a7-92e1629f5335 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:48.617151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fec69-9e4b-4d73-8d47-9eb25f9fb1d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:48.617826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fec69-9e4b-4d73-8d47-9eb25f9fb1d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:48.618107 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fec69-9e4b-4d73-8d47-9eb25f9fb1d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:48.618381 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fec69-9e4b-4d73-8d47-9eb25f9fb1d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:48.627535 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fec69-9e4b-4d73-8d47-9eb25f9fb1d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:48.628960 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60fec69-9e4b-4d73-8d47-9eb25f9fb1d8 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:48.642424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1280/2567] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:48.912894 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6c360-ed21-4142-b2bd-8578c24ffcab None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:48.915189 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-0cf6c360-ed21-4142-b2bd-8578c24ffcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:48.927771 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6c360-ed21-4142-b2bd-8578c24ffcab None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:48.944727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba879c2-a916-4610-9a85-bac619c1b29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:48.945716 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba879c2-a916-4610-9a85-bac619c1b29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:48.945997 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba879c2-a916-4610-9a85-bac619c1b29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:48.946274 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba879c2-a916-4610-9a85-bac619c1b29f admin admin] PATH_INFO: `/v3/projects/448661ff134343298a32059a07014402` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:48.947471 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba879c2-a916-4610-9a85-bac619c1b29f admin admin] RBAC: Authorizing `identity:delete_project(project_id=448661ff134343298a32059a07014402)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:48.949490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba879c2-a916-4610-9a85-bac619c1b29f admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:48.976155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:49.000694 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0ba879c2-a916-4610-9a85-bac619c1b29f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '448661ff134343298a32059a07014402', 'request_id': 'req-0ba879c2-a916-4610-9a85-bac619c1b29f'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:49.006803 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0ba879c2-a916-4610-9a85-bac619c1b29f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '448661ff134343298a32059a07014402', 'request_id': 'req-0ba879c2-a916-4610-9a85-bac619c1b29f'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:49.014017 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0ba879c2-a916-4610-9a85-bac619c1b29f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '448661ff134343298a32059a07014402', 'request_id': 'req-0ba879c2-a916-4610-9a85-bac619c1b29f'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:49.025318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0ba879c2-a916-4610-9a85-bac619c1b29f admin admin] The token cache is being invalidate because project 448661ff134343298a32059a07014402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:48:49.025632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0ba879c2-a916-4610-9a85-bac619c1b29f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:49.026276 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-0ba879c2-a916-4610-9a85-bac619c1b29f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:49.027803 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1288/2568] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:48:48 2022] DELETE /identity/v3/projects/448661ff134343298a32059a07014402 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:48:49.032030 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fec69-9e4b-4d73-8d47-9eb25f9fb1d8 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:49.044386 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fec69-9e4b-4d73-8d47-9eb25f9fb1d8 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:49.100127 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5541075c-9b63-4da2-b0e8-aa8a17cb65a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:49.100982 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541075c-9b63-4da2-b0e8-aa8a17cb65a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:49.101260 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541075c-9b63-4da2-b0e8-aa8a17cb65a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:49.101561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5541075c-9b63-4da2-b0e8-aa8a17cb65a0 admin admin] PATH_INFO: `/v3/users/0f864d8acce74d23b2218bf0776d371c` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:49.102751 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541075c-9b63-4da2-b0e8-aa8a17cb65a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f864d8acce74d23b2218bf0776d371c)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:49.104666 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5541075c-9b63-4da2-b0e8-aa8a17cb65a0 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:49.154180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-5541075c-9b63-4da2-b0e8-aa8a17cb65a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f864d8acce74d23b2218bf0776d371c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:49.154830 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-5541075c-9b63-4da2-b0e8-aa8a17cb65a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f864d8acce74d23b2218bf0776d371c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:49.162198 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-5541075c-9b63-4da2-b0e8-aa8a17cb65a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f864d8acce74d23b2218bf0776d371c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:49.169062 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-5541075c-9b63-4da2-b0e8-aa8a17cb65a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f864d8acce74d23b2218bf0776d371c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:49.181607 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-5541075c-9b63-4da2-b0e8-aa8a17cb65a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f864d8acce74d23b2218bf0776d371c'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:49.187596 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1281/2569] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:48:49 2022] DELETE /identity/v3/users/0f864d8acce74d23b2218bf0776d371c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:49.463295 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba879c2-a916-4610-9a85-bac619c1b29f admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:49.464973 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-0ba879c2-a916-4610-9a85-bac619c1b29f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:49.481551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba879c2-a916-4610-9a85-bac619c1b29f admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:49.539343 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3d43e-d83d-4e80-b59d-b75578b9fb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:49.540114 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d43e-d83d-4e80-b59d-b75578b9fb1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:49.540392 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d43e-d83d-4e80-b59d-b75578b9fb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:49.540665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3d43e-d83d-4e80-b59d-b75578b9fb1d admin admin] PATH_INFO: `/v3/projects/382fb1e08564491195d3b3c81ab980ea` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:49.541937 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3d43e-d83d-4e80-b59d-b75578b9fb1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=382fb1e08564491195d3b3c81ab980ea)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:49.543818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3d43e-d83d-4e80-b59d-b75578b9fb1d admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:49.591678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a6b3d43e-d83d-4e80-b59d-b75578b9fb1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '382fb1e08564491195d3b3c81ab980ea', 'request_id': 'req-a6b3d43e-d83d-4e80-b59d-b75578b9fb1d'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:49.597725 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a6b3d43e-d83d-4e80-b59d-b75578b9fb1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '382fb1e08564491195d3b3c81ab980ea', 'request_id': 'req-a6b3d43e-d83d-4e80-b59d-b75578b9fb1d'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:49.606431 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a6b3d43e-d83d-4e80-b59d-b75578b9fb1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '382fb1e08564491195d3b3c81ab980ea', 'request_id': 'req-a6b3d43e-d83d-4e80-b59d-b75578b9fb1d'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:49.618224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a6b3d43e-d83d-4e80-b59d-b75578b9fb1d admin admin] The token cache is being invalidate because project 382fb1e08564491195d3b3c81ab980ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:48:49.618511 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a6b3d43e-d83d-4e80-b59d-b75578b9fb1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:49.619144 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a6b3d43e-d83d-4e80-b59d-b75578b9fb1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:48:49.620683 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1289/2570] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:48:49 2022] DELETE /identity/v3/projects/382fb1e08564491195d3b3c81ab980ea => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:48:49.625473 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9495f5-69bf-4902-a05d-5f7eaf57b72a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:49.625955 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9495f5-69bf-4902-a05d-5f7eaf57b72a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:49.626050 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9495f5-69bf-4902-a05d-5f7eaf57b72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:49.644129 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0d9495f5-69bf-4902-a05d-5f7eaf57b72a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:49.645315 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0d9495f5-69bf-4902-a05d-5f7eaf57b72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:49.675638 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:49.709112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1282/2571] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:49.716905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780a37e-d2da-4d9c-83ba-f7926f8025f0 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:49.717199 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780a37e-d2da-4d9c-83ba-f7926f8025f0 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:49.717525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780a37e-d2da-4d9c-83ba-f7926f8025f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:49.736541 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-9780a37e-d2da-4d9c-83ba-f7926f8025f0 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:49.737767 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-9780a37e-d2da-4d9c-83ba-f7926f8025f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:49.746416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1290/2572] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:48:49.750559 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9495f5-69bf-4902-a05d-5f7eaf57b72a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:49.760293 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9495f5-69bf-4902-a05d-5f7eaf57b72a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:49.764868 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09a100-5e3f-4bd5-b269-9fa626ca19f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:49.765552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09a100-5e3f-4bd5-b269-9fa626ca19f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:49.765841 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09a100-5e3f-4bd5-b269-9fa626ca19f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:49.766121 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09a100-5e3f-4bd5-b269-9fa626ca19f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:49.766856 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09a100-5e3f-4bd5-b269-9fa626ca19f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:48:49.767165 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09a100-5e3f-4bd5-b269-9fa626ca19f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:49.768768 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09a100-5e3f-4bd5-b269-9fa626ca19f1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:49.780889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1283/2573] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:48:49.784877 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780a37e-d2da-4d9c-83ba-f7926f8025f0 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:49.794932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780a37e-d2da-4d9c-83ba-f7926f8025f0 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:49.799595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b29d6-80d0-4f59-9192-a453dcd40be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:49.800310 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b29d6-80d0-4f59-9192-a453dcd40be3 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:49.800598 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b29d6-80d0-4f59-9192-a453dcd40be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:49.800927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b29d6-80d0-4f59-9192-a453dcd40be3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:49.801832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b29d6-80d0-4f59-9192-a453dcd40be3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:49.804360 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b29d6-80d0-4f59-9192-a453dcd40be3 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:49.836296 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1291/2574] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:48:49 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:48:49.840483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09a100-5e3f-4bd5-b269-9fa626ca19f1 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:49.850407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09a100-5e3f-4bd5-b269-9fa626ca19f1 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:49.909660 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97809e-c81d-4814-8d8f-c52faf5073d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:49.910319 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97809e-c81d-4814-8d8f-c52faf5073d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:49.910600 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97809e-c81d-4814-8d8f-c52faf5073d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:49.910870 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97809e-c81d-4814-8d8f-c52faf5073d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:49.911545 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97809e-c81d-4814-8d8f-c52faf5073d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:49.914153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97809e-c81d-4814-8d8f-c52faf5073d5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:49.932946 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1284/2575] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:48:49 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:49.937045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b29d6-80d0-4f59-9192-a453dcd40be3 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:49.947675 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b29d6-80d0-4f59-9192-a453dcd40be3 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:49.952185 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20211ea5-62f8-4786-9514-6e73e8e5f44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:49.952837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20211ea5-62f8-4786-9514-6e73e8e5f44d admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:49.953121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20211ea5-62f8-4786-9514-6e73e8e5f44d admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:49.953418 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20211ea5-62f8-4786-9514-6e73e8e5f44d admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:49.954137 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20211ea5-62f8-4786-9514-6e73e8e5f44d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:49.955726 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20211ea5-62f8-4786-9514-6e73e8e5f44d admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:49.961455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:49.968934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1292/2576] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:49.972294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97809e-c81d-4814-8d8f-c52faf5073d5 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:49.988362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97809e-c81d-4814-8d8f-c52faf5073d5 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:49.994486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdca85-9dd8-49e7-bd5d-fff7ba1808b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:49.995164 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdca85-9dd8-49e7-bd5d-fff7ba1808b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:49.995453 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdca85-9dd8-49e7-bd5d-fff7ba1808b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:49.995754 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdca85-9dd8-49e7-bd5d-fff7ba1808b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:49.996491 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdca85-9dd8-49e7-bd5d-fff7ba1808b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:49.998634 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdca85-9dd8-49e7-bd5d-fff7ba1808b8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:50.012018 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1285/2577] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:50.016392 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20211ea5-62f8-4786-9514-6e73e8e5f44d admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:50.029144 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20211ea5-62f8-4786-9514-6e73e8e5f44d admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:50.033943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19cfa0-5640-4d87-a53c-c292768a5663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:50.034826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19cfa0-5640-4d87-a53c-c292768a5663 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:50.035124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19cfa0-5640-4d87-a53c-c292768a5663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:50.035391 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19cfa0-5640-4d87-a53c-c292768a5663 admin admin] PATH_INFO: `/v3/projects/945cca55c5b14a89ad177d62e5febf4e/users/8b0275bff4894f36b648d6ae2b304877/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:50.051356 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19cfa0-5640-4d87-a53c-c292768a5663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=945cca55c5b14a89ad177d62e5febf4e, user_id=8b0275bff4894f36b648d6ae2b304877, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:50.054053 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19cfa0-5640-4d87-a53c-c292768a5663 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:50.066582 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1293/2578] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:48:50 2022] PUT /identity/v3/projects/945cca55c5b14a89ad177d62e5febf4e/users/8b0275bff4894f36b648d6ae2b304877/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:48:50.077951 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e38cd-6f68-480f-a3ca-3bdb10c257b3 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:50.078244 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e38cd-6f68-480f-a3ca-3bdb10c257b3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:50.078529 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e38cd-6f68-480f-a3ca-3bdb10c257b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:50.108269 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d95e38cd-6f68-480f-a3ca-3bdb10c257b3 None None] MFA Rules not processed for user `8b0275bff4894f36b648d6ae2b304877`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:50.109566 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d95e38cd-6f68-480f-a3ca-3bdb10c257b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:50.175121 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1286/2579] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:50.179795 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19cfa0-5640-4d87-a53c-c292768a5663 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:50.241485 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19cfa0-5640-4d87-a53c-c292768a5663 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:50.246302 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b528ae6-c685-438d-baab-f920de0ef896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:50.246961 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b528ae6-c685-438d-baab-f920de0ef896 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:50.247246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b528ae6-c685-438d-baab-f920de0ef896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:50.247541 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b528ae6-c685-438d-baab-f920de0ef896 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:50.248213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b528ae6-c685-438d-baab-f920de0ef896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:50.250133 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b528ae6-c685-438d-baab-f920de0ef896 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:50.276404 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1294/2580] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:48:50 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:50.280477 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e38cd-6f68-480f-a3ca-3bdb10c257b3 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:50.291775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e38cd-6f68-480f-a3ca-3bdb10c257b3 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:50.320669 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:50.352296 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10fd79-c965-466e-9b45-60e1e5d06cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:50.352965 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10fd79-c965-466e-9b45-60e1e5d06cae admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:50.353247 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10fd79-c965-466e-9b45-60e1e5d06cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:50.353548 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10fd79-c965-466e-9b45-60e1e5d06cae admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:50.354230 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10fd79-c965-466e-9b45-60e1e5d06cae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:50.356132 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10fd79-c965-466e-9b45-60e1e5d06cae admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:50.374836 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1287/2581] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:48:50 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:48:50.378845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b528ae6-c685-438d-baab-f920de0ef896 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:50.389682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b528ae6-c685-438d-baab-f920de0ef896 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:50.394330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddd01f-d5b9-4643-8c24-3f161ec72816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:50.394982 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddd01f-d5b9-4643-8c24-3f161ec72816 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:50.395267 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddd01f-d5b9-4643-8c24-3f161ec72816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:50.395551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddd01f-d5b9-4643-8c24-3f161ec72816 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:50.396520 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddd01f-d5b9-4643-8c24-3f161ec72816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:50.398924 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddd01f-d5b9-4643-8c24-3f161ec72816 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:50.409434 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1295/2582] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:50.413354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10fd79-c965-466e-9b45-60e1e5d06cae admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:50.423315 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10fd79-c965-466e-9b45-60e1e5d06cae admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:50.427885 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d077890-de89-4978-9845-c9652efa21dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:50.428745 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d077890-de89-4978-9845-c9652efa21dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:50.429112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d077890-de89-4978-9845-c9652efa21dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:50.429545 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d077890-de89-4978-9845-c9652efa21dc admin admin] PATH_INFO: `/v3/projects/703863965015453aa7b46d268c466e1d/users/08a59d2372514c0c97445568b08de9b8/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:50.443779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d077890-de89-4978-9845-c9652efa21dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=703863965015453aa7b46d268c466e1d, user_id=08a59d2372514c0c97445568b08de9b8, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:50.446939 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d077890-de89-4978-9845-c9652efa21dc admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:50.459679 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1288/2583] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:48:50 2022] PUT /identity/v3/projects/703863965015453aa7b46d268c466e1d/users/08a59d2372514c0c97445568b08de9b8/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:50.465091 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddd01f-d5b9-4643-8c24-3f161ec72816 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:50.475987 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddd01f-d5b9-4643-8c24-3f161ec72816 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:50.532178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90e4d5-48fb-4c6b-8c76-b74c376874d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:50.532834 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90e4d5-48fb-4c6b-8c76-b74c376874d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:50.533117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90e4d5-48fb-4c6b-8c76-b74c376874d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:50.533455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90e4d5-48fb-4c6b-8c76-b74c376874d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:50.534149 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90e4d5-48fb-4c6b-8c76-b74c376874d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:50.535757 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90e4d5-48fb-4c6b-8c76-b74c376874d9 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:50.545358 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1296/2584] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:48:50.549530 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d077890-de89-4978-9845-c9652efa21dc admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:50.560689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d077890-de89-4978-9845-c9652efa21dc admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:50.565578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629708c7-f3db-4201-aed6-7bb7e480bba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:50.566485 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629708c7-f3db-4201-aed6-7bb7e480bba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:50.566769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629708c7-f3db-4201-aed6-7bb7e480bba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:50.567043 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629708c7-f3db-4201-aed6-7bb7e480bba6 admin admin] PATH_INFO: `/v3/projects/703863965015453aa7b46d268c466e1d/users/08a59d2372514c0c97445568b08de9b8/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:50.569036 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629708c7-f3db-4201-aed6-7bb7e480bba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=703863965015453aa7b46d268c466e1d, user_id=08a59d2372514c0c97445568b08de9b8, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:50.572567 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629708c7-f3db-4201-aed6-7bb7e480bba6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:50.583378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1289/2585] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:48:50 2022] PUT /identity/v3/projects/703863965015453aa7b46d268c466e1d/users/08a59d2372514c0c97445568b08de9b8/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:48:50.594003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5420d-463d-4a45-a400-5fb275f104f2 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:50.594291 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5420d-463d-4a45-a400-5fb275f104f2 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:50.594571 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5420d-463d-4a45-a400-5fb275f104f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:50.621317 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-8dd5420d-463d-4a45-a400-5fb275f104f2 None None] MFA Rules not processed for user `08a59d2372514c0c97445568b08de9b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:50.622530 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-8dd5420d-463d-4a45-a400-5fb275f104f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:50.660974 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:50.698353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1297/2586] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:50.709145 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629708c7-f3db-4201-aed6-7bb7e480bba6 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:50.711001 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-629708c7-f3db-4201-aed6-7bb7e480bba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:50.772781 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629708c7-f3db-4201-aed6-7bb7e480bba6 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:50.776407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe6771d-757e-48da-ae3c-89a2b67d47cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:50.777046 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6771d-757e-48da-ae3c-89a2b67d47cd service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:50.777329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6771d-757e-48da-ae3c-89a2b67d47cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:50.777638 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe6771d-757e-48da-ae3c-89a2b67d47cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:50.836127 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6771d-757e-48da-ae3c-89a2b67d47cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:50.837310 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe6771d-757e-48da-ae3c-89a2b67d47cd service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:50.847411 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1290/2587] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:56.514869 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5420d-463d-4a45-a400-5fb275f104f2 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:56.524804 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5420d-463d-4a45-a400-5fb275f104f2 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:48:56.528281 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36677bb-040f-4cd4-abfd-c147bd0922c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:48:56.528918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36677bb-040f-4cd4-abfd-c147bd0922c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:56.529201 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36677bb-040f-4cd4-abfd-c147bd0922c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:56.529514 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36677bb-040f-4cd4-abfd-c147bd0922c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:56.538522 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36677bb-040f-4cd4-abfd-c147bd0922c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:48:56.539934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36677bb-040f-4cd4-abfd-c147bd0922c7 service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:48:56.549195 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1298/2588] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:48:59.677787 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c084d2-083e-4709-b4c0-abb44c0f4644 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:48:59.679033 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c084d2-083e-4709-b4c0-abb44c0f4644 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:48:59.679033 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c084d2-083e-4709-b4c0-abb44c0f4644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:48:59.698123 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-49c084d2-083e-4709-b4c0-abb44c0f4644 None None] MFA Rules not processed for user `2900dfb691734898a5fd1ac12207cebf`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:48:59.699302 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-49c084d2-083e-4709-b4c0-abb44c0f4644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:48:59.731252 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:48:59.754170 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1291/2589] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:48:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:48:59.986178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36677bb-040f-4cd4-abfd-c147bd0922c7 service cinder] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:48:59.987591 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-a36677bb-040f-4cd4-abfd-c147bd0922c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:00.045322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36677bb-040f-4cd4-abfd-c147bd0922c7 service cinder] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:00.048928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65399a2b-ac85-4d78-a323-86000875d426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:00.049643 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65399a2b-ac85-4d78-a323-86000875d426 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:00.049931 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65399a2b-ac85-4d78-a323-86000875d426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:00.050213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65399a2b-ac85-4d78-a323-86000875d426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:00.051982 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-65399a2b-ac85-4d78-a323-86000875d426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:00.061594 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65399a2b-ac85-4d78-a323-86000875d426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:00.063020 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65399a2b-ac85-4d78-a323-86000875d426 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:00.071522 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1299/2590] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:48:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:49:09.292837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c084d2-083e-4709-b4c0-abb44c0f4644 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:09.303810 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c084d2-083e-4709-b4c0-abb44c0f4644 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:09.307905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f81632-c855-4db0-8568-179d04588f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:09.308774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f81632-c855-4db0-8568-179d04588f68 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:09.309138 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f81632-c855-4db0-8568-179d04588f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:09.309588 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f81632-c855-4db0-8568-179d04588f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:09.311470 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-44f81632-c855-4db0-8568-179d04588f68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:09.388806 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f81632-c855-4db0-8568-179d04588f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:09.390272 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f81632-c855-4db0-8568-179d04588f68 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:09.400747 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1292/2591] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:49:10.067467 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=45 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:12.747820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65399a2b-ac85-4d78-a323-86000875d426 service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:12.750349 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-65399a2b-ac85-4d78-a323-86000875d426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:12.768776 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65399a2b-ac85-4d78-a323-86000875d426 service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:12.773906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bf7d3-b7b8-42f9-86e9-8dd6b1a7c023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:12.774812 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bf7d3-b7b8-42f9-86e9-8dd6b1a7c023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:12.775094 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bf7d3-b7b8-42f9-86e9-8dd6b1a7c023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:12.775374 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bf7d3-b7b8-42f9-86e9-8dd6b1a7c023 admin admin] PATH_INFO: `/v3/users/f60ed90fb1a54339ac563bc649e98989` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:12.776575 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bf7d3-b7b8-42f9-86e9-8dd6b1a7c023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f60ed90fb1a54339ac563bc649e98989)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:12.778549 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bf7d3-b7b8-42f9-86e9-8dd6b1a7c023 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:12.841535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ec7bf7d3-b7b8-42f9-86e9-8dd6b1a7c023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f60ed90fb1a54339ac563bc649e98989'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:12.842213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ec7bf7d3-b7b8-42f9-86e9-8dd6b1a7c023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f60ed90fb1a54339ac563bc649e98989'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:12.851111 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ec7bf7d3-b7b8-42f9-86e9-8dd6b1a7c023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f60ed90fb1a54339ac563bc649e98989'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:12.858633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ec7bf7d3-b7b8-42f9-86e9-8dd6b1a7c023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f60ed90fb1a54339ac563bc649e98989'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:12.871918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ec7bf7d3-b7b8-42f9-86e9-8dd6b1a7c023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f60ed90fb1a54339ac563bc649e98989'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:12.878132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1300/2592] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:49:12 2022] DELETE /identity/v3/users/f60ed90fb1a54339ac563bc649e98989 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:13.056984 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f81632-c855-4db0-8568-179d04588f68 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:13.070316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f81632-c855-4db0-8568-179d04588f68 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:13.135546 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255f10e-076a-4af1-bd3e-9cd00c3f0eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:13.136493 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255f10e-076a-4af1-bd3e-9cd00c3f0eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:13.136802 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255f10e-076a-4af1-bd3e-9cd00c3f0eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:13.137116 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255f10e-076a-4af1-bd3e-9cd00c3f0eed admin admin] PATH_INFO: `/v3/projects/070bbe844e8945eca60ecc95244acd53` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:13.138364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255f10e-076a-4af1-bd3e-9cd00c3f0eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=070bbe844e8945eca60ecc95244acd53)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:13.140405 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c255f10e-076a-4af1-bd3e-9cd00c3f0eed admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:13.188884 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c255f10e-076a-4af1-bd3e-9cd00c3f0eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070bbe844e8945eca60ecc95244acd53', 'request_id': 'req-c255f10e-076a-4af1-bd3e-9cd00c3f0eed'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:13.195162 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c255f10e-076a-4af1-bd3e-9cd00c3f0eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070bbe844e8945eca60ecc95244acd53', 'request_id': 'req-c255f10e-076a-4af1-bd3e-9cd00c3f0eed'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:13.203306 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c255f10e-076a-4af1-bd3e-9cd00c3f0eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070bbe844e8945eca60ecc95244acd53', 'request_id': 'req-c255f10e-076a-4af1-bd3e-9cd00c3f0eed'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:13.215116 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c255f10e-076a-4af1-bd3e-9cd00c3f0eed admin admin] The token cache is being invalidate because project 070bbe844e8945eca60ecc95244acd53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:49:13.215441 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c255f10e-076a-4af1-bd3e-9cd00c3f0eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:13.216097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-c255f10e-076a-4af1-bd3e-9cd00c3f0eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:13.217887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1293/2593] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:49:13 2022] DELETE /identity/v3/projects/070bbe844e8945eca60ecc95244acd53 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:13.222740 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b964f-5458-4de3-8947-18201796f7d0 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:13.223035 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b964f-5458-4de3-8947-18201796f7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:13.223344 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b964f-5458-4de3-8947-18201796f7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:13.246485 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-b99b964f-5458-4de3-8947-18201796f7d0 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:13.247840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b99b964f-5458-4de3-8947-18201796f7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:13.321421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1301/2594] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:13.327513 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b4f05-4bd8-4a33-ba37-6736cc114b17 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:13.328194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b4f05-4bd8-4a33-ba37-6736cc114b17 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:13.328484 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b4f05-4bd8-4a33-ba37-6736cc114b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:13.342637 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:13.348820 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-613b4f05-4bd8-4a33-ba37-6736cc114b17 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:13.351425 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-613b4f05-4bd8-4a33-ba37-6736cc114b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:13.363802 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1294/2595] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:13.368142 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b964f-5458-4de3-8947-18201796f7d0 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:13.377995 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b964f-5458-4de3-8947-18201796f7d0 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:13.383461 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafc974-9374-4246-a002-ee0c0a1d2996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:13.384130 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafc974-9374-4246-a002-ee0c0a1d2996 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:13.384420 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafc974-9374-4246-a002-ee0c0a1d2996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:13.384702 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafc974-9374-4246-a002-ee0c0a1d2996 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:13.385472 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafc974-9374-4246-a002-ee0c0a1d2996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:49:13.385788 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafc974-9374-4246-a002-ee0c0a1d2996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:13.387405 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafc974-9374-4246-a002-ee0c0a1d2996 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:13.401084 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1302/2596] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:49:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:49:13.406182 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b4f05-4bd8-4a33-ba37-6736cc114b17 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:13.416607 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b4f05-4bd8-4a33-ba37-6736cc114b17 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:13.421492 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1881975-491c-43fd-8d61-439c4f55ebda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:13.422263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1881975-491c-43fd-8d61-439c4f55ebda admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:13.422573 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1881975-491c-43fd-8d61-439c4f55ebda admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:13.422858 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1881975-491c-43fd-8d61-439c4f55ebda admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:13.423557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1881975-491c-43fd-8d61-439c4f55ebda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:13.425605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1881975-491c-43fd-8d61-439c4f55ebda admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:13.451180 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1295/2597] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:49:13 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:13.455254 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafc974-9374-4246-a002-ee0c0a1d2996 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:13.466097 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafc974-9374-4246-a002-ee0c0a1d2996 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:13.525801 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa3cc4-a255-4525-b8e1-5ff47b283f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:13.526510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa3cc4-a255-4525-b8e1-5ff47b283f6d admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:13.526745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa3cc4-a255-4525-b8e1-5ff47b283f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:13.527029 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa3cc4-a255-4525-b8e1-5ff47b283f6d admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:13.527832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa3cc4-a255-4525-b8e1-5ff47b283f6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:13.529932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa3cc4-a255-4525-b8e1-5ff47b283f6d admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:13.536936 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:13.558092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1303/2598] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:49:13 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:13.559213 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1881975-491c-43fd-8d61-439c4f55ebda admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:13.564981 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa3cc4-a255-4525-b8e1-5ff47b283f6d admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:13.567041 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-a0fa3cc4-a255-4525-b8e1-5ff47b283f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:13.571566 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1881975-491c-43fd-8d61-439c4f55ebda admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:13.576726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3021c07-1797-409a-9eef-9b5ce1487a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:13.577451 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3021c07-1797-409a-9eef-9b5ce1487a9e admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:13.577738 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3021c07-1797-409a-9eef-9b5ce1487a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:13.578017 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3021c07-1797-409a-9eef-9b5ce1487a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:13.578740 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3021c07-1797-409a-9eef-9b5ce1487a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:13.580347 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3021c07-1797-409a-9eef-9b5ce1487a9e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:13.581678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa3cc4-a255-4525-b8e1-5ff47b283f6d admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:13.587123 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c89ba1-e6e3-49a4-b0fa-2fcb05675fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:13.588052 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c89ba1-e6e3-49a4-b0fa-2fcb05675fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:13.588408 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c89ba1-e6e3-49a4-b0fa-2fcb05675fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:13.588756 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c89ba1-e6e3-49a4-b0fa-2fcb05675fd7 admin admin] PATH_INFO: `/v3/users/bb9503fc73f040c7aba7d3af29ef6176` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:13.590030 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c89ba1-e6e3-49a4-b0fa-2fcb05675fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb9503fc73f040c7aba7d3af29ef6176)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:13.591845 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1296/2599] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:49:13.592170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c89ba1-e6e3-49a4-b0fa-2fcb05675fd7 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:13.595679 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3021c07-1797-409a-9eef-9b5ce1487a9e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:13.605362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3021c07-1797-409a-9eef-9b5ce1487a9e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:13.610560 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3fec6-c717-4025-a902-08773fd09cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:13.611229 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3fec6-c717-4025-a902-08773fd09cfe admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:13.611536 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3fec6-c717-4025-a902-08773fd09cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:13.611865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3fec6-c717-4025-a902-08773fd09cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:13.612590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3fec6-c717-4025-a902-08773fd09cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:13.614272 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3fec6-c717-4025-a902-08773fd09cfe admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:13.626418 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1297/2600] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:49:13.630507 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3fec6-c717-4025-a902-08773fd09cfe admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:13.640965 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3fec6-c717-4025-a902-08773fd09cfe admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:13.641690 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-40c89ba1-e6e3-49a4-b0fa-2fcb05675fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb9503fc73f040c7aba7d3af29ef6176'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:13.642363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-40c89ba1-e6e3-49a4-b0fa-2fcb05675fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb9503fc73f040c7aba7d3af29ef6176'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:13.645893 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7efb94-17d9-42b9-b66a-fab1c1a7a460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:13.647813 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7efb94-17d9-42b9-b66a-fab1c1a7a460 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:13.648283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7efb94-17d9-42b9-b66a-fab1c1a7a460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:13.648599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7efb94-17d9-42b9-b66a-fab1c1a7a460 admin admin] PATH_INFO: `/v3/projects/b344f575c2144ba0ad962f35dd18745d/users/aced853b8f4a44789e252f8fc522d132/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:13.650923 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-40c89ba1-e6e3-49a4-b0fa-2fcb05675fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb9503fc73f040c7aba7d3af29ef6176'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:13.664606 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-40c89ba1-e6e3-49a4-b0fa-2fcb05675fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb9503fc73f040c7aba7d3af29ef6176'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:13.665844 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7efb94-17d9-42b9-b66a-fab1c1a7a460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b344f575c2144ba0ad962f35dd18745d, user_id=aced853b8f4a44789e252f8fc522d132, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:13.668622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7efb94-17d9-42b9-b66a-fab1c1a7a460 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:13.678257 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-40c89ba1-e6e3-49a4-b0fa-2fcb05675fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb9503fc73f040c7aba7d3af29ef6176'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:13.684376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1298/2601] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:49:13 2022] PUT /identity/v3/projects/b344f575c2144ba0ad962f35dd18745d/users/aced853b8f4a44789e252f8fc522d132/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:49:13.686550 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1304/2602] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:49:13 2022] DELETE /identity/v3/users/bb9503fc73f040c7aba7d3af29ef6176 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:13.695431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0f555-4f5f-438a-a04d-fe1bd8168817 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:13.695732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0f555-4f5f-438a-a04d-fe1bd8168817 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:13.695989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb00d32-b770-4cc8-936d-e0f006b03366 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:13.696094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0f555-4f5f-438a-a04d-fe1bd8168817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:13.696290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb00d32-b770-4cc8-936d-e0f006b03366 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:13.696573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb00d32-b770-4cc8-936d-e0f006b03366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:13.713791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b6a0f555-4f5f-438a-a04d-fe1bd8168817 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:13.714998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b6a0f555-4f5f-438a-a04d-fe1bd8168817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:13.724867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-9eb00d32-b770-4cc8-936d-e0f006b03366 None None] MFA Rules not processed for user `aced853b8f4a44789e252f8fc522d132`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:13.726213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-9eb00d32-b770-4cc8-936d-e0f006b03366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:13.776112 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1299/2603] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:49:13.785298 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0f555-4f5f-438a-a04d-fe1bd8168817 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:13.786787 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b6a0f555-4f5f-438a-a04d-fe1bd8168817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:13.792180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1305/2604] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:49:13.803885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb00d32-b770-4cc8-936d-e0f006b03366 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:13.805224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-9eb00d32-b770-4cc8-936d-e0f006b03366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:13.847971 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0f555-4f5f-438a-a04d-fe1bd8168817 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:13.851821 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b0bd2-7569-46fc-91f0-3b249be92ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:13.852466 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b0bd2-7569-46fc-91f0-3b249be92ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:13.852751 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b0bd2-7569-46fc-91f0-3b249be92ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:13.853033 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b0bd2-7569-46fc-91f0-3b249be92ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:13.862241 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b0bd2-7569-46fc-91f0-3b249be92ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:13.863710 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b0bd2-7569-46fc-91f0-3b249be92ff7 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:13.869288 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb00d32-b770-4cc8-936d-e0f006b03366 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:13.872969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee78c76-d600-4065-a5aa-3fb483622f05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:13.873655 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee78c76-d600-4065-a5aa-3fb483622f05 service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:13.873781 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1300/2605] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:49:13.874026 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee78c76-d600-4065-a5aa-3fb483622f05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:13.874315 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee78c76-d600-4065-a5aa-3fb483622f05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:13.879973 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:13.884474 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee78c76-d600-4065-a5aa-3fb483622f05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:13.885992 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee78c76-d600-4065-a5aa-3fb483622f05 service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:13.896249 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1306/2606] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:49:14.171082 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b0bd2-7569-46fc-91f0-3b249be92ff7 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:14.173340 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2f0b0bd2-7569-46fc-91f0-3b249be92ff7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:14.188519 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b0bd2-7569-46fc-91f0-3b249be92ff7 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:14.194091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9e422-4b41-4c28-a6e1-7d4581f74906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:14.195115 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9e422-4b41-4c28-a6e1-7d4581f74906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:14.195402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9e422-4b41-4c28-a6e1-7d4581f74906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:14.195857 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9e422-4b41-4c28-a6e1-7d4581f74906 admin admin] PATH_INFO: `/v3/projects/db7e220ccd5d454c893012c1edb394d3` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:14.197322 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9e422-4b41-4c28-a6e1-7d4581f74906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db7e220ccd5d454c893012c1edb394d3)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:14.199618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9e422-4b41-4c28-a6e1-7d4581f74906 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:14.240796 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:14.259961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6ff9e422-4b41-4c28-a6e1-7d4581f74906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db7e220ccd5d454c893012c1edb394d3', 'request_id': 'req-6ff9e422-4b41-4c28-a6e1-7d4581f74906'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:14.266976 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6ff9e422-4b41-4c28-a6e1-7d4581f74906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db7e220ccd5d454c893012c1edb394d3', 'request_id': 'req-6ff9e422-4b41-4c28-a6e1-7d4581f74906'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:14.277414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6ff9e422-4b41-4c28-a6e1-7d4581f74906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db7e220ccd5d454c893012c1edb394d3', 'request_id': 'req-6ff9e422-4b41-4c28-a6e1-7d4581f74906'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:14.291759 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6ff9e422-4b41-4c28-a6e1-7d4581f74906 admin admin] The token cache is being invalidate because project db7e220ccd5d454c893012c1edb394d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:49:14.292052 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6ff9e422-4b41-4c28-a6e1-7d4581f74906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:14.292714 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6ff9e422-4b41-4c28-a6e1-7d4581f74906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:14.294373 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1301/2607] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:49:14 2022] DELETE /identity/v3/projects/db7e220ccd5d454c893012c1edb394d3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:14.299269 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ad347-ac36-4dea-a3c0-babbad71bdd1 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:14.299555 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ad347-ac36-4dea-a3c0-babbad71bdd1 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:14.299905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ad347-ac36-4dea-a3c0-babbad71bdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:14.321161 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-131ad347-ac36-4dea-a3c0-babbad71bdd1 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:14.322722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-131ad347-ac36-4dea-a3c0-babbad71bdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:14.406845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1307/2608] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:49:14.408564 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb7ced-dc83-4751-8d33-7a482f3c1d0b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:14.408891 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb7ced-dc83-4751-8d33-7a482f3c1d0b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:14.409192 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb7ced-dc83-4751-8d33-7a482f3c1d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:14.436868 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-52fb7ced-dc83-4751-8d33-7a482f3c1d0b None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:14.436868 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-52fb7ced-dc83-4751-8d33-7a482f3c1d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:14.463803 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1302/2609] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:14.467654 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ad347-ac36-4dea-a3c0-babbad71bdd1 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:14.477790 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ad347-ac36-4dea-a3c0-babbad71bdd1 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:14.491640 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbc018-7afe-4ff1-b9ba-020ec3d08057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:14.491640 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbc018-7afe-4ff1-b9ba-020ec3d08057 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:14.491937 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbc018-7afe-4ff1-b9ba-020ec3d08057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:14.492119 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbc018-7afe-4ff1-b9ba-020ec3d08057 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:14.492845 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbc018-7afe-4ff1-b9ba-020ec3d08057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:49:14.493155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbc018-7afe-4ff1-b9ba-020ec3d08057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:14.500204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbc018-7afe-4ff1-b9ba-020ec3d08057 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:14.517558 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1308/2610] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:49:14.518855 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb7ced-dc83-4751-8d33-7a482f3c1d0b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:14.533860 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb7ced-dc83-4751-8d33-7a482f3c1d0b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:14.543966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f0a03-d851-4cce-9910-ca4231c301bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:14.544643 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f0a03-d851-4cce-9910-ca4231c301bf admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:14.544927 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f0a03-d851-4cce-9910-ca4231c301bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:14.545204 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f0a03-d851-4cce-9910-ca4231c301bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:14.545953 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f0a03-d851-4cce-9910-ca4231c301bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:14.547868 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f0a03-d851-4cce-9910-ca4231c301bf admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:14.586577 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1303/2611] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:49:14 2022] POST /identity/v3/projects => generated 389 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:14.590657 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbc018-7afe-4ff1-b9ba-020ec3d08057 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:14.601390 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbc018-7afe-4ff1-b9ba-020ec3d08057 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:14.677353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7537d-9322-4d4e-b9e4-5f87fc6097b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:14.678316 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7537d-9322-4d4e-b9e4-5f87fc6097b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:14.678573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7537d-9322-4d4e-b9e4-5f87fc6097b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:14.679026 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7537d-9322-4d4e-b9e4-5f87fc6097b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:14.680722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7537d-9322-4d4e-b9e4-5f87fc6097b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:14.688374 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7537d-9322-4d4e-b9e4-5f87fc6097b5 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:14.719471 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1309/2612] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:49:14 2022] POST /identity/v3/users => generated 295 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:14.721204 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f0a03-d851-4cce-9910-ca4231c301bf admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:14.734847 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f0a03-d851-4cce-9910-ca4231c301bf admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:14.740799 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc80938-937a-40ea-b8aa-d6e77bba7f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:14.741513 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc80938-937a-40ea-b8aa-d6e77bba7f88 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:14.741804 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc80938-937a-40ea-b8aa-d6e77bba7f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:14.742126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc80938-937a-40ea-b8aa-d6e77bba7f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:14.742837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc80938-937a-40ea-b8aa-d6e77bba7f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:14.744462 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc80938-937a-40ea-b8aa-d6e77bba7f88 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:14.757033 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1304/2613] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:49:14.761756 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7537d-9322-4d4e-b9e4-5f87fc6097b5 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:14.776384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7537d-9322-4d4e-b9e4-5f87fc6097b5 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:14.781115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbea25b-afcf-4252-ba10-678366a9a7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:14.781760 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbea25b-afcf-4252-ba10-678366a9a7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:14.782042 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbea25b-afcf-4252-ba10-678366a9a7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:14.782319 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbea25b-afcf-4252-ba10-678366a9a7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:14.783049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbea25b-afcf-4252-ba10-678366a9a7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:14.784692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbea25b-afcf-4252-ba10-678366a9a7c8 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:14.801083 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1310/2614] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:49:14.802234 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc80938-937a-40ea-b8aa-d6e77bba7f88 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:14.813892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc80938-937a-40ea-b8aa-d6e77bba7f88 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:14.821304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf84af-734d-4fc5-890d-ccfa739bff83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:14.822533 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf84af-734d-4fc5-890d-ccfa739bff83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:14.822819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf84af-734d-4fc5-890d-ccfa739bff83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:14.823097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf84af-734d-4fc5-890d-ccfa739bff83 admin admin] PATH_INFO: `/v3/projects/6315bfe35a3541d2931d71bf09a661fb/users/201d4a5d91844f9b854cc47a276bab25/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:14.838195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf84af-734d-4fc5-890d-ccfa739bff83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6315bfe35a3541d2931d71bf09a661fb, user_id=201d4a5d91844f9b854cc47a276bab25, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:14.840837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf84af-734d-4fc5-890d-ccfa739bff83 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:14.853913 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1305/2615] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:49:14 2022] PUT /identity/v3/projects/6315bfe35a3541d2931d71bf09a661fb/users/201d4a5d91844f9b854cc47a276bab25/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:49:14.864196 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4307a-a111-45c4-b1b1-9ec14450c568 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:14.864490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4307a-a111-45c4-b1b1-9ec14450c568 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:14.864776 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4307a-a111-45c4-b1b1-9ec14450c568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:14.891327 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-8cc4307a-a111-45c4-b1b1-9ec14450c568 None None] MFA Rules not processed for user `201d4a5d91844f9b854cc47a276bab25`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:14.892529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-8cc4307a-a111-45c4-b1b1-9ec14450c568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:14.940301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:14.958700 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1311/2616] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:49:14.969834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf84af-734d-4fc5-890d-ccfa739bff83 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:14.971484 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-fdbf84af-734d-4fc5-890d-ccfa739bff83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:15.027782 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf84af-734d-4fc5-890d-ccfa739bff83 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:15.031467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e418ae-eca6-4ed3-92fb-c8d158955d12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:15.032047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e418ae-eca6-4ed3-92fb-c8d158955d12 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:15.032331 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e418ae-eca6-4ed3-92fb-c8d158955d12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:15.032612 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e418ae-eca6-4ed3-92fb-c8d158955d12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:15.041575 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e418ae-eca6-4ed3-92fb-c8d158955d12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:15.043003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e418ae-eca6-4ed3-92fb-c8d158955d12 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:15.051691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1306/2617] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:49:24.955749 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=5 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:25.047692 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=66,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:26.868254 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4307a-a111-45c4-b1b1-9ec14450c568 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:26.869716 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-8cc4307a-a111-45c4-b1b1-9ec14450c568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:26.934566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4307a-a111-45c4-b1b1-9ec14450c568 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:26.939148 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da90af7-1ab2-4f98-9452-cca958e89989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:26.940026 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da90af7-1ab2-4f98-9452-cca958e89989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:26.940312 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da90af7-1ab2-4f98-9452-cca958e89989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:26.940593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da90af7-1ab2-4f98-9452-cca958e89989 admin admin] PATH_INFO: `/v3/users/8b0275bff4894f36b648d6ae2b304877` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:26.941817 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da90af7-1ab2-4f98-9452-cca958e89989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b0275bff4894f36b648d6ae2b304877)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:26.944089 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da90af7-1ab2-4f98-9452-cca958e89989 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:26.989257 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-3da90af7-1ab2-4f98-9452-cca958e89989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b0275bff4894f36b648d6ae2b304877'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:26.989935 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-3da90af7-1ab2-4f98-9452-cca958e89989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b0275bff4894f36b648d6ae2b304877'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:26.997408 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-3da90af7-1ab2-4f98-9452-cca958e89989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b0275bff4894f36b648d6ae2b304877'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:27.004281 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-3da90af7-1ab2-4f98-9452-cca958e89989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b0275bff4894f36b648d6ae2b304877'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:27.016106 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-3da90af7-1ab2-4f98-9452-cca958e89989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b0275bff4894f36b648d6ae2b304877'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:27.022678 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1312/2618] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:49:26 2022] DELETE /identity/v3/users/8b0275bff4894f36b648d6ae2b304877 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:27.027245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57903ee6-d058-4297-aaf4-5a07c15b838e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:27.027730 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57903ee6-d058-4297-aaf4-5a07c15b838e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:27.027842 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57903ee6-d058-4297-aaf4-5a07c15b838e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:27.045501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-57903ee6-d058-4297-aaf4-5a07c15b838e None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:27.046695 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-57903ee6-d058-4297-aaf4-5a07c15b838e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:27.104719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1307/2619] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:27.114256 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da90af7-1ab2-4f98-9452-cca958e89989 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:27.116294 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-3da90af7-1ab2-4f98-9452-cca958e89989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:27.172865 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da90af7-1ab2-4f98-9452-cca958e89989 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:27.176544 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0941b-8d9f-4776-8c4f-4d09b9a0f48f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:27.177177 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0941b-8d9f-4776-8c4f-4d09b9a0f48f service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:27.177639 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0941b-8d9f-4776-8c4f-4d09b9a0f48f service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:27.177927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0941b-8d9f-4776-8c4f-4d09b9a0f48f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:27.187491 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0941b-8d9f-4776-8c4f-4d09b9a0f48f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:27.189272 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa0941b-8d9f-4776-8c4f-4d09b9a0f48f service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:27.199242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1313/2620] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:49:27.476881 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57903ee6-d058-4297-aaf4-5a07c15b838e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:27.478503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-57903ee6-d058-4297-aaf4-5a07c15b838e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:27.492589 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57903ee6-d058-4297-aaf4-5a07c15b838e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:27.498448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a92f50-5b08-4ebe-bb68-471ae9182308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:27.499338 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a92f50-5b08-4ebe-bb68-471ae9182308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:27.499609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a92f50-5b08-4ebe-bb68-471ae9182308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:27.499887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a92f50-5b08-4ebe-bb68-471ae9182308 admin admin] PATH_INFO: `/v3/projects/945cca55c5b14a89ad177d62e5febf4e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:27.501071 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a92f50-5b08-4ebe-bb68-471ae9182308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=945cca55c5b14a89ad177d62e5febf4e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:27.503399 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a92f50-5b08-4ebe-bb68-471ae9182308 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:27.554490 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-41a92f50-5b08-4ebe-bb68-471ae9182308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '945cca55c5b14a89ad177d62e5febf4e', 'request_id': 'req-41a92f50-5b08-4ebe-bb68-471ae9182308'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:27.559876 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-41a92f50-5b08-4ebe-bb68-471ae9182308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '945cca55c5b14a89ad177d62e5febf4e', 'request_id': 'req-41a92f50-5b08-4ebe-bb68-471ae9182308'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:27.567905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-41a92f50-5b08-4ebe-bb68-471ae9182308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '945cca55c5b14a89ad177d62e5febf4e', 'request_id': 'req-41a92f50-5b08-4ebe-bb68-471ae9182308'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:27.579998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-41a92f50-5b08-4ebe-bb68-471ae9182308 admin admin] The token cache is being invalidate because project 945cca55c5b14a89ad177d62e5febf4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:49:27.580286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-41a92f50-5b08-4ebe-bb68-471ae9182308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:27.580918 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-41a92f50-5b08-4ebe-bb68-471ae9182308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:27.582513 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1308/2621] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:49:27 2022] DELETE /identity/v3/projects/945cca55c5b14a89ad177d62e5febf4e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:27.586415 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0941b-8d9f-4776-8c4f-4d09b9a0f48f service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:27.596071 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa0941b-8d9f-4776-8c4f-4d09b9a0f48f service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:27.614410 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:27.655198 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c1725-a254-4cf6-a01e-8b49a1c51c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:27.655987 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c1725-a254-4cf6-a01e-8b49a1c51c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:27.656269 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c1725-a254-4cf6-a01e-8b49a1c51c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:27.656545 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c1725-a254-4cf6-a01e-8b49a1c51c37 admin admin] PATH_INFO: `/v3/users/08a59d2372514c0c97445568b08de9b8` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:27.657745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c1725-a254-4cf6-a01e-8b49a1c51c37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08a59d2372514c0c97445568b08de9b8)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:27.659651 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c1725-a254-4cf6-a01e-8b49a1c51c37 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:27.706713 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-bf0c1725-a254-4cf6-a01e-8b49a1c51c37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08a59d2372514c0c97445568b08de9b8'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:27.707350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-bf0c1725-a254-4cf6-a01e-8b49a1c51c37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08a59d2372514c0c97445568b08de9b8'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:27.714632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-bf0c1725-a254-4cf6-a01e-8b49a1c51c37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08a59d2372514c0c97445568b08de9b8'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:27.721340 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-bf0c1725-a254-4cf6-a01e-8b49a1c51c37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08a59d2372514c0c97445568b08de9b8'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:27.733821 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-bf0c1725-a254-4cf6-a01e-8b49a1c51c37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08a59d2372514c0c97445568b08de9b8'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:27.739600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1314/2622] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:49:27 2022] DELETE /identity/v3/users/08a59d2372514c0c97445568b08de9b8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:28.013676 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a92f50-5b08-4ebe-bb68-471ae9182308 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:28.015140 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-41a92f50-5b08-4ebe-bb68-471ae9182308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:28.029865 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a92f50-5b08-4ebe-bb68-471ae9182308 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:28.086948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152668cd-5038-495b-a600-8cfc229d060d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:28.087803 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152668cd-5038-495b-a600-8cfc229d060d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:28.088083 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152668cd-5038-495b-a600-8cfc229d060d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:28.088356 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152668cd-5038-495b-a600-8cfc229d060d admin admin] PATH_INFO: `/v3/projects/703863965015453aa7b46d268c466e1d` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:28.089558 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152668cd-5038-495b-a600-8cfc229d060d admin admin] RBAC: Authorizing `identity:delete_project(project_id=703863965015453aa7b46d268c466e1d)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:28.091474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152668cd-5038-495b-a600-8cfc229d060d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:28.121217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:28.139136 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-152668cd-5038-495b-a600-8cfc229d060d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '703863965015453aa7b46d268c466e1d', 'request_id': 'req-152668cd-5038-495b-a600-8cfc229d060d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:28.144730 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-152668cd-5038-495b-a600-8cfc229d060d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '703863965015453aa7b46d268c466e1d', 'request_id': 'req-152668cd-5038-495b-a600-8cfc229d060d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:28.152626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-152668cd-5038-495b-a600-8cfc229d060d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '703863965015453aa7b46d268c466e1d', 'request_id': 'req-152668cd-5038-495b-a600-8cfc229d060d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:28.164217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-152668cd-5038-495b-a600-8cfc229d060d admin admin] The token cache is being invalidate because project 703863965015453aa7b46d268c466e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:49:28.164505 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-152668cd-5038-495b-a600-8cfc229d060d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:28.165160 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-152668cd-5038-495b-a600-8cfc229d060d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:28.166775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1309/2623] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:49:28 2022] DELETE /identity/v3/projects/703863965015453aa7b46d268c466e1d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:49:28.171828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fbd16-0231-4697-bf70-4c5e97753752 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:28.172296 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fbd16-0231-4697-bf70-4c5e97753752 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:28.172426 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fbd16-0231-4697-bf70-4c5e97753752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:28.190481 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-840fbd16-0231-4697-bf70-4c5e97753752 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:28.191611 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-840fbd16-0231-4697-bf70-4c5e97753752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:28.251043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1315/2624] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:28.259241 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398baca2-9005-4c63-8fd5-f8201e9f1b06 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:28.259522 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398baca2-9005-4c63-8fd5-f8201e9f1b06 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:28.259807 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398baca2-9005-4c63-8fd5-f8201e9f1b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:28.278558 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-398baca2-9005-4c63-8fd5-f8201e9f1b06 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:28.279748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-398baca2-9005-4c63-8fd5-f8201e9f1b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:28.288147 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1310/2625] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:28.292499 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fbd16-0231-4697-bf70-4c5e97753752 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:28.302006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fbd16-0231-4697-bf70-4c5e97753752 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:28.306926 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6ec59-3b5c-4043-add9-0a81c4825f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:28.307574 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6ec59-3b5c-4043-add9-0a81c4825f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:28.307858 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6ec59-3b5c-4043-add9-0a81c4825f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:28.308136 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6ec59-3b5c-4043-add9-0a81c4825f6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:28.308855 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6ec59-3b5c-4043-add9-0a81c4825f6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:49:28.309165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6ec59-3b5c-4043-add9-0a81c4825f6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:28.310789 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6ec59-3b5c-4043-add9-0a81c4825f6b admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:28.323121 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1316/2626] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:49:28.326932 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398baca2-9005-4c63-8fd5-f8201e9f1b06 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:28.336791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398baca2-9005-4c63-8fd5-f8201e9f1b06 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:28.341429 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65c252-c05c-49b1-9530-8ad3e8583034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:28.342076 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65c252-c05c-49b1-9530-8ad3e8583034 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:28.342358 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65c252-c05c-49b1-9530-8ad3e8583034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:28.342635 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65c252-c05c-49b1-9530-8ad3e8583034 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:28.343336 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65c252-c05c-49b1-9530-8ad3e8583034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:28.345229 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65c252-c05c-49b1-9530-8ad3e8583034 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:28.369889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1311/2627] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:49:28 2022] POST /identity/v3/projects => generated 389 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:28.373918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6ec59-3b5c-4043-add9-0a81c4825f6b admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:28.384449 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6ec59-3b5c-4043-add9-0a81c4825f6b admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:28.410656 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:28.442927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74bf90-4b49-48a8-bb4c-5dccf12c3e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:28.443514 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74bf90-4b49-48a8-bb4c-5dccf12c3e72 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:28.444348 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74bf90-4b49-48a8-bb4c-5dccf12c3e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:28.444764 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74bf90-4b49-48a8-bb4c-5dccf12c3e72 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:28.445630 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74bf90-4b49-48a8-bb4c-5dccf12c3e72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:28.447656 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74bf90-4b49-48a8-bb4c-5dccf12c3e72 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:28.467395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1317/2628] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:49:28 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:28.471395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65c252-c05c-49b1-9530-8ad3e8583034 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:28.481629 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65c252-c05c-49b1-9530-8ad3e8583034 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:28.486194 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4eac23-a1c7-4c8e-922e-c11a521c6020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:28.486841 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4eac23-a1c7-4c8e-922e-c11a521c6020 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:28.487127 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4eac23-a1c7-4c8e-922e-c11a521c6020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:28.487405 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4eac23-a1c7-4c8e-922e-c11a521c6020 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:28.488125 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4eac23-a1c7-4c8e-922e-c11a521c6020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:28.489775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4eac23-a1c7-4c8e-922e-c11a521c6020 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:28.500202 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1312/2629] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:49:28.503956 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74bf90-4b49-48a8-bb4c-5dccf12c3e72 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:28.514752 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74bf90-4b49-48a8-bb4c-5dccf12c3e72 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:28.519240 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb030ac-f2b5-4a43-bfe5-2a9dcfbc2e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:28.519877 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb030ac-f2b5-4a43-bfe5-2a9dcfbc2e5e admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:28.520410 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb030ac-f2b5-4a43-bfe5-2a9dcfbc2e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:28.520687 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb030ac-f2b5-4a43-bfe5-2a9dcfbc2e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:28.521423 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb030ac-f2b5-4a43-bfe5-2a9dcfbc2e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:28.524161 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb030ac-f2b5-4a43-bfe5-2a9dcfbc2e5e admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:28.533898 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1318/2630] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:49:28.537905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4eac23-a1c7-4c8e-922e-c11a521c6020 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:28.548784 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4eac23-a1c7-4c8e-922e-c11a521c6020 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:28.553455 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2078383-5b18-4a9d-9911-1ddef1926d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:28.554336 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2078383-5b18-4a9d-9911-1ddef1926d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:28.554681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2078383-5b18-4a9d-9911-1ddef1926d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:28.554969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2078383-5b18-4a9d-9911-1ddef1926d6d admin admin] PATH_INFO: `/v3/projects/7d0c15fef27945c29ddc951cc7e36ad6/users/e6ee5f9b55a44f06b74d05feae256e0d/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:28.572068 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2078383-5b18-4a9d-9911-1ddef1926d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d0c15fef27945c29ddc951cc7e36ad6, user_id=e6ee5f9b55a44f06b74d05feae256e0d, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:28.575096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2078383-5b18-4a9d-9911-1ddef1926d6d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:28.590414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1313/2631] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:49:28 2022] PUT /identity/v3/projects/7d0c15fef27945c29ddc951cc7e36ad6/users/e6ee5f9b55a44f06b74d05feae256e0d/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:28.600939 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0fb77-883f-4318-aaf1-137d166fc5fb None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:28.601229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0fb77-883f-4318-aaf1-137d166fc5fb None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:28.601582 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0fb77-883f-4318-aaf1-137d166fc5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:28.627663 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-50f0fb77-883f-4318-aaf1-137d166fc5fb None None] MFA Rules not processed for user `e6ee5f9b55a44f06b74d05feae256e0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:28.628903 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-50f0fb77-883f-4318-aaf1-137d166fc5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:28.695349 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1319/2632] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:28.699683 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2078383-5b18-4a9d-9911-1ddef1926d6d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:28.761627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2078383-5b18-4a9d-9911-1ddef1926d6d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:28.766274 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3de56-e338-47f2-a1c6-f1146e228cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:28.767247 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3de56-e338-47f2-a1c6-f1146e228cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:28.767535 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3de56-e338-47f2-a1c6-f1146e228cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:28.767819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3de56-e338-47f2-a1c6-f1146e228cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:28.768517 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3de56-e338-47f2-a1c6-f1146e228cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:28.770709 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3de56-e338-47f2-a1c6-f1146e228cc5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:28.794889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1314/2633] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:49:28 2022] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:28.798979 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0fb77-883f-4318-aaf1-137d166fc5fb None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:28.810535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0fb77-883f-4318-aaf1-137d166fc5fb None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:28.868671 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dbe40-70da-466d-a125-2818d72f4fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:28.869331 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dbe40-70da-466d-a125-2818d72f4fee admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:28.869659 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dbe40-70da-466d-a125-2818d72f4fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:28.869935 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dbe40-70da-466d-a125-2818d72f4fee admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:28.870628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dbe40-70da-466d-a125-2818d72f4fee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:28.872520 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dbe40-70da-466d-a125-2818d72f4fee admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:28.893125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1320/2634] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:49:28 2022] POST /identity/v3/users => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:28.897984 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3de56-e338-47f2-a1c6-f1146e228cc5 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:28.908095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3de56-e338-47f2-a1c6-f1146e228cc5 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:28.913117 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c09d3-57a8-4477-a1ff-ac9794ef9c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:28.913791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c09d3-57a8-4477-a1ff-ac9794ef9c3b admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:28.914074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c09d3-57a8-4477-a1ff-ac9794ef9c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:28.914348 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37c09d3-57a8-4477-a1ff-ac9794ef9c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:28.915062 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c09d3-57a8-4477-a1ff-ac9794ef9c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:28.916644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37c09d3-57a8-4477-a1ff-ac9794ef9c3b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:28.926848 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1315/2635] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:49:28.931576 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dbe40-70da-466d-a125-2818d72f4fee admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:28.941292 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dbe40-70da-466d-a125-2818d72f4fee admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:28.946081 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfc3a9-6a7e-442e-b9e0-c57576ae30ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:28.946887 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfc3a9-6a7e-442e-b9e0-c57576ae30ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:28.947166 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfc3a9-6a7e-442e-b9e0-c57576ae30ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:28.947443 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dfc3a9-6a7e-442e-b9e0-c57576ae30ee admin admin] PATH_INFO: `/v3/projects/432e706fc75f48469733ad6fb996cfef/users/ca0b3c84de624a61909bc76481f9bd22/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:28.962462 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfc3a9-6a7e-442e-b9e0-c57576ae30ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=432e706fc75f48469733ad6fb996cfef, user_id=ca0b3c84de624a61909bc76481f9bd22, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:28.965081 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dfc3a9-6a7e-442e-b9e0-c57576ae30ee admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:28.978045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1321/2636] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:49:28 2022] PUT /identity/v3/projects/432e706fc75f48469733ad6fb996cfef/users/ca0b3c84de624a61909bc76481f9bd22/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:28.981889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c09d3-57a8-4477-a1ff-ac9794ef9c3b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:28.992458 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37c09d3-57a8-4477-a1ff-ac9794ef9c3b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:29.015573 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:29.056992 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f930ec-008f-4b85-a634-b64da40a159a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:29.057688 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f930ec-008f-4b85-a634-b64da40a159a admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:29.057971 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f930ec-008f-4b85-a634-b64da40a159a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:29.058246 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f930ec-008f-4b85-a634-b64da40a159a admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:29.058963 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f930ec-008f-4b85-a634-b64da40a159a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:29.060538 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f930ec-008f-4b85-a634-b64da40a159a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:29.071211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1316/2637] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:49:29.075445 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfc3a9-6a7e-442e-b9e0-c57576ae30ee admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:29.080943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:29.087533 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dfc3a9-6a7e-442e-b9e0-c57576ae30ee admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:29.092329 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617773aa-8538-438a-8060-bf2d6bf105ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:29.093213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617773aa-8538-438a-8060-bf2d6bf105ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:29.093544 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617773aa-8538-438a-8060-bf2d6bf105ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:29.093827 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617773aa-8538-438a-8060-bf2d6bf105ee admin admin] PATH_INFO: `/v3/projects/432e706fc75f48469733ad6fb996cfef/users/ca0b3c84de624a61909bc76481f9bd22/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:29.095793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617773aa-8538-438a-8060-bf2d6bf105ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=432e706fc75f48469733ad6fb996cfef, user_id=ca0b3c84de624a61909bc76481f9bd22, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:29.098478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617773aa-8538-438a-8060-bf2d6bf105ee admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:29.109315 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1322/2638] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:49:29 2022] PUT /identity/v3/projects/432e706fc75f48469733ad6fb996cfef/users/ca0b3c84de624a61909bc76481f9bd22/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:49:29.120358 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2523f24-7696-49f9-8f5e-447f196f2779 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:29.120655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2523f24-7696-49f9-8f5e-447f196f2779 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:29.120939 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2523f24-7696-49f9-8f5e-447f196f2779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:29.147612 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d2523f24-7696-49f9-8f5e-447f196f2779 None None] MFA Rules not processed for user `ca0b3c84de624a61909bc76481f9bd22`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:29.148821 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d2523f24-7696-49f9-8f5e-447f196f2779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:29.215952 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1317/2639] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:29 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:29.227179 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617773aa-8538-438a-8060-bf2d6bf105ee admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:29.229544 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-617773aa-8538-438a-8060-bf2d6bf105ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:29.286719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617773aa-8538-438a-8060-bf2d6bf105ee admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:29.290821 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f9daf-0577-47cc-9234-517d009a7db4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:29.291457 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f9daf-0577-47cc-9234-517d009a7db4 service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:29.291738 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f9daf-0577-47cc-9234-517d009a7db4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:29.292012 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f9daf-0577-47cc-9234-517d009a7db4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:29.300746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f9daf-0577-47cc-9234-517d009a7db4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:29.302180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f9daf-0577-47cc-9234-517d009a7db4 service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:29.311904 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1323/2640] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:29 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:49:29.452271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2523f24-7696-49f9-8f5e-447f196f2779 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:29.519069 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2523f24-7696-49f9-8f5e-447f196f2779 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:29.524829 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2ae4d-8b15-471f-9126-df3576e17182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:29.525736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2ae4d-8b15-471f-9126-df3576e17182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:29.526020 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2ae4d-8b15-471f-9126-df3576e17182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:29.526298 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2ae4d-8b15-471f-9126-df3576e17182 admin admin] PATH_INFO: `/v3/users/e6ee5f9b55a44f06b74d05feae256e0d` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:29.527482 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2ae4d-8b15-471f-9126-df3576e17182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ee5f9b55a44f06b74d05feae256e0d)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:29.529562 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2ae4d-8b15-471f-9126-df3576e17182 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:29.576404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-75e2ae4d-8b15-471f-9126-df3576e17182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ee5f9b55a44f06b74d05feae256e0d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:29.577052 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-75e2ae4d-8b15-471f-9126-df3576e17182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ee5f9b55a44f06b74d05feae256e0d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:29.578770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:29.587510 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-75e2ae4d-8b15-471f-9126-df3576e17182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ee5f9b55a44f06b74d05feae256e0d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:29.595128 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-75e2ae4d-8b15-471f-9126-df3576e17182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ee5f9b55a44f06b74d05feae256e0d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:29.608080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-75e2ae4d-8b15-471f-9126-df3576e17182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ee5f9b55a44f06b74d05feae256e0d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:29.614337 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1318/2641] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:49:29 2022] DELETE /identity/v3/users/e6ee5f9b55a44f06b74d05feae256e0d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:29.619135 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459986a-e277-4af4-be99-a060ae72bf3a None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:29.619430 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459986a-e277-4af4-be99-a060ae72bf3a None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:29.619712 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e459986a-e277-4af4-be99-a060ae72bf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:29.638235 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-e459986a-e277-4af4-be99-a060ae72bf3a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:29.639554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e459986a-e277-4af4-be99-a060ae72bf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:29.721096 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1324/2642] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:29.728453 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2ae4d-8b15-471f-9126-df3576e17182 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:29.729916 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-75e2ae4d-8b15-471f-9126-df3576e17182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:29.790625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2ae4d-8b15-471f-9126-df3576e17182 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:29.795088 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1478b7-719d-4567-8e07-cb2fedafc832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:29.795739 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1478b7-719d-4567-8e07-cb2fedafc832 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:29.796026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1478b7-719d-4567-8e07-cb2fedafc832 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:29.796330 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1478b7-719d-4567-8e07-cb2fedafc832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:29.806739 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1478b7-719d-4567-8e07-cb2fedafc832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:29.808537 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1478b7-719d-4567-8e07-cb2fedafc832 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:29.821618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1319/2643] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:49:30.087095 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459986a-e277-4af4-be99-a060ae72bf3a None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:30.088707 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e459986a-e277-4af4-be99-a060ae72bf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:30.109182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e459986a-e277-4af4-be99-a060ae72bf3a None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:30.114488 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41116a39-23ae-4c02-b1b4-9cc51a28963b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:30.118455 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41116a39-23ae-4c02-b1b4-9cc51a28963b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:30.118842 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41116a39-23ae-4c02-b1b4-9cc51a28963b admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:30.119051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41116a39-23ae-4c02-b1b4-9cc51a28963b admin admin] PATH_INFO: `/v3/projects/7d0c15fef27945c29ddc951cc7e36ad6` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:30.120461 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41116a39-23ae-4c02-b1b4-9cc51a28963b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d0c15fef27945c29ddc951cc7e36ad6)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:30.122414 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41116a39-23ae-4c02-b1b4-9cc51a28963b admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:30.175308 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-41116a39-23ae-4c02-b1b4-9cc51a28963b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d0c15fef27945c29ddc951cc7e36ad6', 'request_id': 'req-41116a39-23ae-4c02-b1b4-9cc51a28963b'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:30.182585 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-41116a39-23ae-4c02-b1b4-9cc51a28963b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d0c15fef27945c29ddc951cc7e36ad6', 'request_id': 'req-41116a39-23ae-4c02-b1b4-9cc51a28963b'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:30.189740 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-41116a39-23ae-4c02-b1b4-9cc51a28963b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d0c15fef27945c29ddc951cc7e36ad6', 'request_id': 'req-41116a39-23ae-4c02-b1b4-9cc51a28963b'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:30.202508 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-41116a39-23ae-4c02-b1b4-9cc51a28963b admin admin] The token cache is being invalidate because project 7d0c15fef27945c29ddc951cc7e36ad6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:49:30.202799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-41116a39-23ae-4c02-b1b4-9cc51a28963b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:30.203443 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-41116a39-23ae-4c02-b1b4-9cc51a28963b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:30.205045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1325/2644] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:49:30 2022] DELETE /identity/v3/projects/7d0c15fef27945c29ddc951cc7e36ad6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:49:30.209128 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1478b7-719d-4567-8e07-cb2fedafc832 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:30.219361 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1478b7-719d-4567-8e07-cb2fedafc832 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:30.291411 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e6926-078d-424e-a22d-ebf1b8557b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:30.292524 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e6926-078d-424e-a22d-ebf1b8557b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:30.292890 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e6926-078d-424e-a22d-ebf1b8557b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:30.293288 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e6926-078d-424e-a22d-ebf1b8557b47 admin admin] PATH_INFO: `/v3/users/ca0b3c84de624a61909bc76481f9bd22` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:30.294588 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e6926-078d-424e-a22d-ebf1b8557b47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca0b3c84de624a61909bc76481f9bd22)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:30.301291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e6926-078d-424e-a22d-ebf1b8557b47 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:30.347040 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6c2e6926-078d-424e-a22d-ebf1b8557b47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca0b3c84de624a61909bc76481f9bd22'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:30.349934 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6c2e6926-078d-424e-a22d-ebf1b8557b47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca0b3c84de624a61909bc76481f9bd22'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:30.357667 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6c2e6926-078d-424e-a22d-ebf1b8557b47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca0b3c84de624a61909bc76481f9bd22'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:30.365988 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6c2e6926-078d-424e-a22d-ebf1b8557b47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca0b3c84de624a61909bc76481f9bd22'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:30.371792 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:30.382746 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6c2e6926-078d-424e-a22d-ebf1b8557b47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca0b3c84de624a61909bc76481f9bd22'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:30.392456 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1320/2645] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:49:30 2022] DELETE /identity/v3/users/ca0b3c84de624a61909bc76481f9bd22 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:30.672073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41116a39-23ae-4c02-b1b4-9cc51a28963b admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:30.674024 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-41116a39-23ae-4c02-b1b4-9cc51a28963b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:30.691048 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41116a39-23ae-4c02-b1b4-9cc51a28963b admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:30.709832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:30.753153 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e6926-078d-424e-a22d-ebf1b8557b47 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:30.755085 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6c2e6926-078d-424e-a22d-ebf1b8557b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:30.773205 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5c9fe-bedd-4a27-90c5-8984c63ec5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:30.774022 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5c9fe-bedd-4a27-90c5-8984c63ec5ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:30.774303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5c9fe-bedd-4a27-90c5-8984c63ec5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:30.774577 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5c9fe-bedd-4a27-90c5-8984c63ec5ee admin admin] PATH_INFO: `/v3/projects/432e706fc75f48469733ad6fb996cfef` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:30.775776 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5c9fe-bedd-4a27-90c5-8984c63ec5ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=432e706fc75f48469733ad6fb996cfef)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:30.777829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5c9fe-bedd-4a27-90c5-8984c63ec5ee admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:30.837811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e6926-078d-424e-a22d-ebf1b8557b47 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:30.842003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-84a5c9fe-bedd-4a27-90c5-8984c63ec5ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '432e706fc75f48469733ad6fb996cfef', 'request_id': 'req-84a5c9fe-bedd-4a27-90c5-8984c63ec5ee'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:30.848464 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-84a5c9fe-bedd-4a27-90c5-8984c63ec5ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '432e706fc75f48469733ad6fb996cfef', 'request_id': 'req-84a5c9fe-bedd-4a27-90c5-8984c63ec5ee'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:30.860111 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-84a5c9fe-bedd-4a27-90c5-8984c63ec5ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '432e706fc75f48469733ad6fb996cfef', 'request_id': 'req-84a5c9fe-bedd-4a27-90c5-8984c63ec5ee'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:30.874724 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-84a5c9fe-bedd-4a27-90c5-8984c63ec5ee admin admin] The token cache is being invalidate because project 432e706fc75f48469733ad6fb996cfef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:49:30.875022 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-84a5c9fe-bedd-4a27-90c5-8984c63ec5ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:30.875931 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-84a5c9fe-bedd-4a27-90c5-8984c63ec5ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:30.877864 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1326/2646] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:49:30 2022] DELETE /identity/v3/projects/432e706fc75f48469733ad6fb996cfef => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:30.883729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510811ba-f481-43f7-8391-bfb01000c216 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:30.883992 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510811ba-f481-43f7-8391-bfb01000c216 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:30.884281 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510811ba-f481-43f7-8391-bfb01000c216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:30.904336 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-510811ba-f481-43f7-8391-bfb01000c216 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:30.905391 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-510811ba-f481-43f7-8391-bfb01000c216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:30.910319 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8614e5-d0d8-4d6e-afe5-1cba23b2005d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:30.911308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8614e5-d0d8-4d6e-afe5-1cba23b2005d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:30.911788 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8614e5-d0d8-4d6e-afe5-1cba23b2005d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:30.912721 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8614e5-d0d8-4d6e-afe5-1cba23b2005d admin admin] PATH_INFO: `/v3/users/aced853b8f4a44789e252f8fc522d132` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:30.914171 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8614e5-d0d8-4d6e-afe5-1cba23b2005d admin admin] RBAC: Authorizing `identity:delete_user(user_id=aced853b8f4a44789e252f8fc522d132)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:30.915164 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1327/2647] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:49:30.916127 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8614e5-d0d8-4d6e-afe5-1cba23b2005d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:30.923248 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca3a83-52d2-41b1-9bab-6e22bc60e629 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:30.923535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca3a83-52d2-41b1-9bab-6e22bc60e629 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:30.923811 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca3a83-52d2-41b1-9bab-6e22bc60e629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:30.943222 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-9aca3a83-52d2-41b1-9bab-6e22bc60e629 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:30.944696 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-9aca3a83-52d2-41b1-9bab-6e22bc60e629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:30.954071 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1328/2648] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:30.958459 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca3a83-52d2-41b1-9bab-6e22bc60e629 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:30.968628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca3a83-52d2-41b1-9bab-6e22bc60e629 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:30.973880 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f9ab6-f611-40a9-815d-43419bda5809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:30.974483 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f9ab6-f611-40a9-815d-43419bda5809 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:30.974873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f9ab6-f611-40a9-815d-43419bda5809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:30.975169 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f9ab6-f611-40a9-815d-43419bda5809 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:30.975925 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f9ab6-f611-40a9-815d-43419bda5809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:49:30.976233 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f9ab6-f611-40a9-815d-43419bda5809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:30.977858 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f9ab6-f611-40a9-815d-43419bda5809 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:30.993864 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1329/2649] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:49:30.994009 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7e8614e5-d0d8-4d6e-afe5-1cba23b2005d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aced853b8f4a44789e252f8fc522d132'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:30.994253 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7e8614e5-d0d8-4d6e-afe5-1cba23b2005d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aced853b8f4a44789e252f8fc522d132'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:30.996104 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f9ab6-f611-40a9-815d-43419bda5809 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:31.004479 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7e8614e5-d0d8-4d6e-afe5-1cba23b2005d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aced853b8f4a44789e252f8fc522d132'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:31.009595 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f9ab6-f611-40a9-815d-43419bda5809 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:31.012452 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7e8614e5-d0d8-4d6e-afe5-1cba23b2005d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aced853b8f4a44789e252f8fc522d132'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:31.014461 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4b4cb-3a32-432c-ae9d-2968389f2ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:31.015293 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4b4cb-3a32-432c-ae9d-2968389f2ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:31.015586 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4b4cb-3a32-432c-ae9d-2968389f2ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:31.015859 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4b4cb-3a32-432c-ae9d-2968389f2ff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:31.016558 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4b4cb-3a32-432c-ae9d-2968389f2ff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:31.018501 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4b4cb-3a32-432c-ae9d-2968389f2ff0 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:31.027485 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7e8614e5-d0d8-4d6e-afe5-1cba23b2005d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aced853b8f4a44789e252f8fc522d132'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:31.036030 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1321/2650] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:49:30 2022] DELETE /identity/v3/users/aced853b8f4a44789e252f8fc522d132 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:31.042348 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c5d13-6c00-46c4-b4aa-b0a24e754523 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:31.042685 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c5d13-6c00-46c4-b4aa-b0a24e754523 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:31.043005 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c5d13-6c00-46c4-b4aa-b0a24e754523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:31.057843 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1330/2651] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:49:30 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:49:31.058863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4b4cb-3a32-432c-ae9d-2968389f2ff0 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:31.060660 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-6ae4b4cb-3a32-432c-ae9d-2968389f2ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:31.067959 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-913c5d13-6c00-46c4-b4aa-b0a24e754523 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:31.069475 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-913c5d13-6c00-46c4-b4aa-b0a24e754523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:31.082971 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:31.123403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:31.127755 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4b4cb-3a32-432c-ae9d-2968389f2ff0 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:31.134266 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fea2fd-ba13-4a83-b036-82081465963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:31.134943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fea2fd-ba13-4a83-b036-82081465963a admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:31.135233 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fea2fd-ba13-4a83-b036-82081465963a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:31.135531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fea2fd-ba13-4a83-b036-82081465963a admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:31.136609 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fea2fd-ba13-4a83-b036-82081465963a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:31.137944 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1322/2652] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:31.142109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fea2fd-ba13-4a83-b036-82081465963a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:31.148353 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c5d13-6c00-46c4-b4aa-b0a24e754523 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:31.149756 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-913c5d13-6c00-46c4-b4aa-b0a24e754523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:31.167935 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1331/2653] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:49:31 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:49:31.168967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fea2fd-ba13-4a83-b036-82081465963a admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:31.178566 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fea2fd-ba13-4a83-b036-82081465963a admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:31.183238 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9da87d-0176-45ed-ac52-79d5959de8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:31.183883 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9da87d-0176-45ed-ac52-79d5959de8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:31.184170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9da87d-0176-45ed-ac52-79d5959de8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:31.184454 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9da87d-0176-45ed-ac52-79d5959de8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:31.185182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9da87d-0176-45ed-ac52-79d5959de8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:31.186818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9da87d-0176-45ed-ac52-79d5959de8d5 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:31.197240 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1332/2654] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:49:31.200918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9da87d-0176-45ed-ac52-79d5959de8d5 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:31.207867 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c5d13-6c00-46c4-b4aa-b0a24e754523 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:31.211045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9da87d-0176-45ed-ac52-79d5959de8d5 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:31.212414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94cd77a-f835-45f6-a744-f218a82e8097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:31.213084 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cd77a-f835-45f6-a744-f218a82e8097 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:31.213367 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cd77a-f835-45f6-a744-f218a82e8097 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:31.213676 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94cd77a-f835-45f6-a744-f218a82e8097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:31.216309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda1720-03a1-433c-845d-fc0c4d7b9907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:31.216958 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda1720-03a1-433c-845d-fc0c4d7b9907 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:31.217279 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda1720-03a1-433c-845d-fc0c4d7b9907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:31.217596 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda1720-03a1-433c-845d-fc0c4d7b9907 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:31.218313 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda1720-03a1-433c-845d-fc0c4d7b9907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:31.219893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda1720-03a1-433c-845d-fc0c4d7b9907 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:31.222859 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cd77a-f835-45f6-a744-f218a82e8097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:31.224291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94cd77a-f835-45f6-a744-f218a82e8097 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:31.231708 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1333/2655] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:49:31.235537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda1720-03a1-433c-845d-fc0c4d7b9907 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:31.237334 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1323/2656] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:49:31.245715 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda1720-03a1-433c-845d-fc0c4d7b9907 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:31.250284 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a75442-9700-45e5-ac80-69e244df2d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:31.251278 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a75442-9700-45e5-ac80-69e244df2d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:31.251425 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a75442-9700-45e5-ac80-69e244df2d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:31.251697 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a75442-9700-45e5-ac80-69e244df2d37 admin admin] PATH_INFO: `/v3/projects/2f9a503c7d7242b9ba5bcdc68d5dfb16/users/36b7d2892928487db79a8f66098d3ef6/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:31.267268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a75442-9700-45e5-ac80-69e244df2d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9a503c7d7242b9ba5bcdc68d5dfb16, user_id=36b7d2892928487db79a8f66098d3ef6, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:31.270212 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a75442-9700-45e5-ac80-69e244df2d37 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:31.283279 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1334/2657] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:49:31 2022] PUT /identity/v3/projects/2f9a503c7d7242b9ba5bcdc68d5dfb16/users/36b7d2892928487db79a8f66098d3ef6/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:49:31.295516 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0d5ff-68b5-4935-92d8-1ad83a748be2 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:31.295891 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0d5ff-68b5-4935-92d8-1ad83a748be2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:31.296385 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0d5ff-68b5-4935-92d8-1ad83a748be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:31.331600 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9fe0d5ff-68b5-4935-92d8-1ad83a748be2 None None] MFA Rules not processed for user `36b7d2892928487db79a8f66098d3ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:31.333122 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9fe0d5ff-68b5-4935-92d8-1ad83a748be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:31.406354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1324/2658] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:49:31.410902 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a75442-9700-45e5-ac80-69e244df2d37 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:31.476580 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a75442-9700-45e5-ac80-69e244df2d37 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:31.481442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac0f79-c482-46fe-8df3-719278d9970a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:31.482104 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac0f79-c482-46fe-8df3-719278d9970a admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:31.482385 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac0f79-c482-46fe-8df3-719278d9970a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:31.482660 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac0f79-c482-46fe-8df3-719278d9970a admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:31.483358 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac0f79-c482-46fe-8df3-719278d9970a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:31.485363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac0f79-c482-46fe-8df3-719278d9970a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:31.516249 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1335/2659] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:49:31 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:31.520856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac0f79-c482-46fe-8df3-719278d9970a admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:31.521560 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0d5ff-68b5-4935-92d8-1ad83a748be2 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:31.524036 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9fe0d5ff-68b5-4935-92d8-1ad83a748be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:31.547546 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0d5ff-68b5-4935-92d8-1ad83a748be2 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:31.588413 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac0f79-c482-46fe-8df3-719278d9970a admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:31.593263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:31.593507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b91a94-b1dc-48a0-a1b4-b27eafbacd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:31.594226 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b91a94-b1dc-48a0-a1b4-b27eafbacd8f admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:31.594465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b91a94-b1dc-48a0-a1b4-b27eafbacd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:31.594796 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b91a94-b1dc-48a0-a1b4-b27eafbacd8f admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:31.595465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b91a94-b1dc-48a0-a1b4-b27eafbacd8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:31.597408 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b91a94-b1dc-48a0-a1b4-b27eafbacd8f admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:31.607172 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ccf575-2082-4132-85d2-d4e1275abf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:31.608038 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccf575-2082-4132-85d2-d4e1275abf45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:31.608316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccf575-2082-4132-85d2-d4e1275abf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:31.608595 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccf575-2082-4132-85d2-d4e1275abf45 admin admin] PATH_INFO: `/v3/projects/b344f575c2144ba0ad962f35dd18745d` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:31.609957 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ccf575-2082-4132-85d2-d4e1275abf45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b344f575c2144ba0ad962f35dd18745d)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:31.612151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ccf575-2082-4132-85d2-d4e1275abf45 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:31.625339 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1336/2660] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:49:31 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:31.626456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b91a94-b1dc-48a0-a1b4-b27eafbacd8f admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:31.637793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b91a94-b1dc-48a0-a1b4-b27eafbacd8f admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:31.643977 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd79a6-42f3-49e0-9cb2-f30d82ad5a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:31.644633 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd79a6-42f3-49e0-9cb2-f30d82ad5a8e admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:31.645179 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd79a6-42f3-49e0-9cb2-f30d82ad5a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:31.645496 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd79a6-42f3-49e0-9cb2-f30d82ad5a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:31.646227 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd79a6-42f3-49e0-9cb2-f30d82ad5a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:31.648077 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd79a6-42f3-49e0-9cb2-f30d82ad5a8e admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:31.658293 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1337/2661] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:49:31.661441 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f5ccf575-2082-4132-85d2-d4e1275abf45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b344f575c2144ba0ad962f35dd18745d', 'request_id': 'req-f5ccf575-2082-4132-85d2-d4e1275abf45'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:31.663085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd79a6-42f3-49e0-9cb2-f30d82ad5a8e admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:31.666796 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f5ccf575-2082-4132-85d2-d4e1275abf45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b344f575c2144ba0ad962f35dd18745d', 'request_id': 'req-f5ccf575-2082-4132-85d2-d4e1275abf45'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:31.668968 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:31.673767 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd79a6-42f3-49e0-9cb2-f30d82ad5a8e admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:31.674395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f5ccf575-2082-4132-85d2-d4e1275abf45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b344f575c2144ba0ad962f35dd18745d', 'request_id': 'req-f5ccf575-2082-4132-85d2-d4e1275abf45'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:31.689334 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f5ccf575-2082-4132-85d2-d4e1275abf45 admin admin] The token cache is being invalidate because project b344f575c2144ba0ad962f35dd18745d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:49:31.689650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f5ccf575-2082-4132-85d2-d4e1275abf45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:31.690387 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-f5ccf575-2082-4132-85d2-d4e1275abf45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:31.692073 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1325/2662] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:49:31 2022] DELETE /identity/v3/projects/b344f575c2144ba0ad962f35dd18745d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:31.696808 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8e251-2210-4978-b128-d16378ca1ac8 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:31.697224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8e251-2210-4978-b128-d16378ca1ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:31.697546 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8e251-2210-4978-b128-d16378ca1ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:31.715811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-efe8e251-2210-4978-b128-d16378ca1ac8 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:31.717004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-efe8e251-2210-4978-b128-d16378ca1ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:31.735049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02028d3e-3eae-4679-b6a6-203c8f8a314c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:31.735972 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02028d3e-3eae-4679-b6a6-203c8f8a314c admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:31.736256 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02028d3e-3eae-4679-b6a6-203c8f8a314c admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:31.736535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02028d3e-3eae-4679-b6a6-203c8f8a314c admin admin] PATH_INFO: `/v3/projects/a533dac529c94ceda3f9c8a097cb6459/users/e94f1e530f084d1abdfe39d27e2eb334/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:31.751916 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02028d3e-3eae-4679-b6a6-203c8f8a314c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a533dac529c94ceda3f9c8a097cb6459, user_id=e94f1e530f084d1abdfe39d27e2eb334, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:31.754593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02028d3e-3eae-4679-b6a6-203c8f8a314c admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:31.768434 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1338/2663] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:49:31 2022] PUT /identity/v3/projects/a533dac529c94ceda3f9c8a097cb6459/users/e94f1e530f084d1abdfe39d27e2eb334/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:31.773241 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02028d3e-3eae-4679-b6a6-203c8f8a314c admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:31.774880 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-02028d3e-3eae-4679-b6a6-203c8f8a314c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:31.778124 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1326/2664] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:49:31.785654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f762c68-72b6-42c0-adc0-a3762cac8f46 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:31.785948 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f762c68-72b6-42c0-adc0-a3762cac8f46 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:31.786230 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f762c68-72b6-42c0-adc0-a3762cac8f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:31.805423 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-4f762c68-72b6-42c0-adc0-a3762cac8f46 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:31.806553 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4f762c68-72b6-42c0-adc0-a3762cac8f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:31.844711 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02028d3e-3eae-4679-b6a6-203c8f8a314c admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:31.850625 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129aacfa-6289-4e2e-8a48-5908a7642243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:31.851296 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129aacfa-6289-4e2e-8a48-5908a7642243 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:31.851585 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129aacfa-6289-4e2e-8a48-5908a7642243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:31.851867 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129aacfa-6289-4e2e-8a48-5908a7642243 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:31.852863 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129aacfa-6289-4e2e-8a48-5908a7642243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:31.854504 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129aacfa-6289-4e2e-8a48-5908a7642243 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:31.864488 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1339/2665] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:49:31.868547 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129aacfa-6289-4e2e-8a48-5908a7642243 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:31.877967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129aacfa-6289-4e2e-8a48-5908a7642243 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:31.878118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1327/2666] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:49:31.882076 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f762c68-72b6-42c0-adc0-a3762cac8f46 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:31.882888 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af0040-9717-45d9-8164-12f19458719a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:31.883781 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af0040-9717-45d9-8164-12f19458719a admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:31.884110 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af0040-9717-45d9-8164-12f19458719a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:31.884389 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af0040-9717-45d9-8164-12f19458719a admin admin] PATH_INFO: `/v3/projects/a533dac529c94ceda3f9c8a097cb6459/users/e94f1e530f084d1abdfe39d27e2eb334/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:31.886399 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af0040-9717-45d9-8164-12f19458719a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a533dac529c94ceda3f9c8a097cb6459, user_id=e94f1e530f084d1abdfe39d27e2eb334, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:31.889005 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af0040-9717-45d9-8164-12f19458719a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:31.891270 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f762c68-72b6-42c0-adc0-a3762cac8f46 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:31.896300 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7fae5-c17b-4e16-94ac-729be2b24c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:31.897488 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7fae5-c17b-4e16-94ac-729be2b24c71 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:31.897784 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7fae5-c17b-4e16-94ac-729be2b24c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:31.898062 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7fae5-c17b-4e16-94ac-729be2b24c71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:31.898819 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7fae5-c17b-4e16-94ac-729be2b24c71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:49:31.899130 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7fae5-c17b-4e16-94ac-729be2b24c71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:31.900583 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1340/2667] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:49:31 2022] PUT /identity/v3/projects/a533dac529c94ceda3f9c8a097cb6459/users/e94f1e530f084d1abdfe39d27e2eb334/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:49:31.901531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7fae5-c17b-4e16-94ac-729be2b24c71 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:31.911424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f6746-af8c-4ffd-b433-92bd45c7897b None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:31.911721 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f6746-af8c-4ffd-b433-92bd45c7897b None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:31.912000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f6746-af8c-4ffd-b433-92bd45c7897b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:31.917577 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1328/2668] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 14 19:49:31.918997 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7fae5-c17b-4e16-94ac-729be2b24c71 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:31.925944 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:31.930077 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7fae5-c17b-4e16-94ac-729be2b24c71 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:31.941178 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-8f6f6746-af8c-4ffd-b433-92bd45c7897b None None] MFA Rules not processed for user `e94f1e530f084d1abdfe39d27e2eb334`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:31.942495 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-8f6f6746-af8c-4ffd-b433-92bd45c7897b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:31.988391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30166d9a-6517-488d-9daa-85ad17ab25c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:31.989041 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30166d9a-6517-488d-9daa-85ad17ab25c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:31.989322 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30166d9a-6517-488d-9daa-85ad17ab25c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:31.989624 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30166d9a-6517-488d-9daa-85ad17ab25c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:31.990386 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30166d9a-6517-488d-9daa-85ad17ab25c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:31.992454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30166d9a-6517-488d-9daa-85ad17ab25c6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:32.002893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:32.014020 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1341/2669] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:49:32.018563 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1329/2670] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:49:31 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:49:32.023542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f6746-af8c-4ffd-b433-92bd45c7897b None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:32.025617 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30166d9a-6517-488d-9daa-85ad17ab25c6 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:32.027210 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-30166d9a-6517-488d-9daa-85ad17ab25c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:32.033978 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f6746-af8c-4ffd-b433-92bd45c7897b None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:32.084603 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30166d9a-6517-488d-9daa-85ad17ab25c6 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:32.088578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66597e30-df9c-418c-98fe-215c14866de6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:32.089228 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66597e30-df9c-418c-98fe-215c14866de6 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:32.089556 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66597e30-df9c-418c-98fe-215c14866de6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:32.089836 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66597e30-df9c-418c-98fe-215c14866de6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:32.091627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-66597e30-df9c-418c-98fe-215c14866de6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:32.092146 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9637e1c-eeeb-4376-a7ec-6a36f3632a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:32.092862 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9637e1c-eeeb-4376-a7ec-6a36f3632a8c admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:32.093208 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9637e1c-eeeb-4376-a7ec-6a36f3632a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:32.093463 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9637e1c-eeeb-4376-a7ec-6a36f3632a8c admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:32.094160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9637e1c-eeeb-4376-a7ec-6a36f3632a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:32.096282 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9637e1c-eeeb-4376-a7ec-6a36f3632a8c admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:32.119724 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1342/2671] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:49:32 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:32.123797 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9637e1c-eeeb-4376-a7ec-6a36f3632a8c admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:32.133395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9637e1c-eeeb-4376-a7ec-6a36f3632a8c admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:32.138165 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcc2bb-294a-41be-a399-da7a00a0a832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:32.138812 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcc2bb-294a-41be-a399-da7a00a0a832 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:32.139096 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcc2bb-294a-41be-a399-da7a00a0a832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:32.139379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bcc2bb-294a-41be-a399-da7a00a0a832 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:32.140129 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcc2bb-294a-41be-a399-da7a00a0a832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:32.141746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bcc2bb-294a-41be-a399-da7a00a0a832 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:32.154994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1343/2672] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:49:32.155510 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66597e30-df9c-418c-98fe-215c14866de6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:32.156299 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcc2bb-294a-41be-a399-da7a00a0a832 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:32.157151 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66597e30-df9c-418c-98fe-215c14866de6 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:32.166473 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bcc2bb-294a-41be-a399-da7a00a0a832 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:32.167129 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1330/2673] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:49:32.172877 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f344062-538d-4087-a4f2-d24d1749bc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:32.173560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f344062-538d-4087-a4f2-d24d1749bc0a admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:32.173853 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f344062-538d-4087-a4f2-d24d1749bc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:32.174132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f344062-538d-4087-a4f2-d24d1749bc0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:32.174930 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f344062-538d-4087-a4f2-d24d1749bc0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:32.176409 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f344062-538d-4087-a4f2-d24d1749bc0a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:32.187758 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1344/2674] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:49:32.192031 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66597e30-df9c-418c-98fe-215c14866de6 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:32.202998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66597e30-df9c-418c-98fe-215c14866de6 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:32.207450 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbec3c-77c9-4224-a8f7-d557a217dacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:32.208321 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbec3c-77c9-4224-a8f7-d557a217dacc admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:32.208596 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbec3c-77c9-4224-a8f7-d557a217dacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:32.208859 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cbec3c-77c9-4224-a8f7-d557a217dacc admin admin] PATH_INFO: `/v3/projects/8009f789c4ad4b239042770bbd711cd4/users/6ce36ec76ca943d899bd80a844b85e03/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:32.223373 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbec3c-77c9-4224-a8f7-d557a217dacc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8009f789c4ad4b239042770bbd711cd4, user_id=6ce36ec76ca943d899bd80a844b85e03, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:32.228247 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cbec3c-77c9-4224-a8f7-d557a217dacc admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:32.243911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1331/2675] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:49:32 2022] PUT /identity/v3/projects/8009f789c4ad4b239042770bbd711cd4/users/6ce36ec76ca943d899bd80a844b85e03/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:32.255546 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a78ed4-7831-4ac7-b4b1-5cdb98cc93c3 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:32.255860 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a78ed4-7831-4ac7-b4b1-5cdb98cc93c3 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:32.256156 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a78ed4-7831-4ac7-b4b1-5cdb98cc93c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:32.283000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-35a78ed4-7831-4ac7-b4b1-5cdb98cc93c3 None None] MFA Rules not processed for user `6ce36ec76ca943d899bd80a844b85e03`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:32.284216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-35a78ed4-7831-4ac7-b4b1-5cdb98cc93c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:32.360386 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1345/2676] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:32.365054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbec3c-77c9-4224-a8f7-d557a217dacc admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:32.387944 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:32.437039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cbec3c-77c9-4224-a8f7-d557a217dacc admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:32.442373 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5c21f-56d2-47c1-8728-06e87039627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:32.443076 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5c21f-56d2-47c1-8728-06e87039627f admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:32.443923 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5c21f-56d2-47c1-8728-06e87039627f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:32.444255 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5c21f-56d2-47c1-8728-06e87039627f admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:32.445251 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5c21f-56d2-47c1-8728-06e87039627f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:32.447492 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f5c21f-56d2-47c1-8728-06e87039627f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:32.478325 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1332/2677] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:49:32 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:49:32.479528 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a78ed4-7831-4ac7-b4b1-5cdb98cc93c3 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:32.491181 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a78ed4-7831-4ac7-b4b1-5cdb98cc93c3 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:32.545788 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:32.557124 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d75be-fcf9-4370-ba1d-056ed5d3dca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:32.557868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d75be-fcf9-4370-ba1d-056ed5d3dca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:32.558160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d75be-fcf9-4370-ba1d-056ed5d3dca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:32.558443 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d75be-fcf9-4370-ba1d-056ed5d3dca0 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:32.559142 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d75be-fcf9-4370-ba1d-056ed5d3dca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:32.561059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2d75be-fcf9-4370-ba1d-056ed5d3dca0 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:32.585415 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1346/2678] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:49:32 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:32.586824 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5c21f-56d2-47c1-8728-06e87039627f admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:32.597278 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5c21f-56d2-47c1-8728-06e87039627f admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:32.602924 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2d058-89cb-4e33-99dd-178cdbb287b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:32.603578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2d058-89cb-4e33-99dd-178cdbb287b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:32.603864 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2d058-89cb-4e33-99dd-178cdbb287b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:32.604143 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2d058-89cb-4e33-99dd-178cdbb287b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:32.604864 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2d058-89cb-4e33-99dd-178cdbb287b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:32.606495 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2d058-89cb-4e33-99dd-178cdbb287b2 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:32.617308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1333/2679] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:49:32.621204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d75be-fcf9-4370-ba1d-056ed5d3dca0 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:32.631162 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2d75be-fcf9-4370-ba1d-056ed5d3dca0 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:32.636137 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f4065-804f-4887-bc41-c1af393a429e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:32.636883 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f4065-804f-4887-bc41-c1af393a429e admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:32.637197 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f4065-804f-4887-bc41-c1af393a429e admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:32.637499 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f4065-804f-4887-bc41-c1af393a429e admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:32.638222 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f4065-804f-4887-bc41-c1af393a429e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:32.639799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f4065-804f-4887-bc41-c1af393a429e admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:32.650967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1347/2680] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:49:32.654959 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2d058-89cb-4e33-99dd-178cdbb287b2 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:32.665823 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2d058-89cb-4e33-99dd-178cdbb287b2 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:32.670496 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e9114-e95f-4118-bbd1-31e739604ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:32.671373 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e9114-e95f-4118-bbd1-31e739604ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:32.671660 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e9114-e95f-4118-bbd1-31e739604ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:32.671940 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e9114-e95f-4118-bbd1-31e739604ac1 admin admin] PATH_INFO: `/v3/projects/612db3cbf1f3464e9d95e1301a569471/users/c6a4a7a099794999bf0e136ff8b96b7b/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:32.687256 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e9114-e95f-4118-bbd1-31e739604ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=612db3cbf1f3464e9d95e1301a569471, user_id=c6a4a7a099794999bf0e136ff8b96b7b, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:32.689963 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e9114-e95f-4118-bbd1-31e739604ac1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:32.702514 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1334/2681] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:49:32 2022] PUT /identity/v3/projects/612db3cbf1f3464e9d95e1301a569471/users/c6a4a7a099794999bf0e136ff8b96b7b/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:32.713478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65699405-81c4-41ea-8ea4-2f09e1657ce2 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:32.713942 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65699405-81c4-41ea-8ea4-2f09e1657ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:32.714102 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65699405-81c4-41ea-8ea4-2f09e1657ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:32.740476 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-65699405-81c4-41ea-8ea4-2f09e1657ce2 None None] MFA Rules not processed for user `c6a4a7a099794999bf0e136ff8b96b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:32.741703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-65699405-81c4-41ea-8ea4-2f09e1657ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:32.804777 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1348/2682] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:32.809210 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e9114-e95f-4118-bbd1-31e739604ac1 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:32.872241 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e9114-e95f-4118-bbd1-31e739604ac1 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:32.876727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75512a9f-6c5c-4295-ae8d-b60a4aa148f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:32.877395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75512a9f-6c5c-4295-ae8d-b60a4aa148f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:32.877686 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75512a9f-6c5c-4295-ae8d-b60a4aa148f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:32.877963 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75512a9f-6c5c-4295-ae8d-b60a4aa148f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:32.878656 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75512a9f-6c5c-4295-ae8d-b60a4aa148f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:32.880543 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75512a9f-6c5c-4295-ae8d-b60a4aa148f9 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:32.911160 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1335/2683] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:49:32 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:32.915264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65699405-81c4-41ea-8ea4-2f09e1657ce2 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:32.925939 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65699405-81c4-41ea-8ea4-2f09e1657ce2 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:32.981465 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2117c50-807e-4b07-a857-92bd53058f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:32.982120 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2117c50-807e-4b07-a857-92bd53058f86 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:32.982406 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2117c50-807e-4b07-a857-92bd53058f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:32.982684 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2117c50-807e-4b07-a857-92bd53058f86 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:32.983362 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2117c50-807e-4b07-a857-92bd53058f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:32.985264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2117c50-807e-4b07-a857-92bd53058f86 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:33.004356 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1349/2684] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:49:32 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:33.008951 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75512a9f-6c5c-4295-ae8d-b60a4aa148f9 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:33.019065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75512a9f-6c5c-4295-ae8d-b60a4aa148f9 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:33.024663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcf1eb-321d-49c5-aa9c-f68d734cd3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:33.025315 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcf1eb-321d-49c5-aa9c-f68d734cd3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:33.025647 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcf1eb-321d-49c5-aa9c-f68d734cd3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:33.025924 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bcf1eb-321d-49c5-aa9c-f68d734cd3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:33.026645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bcf1eb-321d-49c5-aa9c-f68d734cd3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:33.028241 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bcf1eb-321d-49c5-aa9c-f68d734cd3a2 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:33.039069 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1336/2685] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:49:33.043086 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2117c50-807e-4b07-a857-92bd53058f86 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:33.052897 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2117c50-807e-4b07-a857-92bd53058f86 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:33.057721 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d13fa2-76a8-4437-b986-f26f35d9c6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:33.058585 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d13fa2-76a8-4437-b986-f26f35d9c6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:33.058868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d13fa2-76a8-4437-b986-f26f35d9c6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:33.059145 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d13fa2-76a8-4437-b986-f26f35d9c6aa admin admin] PATH_INFO: `/v3/projects/02515a946d244b77b731e14fa0982b4f/users/d4cd880e6b0c4f3bbe7cf40bf733982b/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:33.074604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d13fa2-76a8-4437-b986-f26f35d9c6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=02515a946d244b77b731e14fa0982b4f, user_id=d4cd880e6b0c4f3bbe7cf40bf733982b, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:33.077293 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d13fa2-76a8-4437-b986-f26f35d9c6aa admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:33.090497 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1350/2686] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:49:33 2022] PUT /identity/v3/projects/02515a946d244b77b731e14fa0982b4f/users/d4cd880e6b0c4f3bbe7cf40bf733982b/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:33.094345 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcf1eb-321d-49c5-aa9c-f68d734cd3a2 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:33.104586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bcf1eb-321d-49c5-aa9c-f68d734cd3a2 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:33.149211 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:33.165264 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992cab4c-91fa-45d6-b987-ec3da17cf22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:33.165977 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cab4c-91fa-45d6-b987-ec3da17cf22a admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:33.166272 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cab4c-91fa-45d6-b987-ec3da17cf22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:33.166554 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cab4c-91fa-45d6-b987-ec3da17cf22a admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:33.167273 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992cab4c-91fa-45d6-b987-ec3da17cf22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:33.168873 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992cab4c-91fa-45d6-b987-ec3da17cf22a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:33.178652 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1337/2687] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:49:33.182970 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d13fa2-76a8-4437-b986-f26f35d9c6aa admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:33.193055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d13fa2-76a8-4437-b986-f26f35d9c6aa admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:33.198225 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f9778-cd6a-48b7-88cf-e3258a7a4669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:33.199098 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f9778-cd6a-48b7-88cf-e3258a7a4669 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:33.199384 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f9778-cd6a-48b7-88cf-e3258a7a4669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:33.199665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f9778-cd6a-48b7-88cf-e3258a7a4669 admin admin] PATH_INFO: `/v3/projects/02515a946d244b77b731e14fa0982b4f/users/d4cd880e6b0c4f3bbe7cf40bf733982b/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:33.201650 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f9778-cd6a-48b7-88cf-e3258a7a4669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02515a946d244b77b731e14fa0982b4f, user_id=d4cd880e6b0c4f3bbe7cf40bf733982b, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:33.204322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f9778-cd6a-48b7-88cf-e3258a7a4669 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:33.214912 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1351/2688] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:49:33 2022] PUT /identity/v3/projects/02515a946d244b77b731e14fa0982b4f/users/d4cd880e6b0c4f3bbe7cf40bf733982b/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:33.225048 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed3e66-e0dd-4b73-bb14-266a598fd524 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:33.225048 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed3e66-e0dd-4b73-bb14-266a598fd524 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:33.225850 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed3e66-e0dd-4b73-bb14-266a598fd524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:33.252775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-74ed3e66-e0dd-4b73-bb14-266a598fd524 None None] MFA Rules not processed for user `d4cd880e6b0c4f3bbe7cf40bf733982b`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:33.254000 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-74ed3e66-e0dd-4b73-bb14-266a598fd524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:33.319866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1338/2689] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:33.330302 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f9778-cd6a-48b7-88cf-e3258a7a4669 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:33.345732 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:33.392033 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f9778-cd6a-48b7-88cf-e3258a7a4669 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:33.395883 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb7224-3bf9-4d0c-aa71-9bd3869c62e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:33.396652 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb7224-3bf9-4d0c-aa71-9bd3869c62e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:33.396946 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb7224-3bf9-4d0c-aa71-9bd3869c62e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:33.397306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb7224-3bf9-4d0c-aa71-9bd3869c62e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:33.406273 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb7224-3bf9-4d0c-aa71-9bd3869c62e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:33.407690 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb7224-3bf9-4d0c-aa71-9bd3869c62e2 service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:33.417253 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1352/2690] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:49:33.912492 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed3e66-e0dd-4b73-bb14-266a598fd524 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:33.926351 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed3e66-e0dd-4b73-bb14-266a598fd524 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:33.932647 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878da16-4686-4acd-8597-c71339cc00e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:33.933341 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878da16-4686-4acd-8597-c71339cc00e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:33.933665 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878da16-4686-4acd-8597-c71339cc00e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:33.933921 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878da16-4686-4acd-8597-c71339cc00e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:34.006922 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878da16-4686-4acd-8597-c71339cc00e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:34.008459 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878da16-4686-4acd-8597-c71339cc00e8 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:34.017750 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1339/2691] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:49:39.524637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb7224-3bf9-4d0c-aa71-9bd3869c62e2 service cinder] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:39.526159 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-78cb7224-3bf9-4d0c-aa71-9bd3869c62e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:39.537552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb7224-3bf9-4d0c-aa71-9bd3869c62e2 service cinder] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:39.537929 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878da16-4686-4acd-8597-c71339cc00e8 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:39.539310 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c878da16-4686-4acd-8597-c71339cc00e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:39.541495 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385def6-e1af-4315-821a-3ed2ef58568c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:39.542224 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385def6-e1af-4315-821a-3ed2ef58568c service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:39.542514 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385def6-e1af-4315-821a-3ed2ef58568c service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:39.542790 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385def6-e1af-4315-821a-3ed2ef58568c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:39.606829 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878da16-4686-4acd-8597-c71339cc00e8 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:39.611539 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27f6df-b441-43a8-93dc-aeee378fef6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:39.612403 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27f6df-b441-43a8-93dc-aeee378fef6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:39.612691 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27f6df-b441-43a8-93dc-aeee378fef6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:39.612972 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27f6df-b441-43a8-93dc-aeee378fef6c admin admin] PATH_INFO: `/v3/users/201d4a5d91844f9b854cc47a276bab25` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:39.614193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27f6df-b441-43a8-93dc-aeee378fef6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=201d4a5d91844f9b854cc47a276bab25)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:39.616665 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27f6df-b441-43a8-93dc-aeee378fef6c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:39.619292 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385def6-e1af-4315-821a-3ed2ef58568c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:39.620731 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385def6-e1af-4315-821a-3ed2ef58568c service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:39.621311 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:39.630844 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1353/2692] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:49:39.667714 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2e27f6df-b441-43a8-93dc-aeee378fef6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '201d4a5d91844f9b854cc47a276bab25'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:39.668389 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2e27f6df-b441-43a8-93dc-aeee378fef6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '201d4a5d91844f9b854cc47a276bab25'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:39.676200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2e27f6df-b441-43a8-93dc-aeee378fef6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '201d4a5d91844f9b854cc47a276bab25'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:39.686448 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2e27f6df-b441-43a8-93dc-aeee378fef6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '201d4a5d91844f9b854cc47a276bab25'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:39.699475 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2e27f6df-b441-43a8-93dc-aeee378fef6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '201d4a5d91844f9b854cc47a276bab25'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:39.705997 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1340/2693] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:49:39 2022] DELETE /identity/v3/users/201d4a5d91844f9b854cc47a276bab25 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:49:39.710406 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675d2ab-6e0c-499d-89c5-9382dfe9dd7b None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:39.710929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675d2ab-6e0c-499d-89c5-9382dfe9dd7b None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:39.711063 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675d2ab-6e0c-499d-89c5-9382dfe9dd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:39.728391 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-4675d2ab-6e0c-499d-89c5-9382dfe9dd7b None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:39.729637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-4675d2ab-6e0c-499d-89c5-9382dfe9dd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:39.807766 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1354/2694] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:39.818392 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27f6df-b441-43a8-93dc-aeee378fef6c admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:39.839085 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2e27f6df-b441-43a8-93dc-aeee378fef6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:39.901343 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27f6df-b441-43a8-93dc-aeee378fef6c admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:39.914404 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452250e6-bdd4-477b-9c16-f74fd891cac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:39.916030 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452250e6-bdd4-477b-9c16-f74fd891cac9 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:39.916959 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452250e6-bdd4-477b-9c16-f74fd891cac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:39.917346 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452250e6-bdd4-477b-9c16-f74fd891cac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:39.928484 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452250e6-bdd4-477b-9c16-f74fd891cac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:39.930268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452250e6-bdd4-477b-9c16-f74fd891cac9 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:39.942650 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1341/2695] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:49:40.154750 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675d2ab-6e0c-499d-89c5-9382dfe9dd7b None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:40.156168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-4675d2ab-6e0c-499d-89c5-9382dfe9dd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:40.215552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675d2ab-6e0c-499d-89c5-9382dfe9dd7b None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:40.219338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7456f62-63fb-4642-a412-344e13c684b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:40.219973 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7456f62-63fb-4642-a412-344e13c684b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:40.220341 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7456f62-63fb-4642-a412-344e13c684b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:40.220558 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7456f62-63fb-4642-a412-344e13c684b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:40.222540 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b7456f62-63fb-4642-a412-344e13c684b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:40.229197 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:40.235936 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452250e6-bdd4-477b-9c16-f74fd891cac9 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:40.237346 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-452250e6-bdd4-477b-9c16-f74fd891cac9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:40.251572 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452250e6-bdd4-477b-9c16-f74fd891cac9 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:40.256374 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc8824-9976-4fee-9f3c-f88a8c1500a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:40.257263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc8824-9976-4fee-9f3c-f88a8c1500a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:40.257582 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc8824-9976-4fee-9f3c-f88a8c1500a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:40.257863 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc8824-9976-4fee-9f3c-f88a8c1500a1 admin admin] PATH_INFO: `/v3/projects/6315bfe35a3541d2931d71bf09a661fb` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:40.259425 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc8824-9976-4fee-9f3c-f88a8c1500a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6315bfe35a3541d2931d71bf09a661fb)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:40.261024 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc8824-9976-4fee-9f3c-f88a8c1500a1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:40.304292 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7456f62-63fb-4642-a412-344e13c684b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:40.305775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7456f62-63fb-4642-a412-344e13c684b3 service cinder] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:40.312190 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-95bc8824-9976-4fee-9f3c-f88a8c1500a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6315bfe35a3541d2931d71bf09a661fb', 'request_id': 'req-95bc8824-9976-4fee-9f3c-f88a8c1500a1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:40.315103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1355/2696] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:49:40.320396 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-95bc8824-9976-4fee-9f3c-f88a8c1500a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6315bfe35a3541d2931d71bf09a661fb', 'request_id': 'req-95bc8824-9976-4fee-9f3c-f88a8c1500a1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:40.328402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-95bc8824-9976-4fee-9f3c-f88a8c1500a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6315bfe35a3541d2931d71bf09a661fb', 'request_id': 'req-95bc8824-9976-4fee-9f3c-f88a8c1500a1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:40.340394 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-95bc8824-9976-4fee-9f3c-f88a8c1500a1 admin admin] The token cache is being invalidate because project 6315bfe35a3541d2931d71bf09a661fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:49:40.340687 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-95bc8824-9976-4fee-9f3c-f88a8c1500a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:40.341328 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-95bc8824-9976-4fee-9f3c-f88a8c1500a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:40.342985 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1342/2697] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:49:40 2022] DELETE /identity/v3/projects/6315bfe35a3541d2931d71bf09a661fb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:40.348615 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec28c51-41d1-4bd4-9634-9ce6f6056e0e None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:40.348908 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec28c51-41d1-4bd4-9634-9ce6f6056e0e None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:40.349344 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec28c51-41d1-4bd4-9634-9ce6f6056e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:40.366675 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-0ec28c51-41d1-4bd4-9634-9ce6f6056e0e None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:40.367873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-0ec28c51-41d1-4bd4-9634-9ce6f6056e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:40.440830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1356/2698] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:40.449980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23acf5-56e9-484d-9904-bc930a80588d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:40.450276 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23acf5-56e9-484d-9904-bc930a80588d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:40.450606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23acf5-56e9-484d-9904-bc930a80588d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:40.469286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ca23acf5-56e9-484d-9904-bc930a80588d None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:40.470519 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ca23acf5-56e9-484d-9904-bc930a80588d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:40.478904 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1343/2699] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:40.483432 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec28c51-41d1-4bd4-9634-9ce6f6056e0e None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:40.493723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec28c51-41d1-4bd4-9634-9ce6f6056e0e None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:40.498323 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f85a8-2004-4e26-a086-9beb0c8cd3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:40.498979 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f85a8-2004-4e26-a086-9beb0c8cd3ea admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:40.499262 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f85a8-2004-4e26-a086-9beb0c8cd3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:40.499543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f85a8-2004-4e26-a086-9beb0c8cd3ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:40.500270 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f85a8-2004-4e26-a086-9beb0c8cd3ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:49:40.500576 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f85a8-2004-4e26-a086-9beb0c8cd3ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:40.502203 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f85a8-2004-4e26-a086-9beb0c8cd3ea admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:40.515896 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1357/2700] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:49:40.520549 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23acf5-56e9-484d-9904-bc930a80588d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:40.525885 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:40.532718 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23acf5-56e9-484d-9904-bc930a80588d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:40.539986 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d3a46-f8ad-49d3-9bca-21c69f723ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:40.540654 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d3a46-f8ad-49d3-9bca-21c69f723ef7 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:40.540979 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d3a46-f8ad-49d3-9bca-21c69f723ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:40.541407 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d3a46-f8ad-49d3-9bca-21c69f723ef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:40.542266 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d3a46-f8ad-49d3-9bca-21c69f723ef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:40.544160 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d3a46-f8ad-49d3-9bca-21c69f723ef7 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:40.572399 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1344/2701] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:49:40 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:40.577027 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f85a8-2004-4e26-a086-9beb0c8cd3ea admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:40.589113 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f85a8-2004-4e26-a086-9beb0c8cd3ea admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:40.651692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404a6c2-14bd-49d5-936c-e68aae0a23bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:40.652509 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404a6c2-14bd-49d5-936c-e68aae0a23bd admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:40.652794 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404a6c2-14bd-49d5-936c-e68aae0a23bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:40.653061 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5404a6c2-14bd-49d5-936c-e68aae0a23bd admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:40.653855 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404a6c2-14bd-49d5-936c-e68aae0a23bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:40.655764 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5404a6c2-14bd-49d5-936c-e68aae0a23bd admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:40.675753 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1358/2702] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:49:40 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:40.680034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d3a46-f8ad-49d3-9bca-21c69f723ef7 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:40.691931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d3a46-f8ad-49d3-9bca-21c69f723ef7 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:40.698384 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afdfdb-3a74-4241-9b62-6fb78bfd090d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:40.699066 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afdfdb-3a74-4241-9b62-6fb78bfd090d admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:40.699350 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afdfdb-3a74-4241-9b62-6fb78bfd090d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:40.699635 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afdfdb-3a74-4241-9b62-6fb78bfd090d admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:40.700359 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afdfdb-3a74-4241-9b62-6fb78bfd090d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:40.702075 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afdfdb-3a74-4241-9b62-6fb78bfd090d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:40.715897 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1345/2703] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:49:40.720062 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404a6c2-14bd-49d5-936c-e68aae0a23bd admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:40.731783 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5404a6c2-14bd-49d5-936c-e68aae0a23bd admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:40.736706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b21ee5-7abc-4d41-9a49-8593ddbe7e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:40.737488 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b21ee5-7abc-4d41-9a49-8593ddbe7e77 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:40.737922 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b21ee5-7abc-4d41-9a49-8593ddbe7e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:40.738337 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b21ee5-7abc-4d41-9a49-8593ddbe7e77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:40.739205 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b21ee5-7abc-4d41-9a49-8593ddbe7e77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:40.741816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b21ee5-7abc-4d41-9a49-8593ddbe7e77 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:40.752324 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1359/2704] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:49:40.757193 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afdfdb-3a74-4241-9b62-6fb78bfd090d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:40.767353 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afdfdb-3a74-4241-9b62-6fb78bfd090d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:40.772591 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97bcb6-4c8e-49aa-b784-b76df10b281e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:40.773510 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97bcb6-4c8e-49aa-b784-b76df10b281e admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:40.773800 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97bcb6-4c8e-49aa-b784-b76df10b281e admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:40.774075 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad97bcb6-4c8e-49aa-b784-b76df10b281e admin admin] PATH_INFO: `/v3/projects/a9af0b38d9fa4db0bfd12c0d1b51b12f/users/f2d3d11f92e3400c9ec8f35677a44198/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:40.789837 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97bcb6-4c8e-49aa-b784-b76df10b281e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9af0b38d9fa4db0bfd12c0d1b51b12f, user_id=f2d3d11f92e3400c9ec8f35677a44198, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:40.792631 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad97bcb6-4c8e-49aa-b784-b76df10b281e admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:40.807048 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1346/2705] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:49:40 2022] PUT /identity/v3/projects/a9af0b38d9fa4db0bfd12c0d1b51b12f/users/f2d3d11f92e3400c9ec8f35677a44198/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:40.815020 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3368d96-de1d-457d-9a5e-8511c10395dd None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:40.815521 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3368d96-de1d-457d-9a5e-8511c10395dd None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:40.817757 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3368d96-de1d-457d-9a5e-8511c10395dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:40.839398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-a3368d96-de1d-457d-9a5e-8511c10395dd None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:40.840686 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-a3368d96-de1d-457d-9a5e-8511c10395dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:40.846335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:40.906353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1360/2706] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:40.916598 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97bcb6-4c8e-49aa-b784-b76df10b281e admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:40.918530 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ad97bcb6-4c8e-49aa-b784-b76df10b281e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:40.993492 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad97bcb6-4c8e-49aa-b784-b76df10b281e admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:40.997278 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42821d7e-b186-4f05-8cef-8de31ae86276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:40.998027 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42821d7e-b186-4f05-8cef-8de31ae86276 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:40.998316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42821d7e-b186-4f05-8cef-8de31ae86276 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:40.998592 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42821d7e-b186-4f05-8cef-8de31ae86276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:41.008542 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42821d7e-b186-4f05-8cef-8de31ae86276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:41.010025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42821d7e-b186-4f05-8cef-8de31ae86276 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:41.020159 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1347/2707] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:49:42.203450 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3368d96-de1d-457d-9a5e-8511c10395dd None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:42.205061 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-a3368d96-de1d-457d-9a5e-8511c10395dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:42.218408 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3368d96-de1d-457d-9a5e-8511c10395dd None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:42.222685 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834a6b6-4e4f-4f54-9bba-88cf4a73da39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:42.223544 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834a6b6-4e4f-4f54-9bba-88cf4a73da39 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:42.224221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834a6b6-4e4f-4f54-9bba-88cf4a73da39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:42.224996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834a6b6-4e4f-4f54-9bba-88cf4a73da39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:42.238663 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b834a6b6-4e4f-4f54-9bba-88cf4a73da39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:42.335059 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834a6b6-4e4f-4f54-9bba-88cf4a73da39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:42.338227 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834a6b6-4e4f-4f54-9bba-88cf4a73da39 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:42.360314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1361/2708] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:49:42.775524 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42821d7e-b186-4f05-8cef-8de31ae86276 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:42.777033 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-42821d7e-b186-4f05-8cef-8de31ae86276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:42.802838 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42821d7e-b186-4f05-8cef-8de31ae86276 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:42.808402 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9248c72-16b9-4ab6-82dc-52dda1bce6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:42.809306 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9248c72-16b9-4ab6-82dc-52dda1bce6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:42.809629 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9248c72-16b9-4ab6-82dc-52dda1bce6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:42.810116 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9248c72-16b9-4ab6-82dc-52dda1bce6ce admin admin] PATH_INFO: `/v3/users/6ce36ec76ca943d899bd80a844b85e03` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:42.811813 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9248c72-16b9-4ab6-82dc-52dda1bce6ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ce36ec76ca943d899bd80a844b85e03)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:42.814148 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9248c72-16b9-4ab6-82dc-52dda1bce6ce admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:42.881263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e9248c72-16b9-4ab6-82dc-52dda1bce6ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ce36ec76ca943d899bd80a844b85e03'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:42.882420 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e9248c72-16b9-4ab6-82dc-52dda1bce6ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ce36ec76ca943d899bd80a844b85e03'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:42.895362 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e9248c72-16b9-4ab6-82dc-52dda1bce6ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ce36ec76ca943d899bd80a844b85e03'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:42.912834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e9248c72-16b9-4ab6-82dc-52dda1bce6ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ce36ec76ca943d899bd80a844b85e03'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:42.931663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e9248c72-16b9-4ab6-82dc-52dda1bce6ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ce36ec76ca943d899bd80a844b85e03'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:42.938148 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1348/2709] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:49:42 2022] DELETE /identity/v3/users/6ce36ec76ca943d899bd80a844b85e03 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:42.943460 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b834c6-545d-42da-9970-261c1ffef09b None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:42.944109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b834c6-545d-42da-9970-261c1ffef09b None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:42.944395 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b834c6-545d-42da-9970-261c1ffef09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:42.975379 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-04b834c6-545d-42da-9970-261c1ffef09b None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:42.976745 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-04b834c6-545d-42da-9970-261c1ffef09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:43.053139 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1362/2710] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:49:43.079769 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9248c72-16b9-4ab6-82dc-52dda1bce6ce admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:43.081324 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e9248c72-16b9-4ab6-82dc-52dda1bce6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:43.123558 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:43.174169 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9248c72-16b9-4ab6-82dc-52dda1bce6ce admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:43.179524 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cea669-07c7-4eec-b489-5e51c42f6042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:43.180258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cea669-07c7-4eec-b489-5e51c42f6042 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:43.180625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cea669-07c7-4eec-b489-5e51c42f6042 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:43.181506 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cea669-07c7-4eec-b489-5e51c42f6042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:43.195240 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cea669-07c7-4eec-b489-5e51c42f6042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:43.196779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cea669-07c7-4eec-b489-5e51c42f6042 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:43.208669 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1349/2711] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:49:44.600796 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b834c6-545d-42da-9970-261c1ffef09b None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:44.607548 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-04b834c6-545d-42da-9970-261c1ffef09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:44.641535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b834c6-545d-42da-9970-261c1ffef09b None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:44.659551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f050a-278a-4a43-8f35-3d16034220d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:44.661688 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f050a-278a-4a43-8f35-3d16034220d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:44.662321 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f050a-278a-4a43-8f35-3d16034220d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:44.662321 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f050a-278a-4a43-8f35-3d16034220d7 admin admin] PATH_INFO: `/v3/projects/8009f789c4ad4b239042770bbd711cd4` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:44.665892 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f050a-278a-4a43-8f35-3d16034220d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8009f789c4ad4b239042770bbd711cd4)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:44.670652 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f050a-278a-4a43-8f35-3d16034220d7 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:44.825416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:44.836803 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2a5f050a-278a-4a43-8f35-3d16034220d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8009f789c4ad4b239042770bbd711cd4', 'request_id': 'req-2a5f050a-278a-4a43-8f35-3d16034220d7'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:44.855255 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2a5f050a-278a-4a43-8f35-3d16034220d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8009f789c4ad4b239042770bbd711cd4', 'request_id': 'req-2a5f050a-278a-4a43-8f35-3d16034220d7'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:44.866746 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2a5f050a-278a-4a43-8f35-3d16034220d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8009f789c4ad4b239042770bbd711cd4', 'request_id': 'req-2a5f050a-278a-4a43-8f35-3d16034220d7'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:44.881652 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2a5f050a-278a-4a43-8f35-3d16034220d7 admin admin] The token cache is being invalidate because project 8009f789c4ad4b239042770bbd711cd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:49:44.882101 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2a5f050a-278a-4a43-8f35-3d16034220d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:44.883421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2a5f050a-278a-4a43-8f35-3d16034220d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:44.885856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1363/2712] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:49:44 2022] DELETE /identity/v3/projects/8009f789c4ad4b239042770bbd711cd4 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:44.891166 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cea669-07c7-4eec-b489-5e51c42f6042 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:44.902678 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cea669-07c7-4eec-b489-5e51c42f6042 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:44.968512 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f050a-278a-4a43-8f35-3d16034220d7 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:44.972024 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-2a5f050a-278a-4a43-8f35-3d16034220d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:45.006998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbce85e-1eae-462b-9fe1-8aeb2b5b7491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:45.007885 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbce85e-1eae-462b-9fe1-8aeb2b5b7491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:45.008173 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbce85e-1eae-462b-9fe1-8aeb2b5b7491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:45.008446 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbce85e-1eae-462b-9fe1-8aeb2b5b7491 admin admin] PATH_INFO: `/v3/users/c6a4a7a099794999bf0e136ff8b96b7b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:45.010167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbce85e-1eae-462b-9fe1-8aeb2b5b7491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6a4a7a099794999bf0e136ff8b96b7b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:45.019635 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbce85e-1eae-462b-9fe1-8aeb2b5b7491 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:45.051807 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f050a-278a-4a43-8f35-3d16034220d7 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:45.058659 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac82ed-8ef3-4edf-8ab8-c4a6810a2cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:45.058857 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac82ed-8ef3-4edf-8ab8-c4a6810a2cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:45.059066 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac82ed-8ef3-4edf-8ab8-c4a6810a2cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:45.059347 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac82ed-8ef3-4edf-8ab8-c4a6810a2cd2 admin admin] PATH_INFO: `/v3/users/36b7d2892928487db79a8f66098d3ef6` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:45.060593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac82ed-8ef3-4edf-8ab8-c4a6810a2cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b7d2892928487db79a8f66098d3ef6)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:45.063242 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dac82ed-8ef3-4edf-8ab8-c4a6810a2cd2 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:45.114958 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2fbce85e-1eae-462b-9fe1-8aeb2b5b7491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6a4a7a099794999bf0e136ff8b96b7b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:45.125856 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2fbce85e-1eae-462b-9fe1-8aeb2b5b7491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6a4a7a099794999bf0e136ff8b96b7b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:45.129812 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-8dac82ed-8ef3-4edf-8ab8-c4a6810a2cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b7d2892928487db79a8f66098d3ef6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:45.131106 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-8dac82ed-8ef3-4edf-8ab8-c4a6810a2cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b7d2892928487db79a8f66098d3ef6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:45.148024 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2fbce85e-1eae-462b-9fe1-8aeb2b5b7491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6a4a7a099794999bf0e136ff8b96b7b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:45.153346 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-8dac82ed-8ef3-4edf-8ab8-c4a6810a2cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b7d2892928487db79a8f66098d3ef6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:45.168722 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2fbce85e-1eae-462b-9fe1-8aeb2b5b7491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6a4a7a099794999bf0e136ff8b96b7b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:45.170902 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-8dac82ed-8ef3-4edf-8ab8-c4a6810a2cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b7d2892928487db79a8f66098d3ef6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:45.231580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2fbce85e-1eae-462b-9fe1-8aeb2b5b7491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6a4a7a099794999bf0e136ff8b96b7b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:45.233182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-8dac82ed-8ef3-4edf-8ab8-c4a6810a2cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b7d2892928487db79a8f66098d3ef6'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:45.248387 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1350/2713] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:49:44 2022] DELETE /identity/v3/users/c6a4a7a099794999bf0e136ff8b96b7b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:45.249951 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1364/2714] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:49:44 2022] DELETE /identity/v3/users/36b7d2892928487db79a8f66098d3ef6 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:45.263783 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1397b-b044-43d3-ae17-fac675302255 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:45.265323 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1397b-b044-43d3-ae17-fac675302255 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:45.265789 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1397b-b044-43d3-ae17-fac675302255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:45.301815 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6ea1397b-b044-43d3-ae17-fac675302255 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:45.305268 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6ea1397b-b044-43d3-ae17-fac675302255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:45.408756 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:45.442852 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1351/2715] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:45.526824 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac82ed-8ef3-4edf-8ab8-c4a6810a2cd2 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:45.528354 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-8dac82ed-8ef3-4edf-8ab8-c4a6810a2cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:45.728554 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac82ed-8ef3-4edf-8ab8-c4a6810a2cd2 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:45.740747 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:45.853679 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04032804-8a93-46e8-b3fd-a722414bd1a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:45.854355 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04032804-8a93-46e8-b3fd-a722414bd1a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:45.855866 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04032804-8a93-46e8-b3fd-a722414bd1a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:45.855866 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04032804-8a93-46e8-b3fd-a722414bd1a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:45.871277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04032804-8a93-46e8-b3fd-a722414bd1a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:45.873283 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04032804-8a93-46e8-b3fd-a722414bd1a4 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:45.896523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1365/2716] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:49:45.919873 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1397b-b044-43d3-ae17-fac675302255 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:45.921287 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6ea1397b-b044-43d3-ae17-fac675302255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:45.942195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1397b-b044-43d3-ae17-fac675302255 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:45.953616 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0857b-047d-40b7-b45a-2ef6f2f42951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:45.955057 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0857b-047d-40b7-b45a-2ef6f2f42951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:45.955934 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0857b-047d-40b7-b45a-2ef6f2f42951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:45.956397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0857b-047d-40b7-b45a-2ef6f2f42951 admin admin] PATH_INFO: `/v3/projects/612db3cbf1f3464e9d95e1301a569471` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:45.958968 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0857b-047d-40b7-b45a-2ef6f2f42951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=612db3cbf1f3464e9d95e1301a569471)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:45.961272 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0857b-047d-40b7-b45a-2ef6f2f42951 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:46.064348 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7fb0857b-047d-40b7-b45a-2ef6f2f42951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '612db3cbf1f3464e9d95e1301a569471', 'request_id': 'req-7fb0857b-047d-40b7-b45a-2ef6f2f42951'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:46.092993 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7fb0857b-047d-40b7-b45a-2ef6f2f42951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '612db3cbf1f3464e9d95e1301a569471', 'request_id': 'req-7fb0857b-047d-40b7-b45a-2ef6f2f42951'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:46.114517 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7fb0857b-047d-40b7-b45a-2ef6f2f42951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '612db3cbf1f3464e9d95e1301a569471', 'request_id': 'req-7fb0857b-047d-40b7-b45a-2ef6f2f42951'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:46.143083 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7fb0857b-047d-40b7-b45a-2ef6f2f42951 admin admin] The token cache is being invalidate because project 612db3cbf1f3464e9d95e1301a569471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:49:46.143412 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7fb0857b-047d-40b7-b45a-2ef6f2f42951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:46.156281 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-7fb0857b-047d-40b7-b45a-2ef6f2f42951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:46.159992 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1352/2717] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:49:45 2022] DELETE /identity/v3/projects/612db3cbf1f3464e9d95e1301a569471 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:46.164458 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04032804-8a93-46e8-b3fd-a722414bd1a4 service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:46.179472 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04032804-8a93-46e8-b3fd-a722414bd1a4 service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:46.307142 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39038a1-e58c-4ba7-89b3-c8bc27d36f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:46.308225 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39038a1-e58c-4ba7-89b3-c8bc27d36f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:46.308634 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39038a1-e58c-4ba7-89b3-c8bc27d36f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:46.309029 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39038a1-e58c-4ba7-89b3-c8bc27d36f1b admin admin] PATH_INFO: `/v3/users/d4cd880e6b0c4f3bbe7cf40bf733982b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:46.310616 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39038a1-e58c-4ba7-89b3-c8bc27d36f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4cd880e6b0c4f3bbe7cf40bf733982b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:46.313344 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39038a1-e58c-4ba7-89b3-c8bc27d36f1b admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:46.332461 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0857b-047d-40b7-b45a-2ef6f2f42951 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:46.334051 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-7fb0857b-047d-40b7-b45a-2ef6f2f42951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:46.364309 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0857b-047d-40b7-b45a-2ef6f2f42951 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:46.383304 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcfbedb-6afd-4162-8c0f-b6978f1d73e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:46.384673 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfbedb-6afd-4162-8c0f-b6978f1d73e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:46.385920 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfbedb-6afd-4162-8c0f-b6978f1d73e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:46.386434 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcfbedb-6afd-4162-8c0f-b6978f1d73e1 admin admin] PATH_INFO: `/v3/projects/2f9a503c7d7242b9ba5bcdc68d5dfb16` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:46.388237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcfbedb-6afd-4162-8c0f-b6978f1d73e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f9a503c7d7242b9ba5bcdc68d5dfb16)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:46.390741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcfbedb-6afd-4162-8c0f-b6978f1d73e1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:46.440353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a39038a1-e58c-4ba7-89b3-c8bc27d36f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4cd880e6b0c4f3bbe7cf40bf733982b'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:46.441190 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a39038a1-e58c-4ba7-89b3-c8bc27d36f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4cd880e6b0c4f3bbe7cf40bf733982b'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:46.468535 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a39038a1-e58c-4ba7-89b3-c8bc27d36f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4cd880e6b0c4f3bbe7cf40bf733982b'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:46.486934 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a39038a1-e58c-4ba7-89b3-c8bc27d36f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4cd880e6b0c4f3bbe7cf40bf733982b'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:46.511483 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a39038a1-e58c-4ba7-89b3-c8bc27d36f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4cd880e6b0c4f3bbe7cf40bf733982b'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:46.528137 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1366/2718] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:49:46 2022] DELETE /identity/v3/users/d4cd880e6b0c4f3bbe7cf40bf733982b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:46.541853 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6dcfbedb-6afd-4162-8c0f-b6978f1d73e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f9a503c7d7242b9ba5bcdc68d5dfb16', 'request_id': 'req-6dcfbedb-6afd-4162-8c0f-b6978f1d73e1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:46.561340 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6dcfbedb-6afd-4162-8c0f-b6978f1d73e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f9a503c7d7242b9ba5bcdc68d5dfb16', 'request_id': 'req-6dcfbedb-6afd-4162-8c0f-b6978f1d73e1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:46.585591 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6dcfbedb-6afd-4162-8c0f-b6978f1d73e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f9a503c7d7242b9ba5bcdc68d5dfb16', 'request_id': 'req-6dcfbedb-6afd-4162-8c0f-b6978f1d73e1'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:46.615657 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6dcfbedb-6afd-4162-8c0f-b6978f1d73e1 admin admin] The token cache is being invalidate because project 2f9a503c7d7242b9ba5bcdc68d5dfb16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:49:46.615872 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6dcfbedb-6afd-4162-8c0f-b6978f1d73e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:46.616562 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-6dcfbedb-6afd-4162-8c0f-b6978f1d73e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:46.622243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1353/2719] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:49:46 2022] DELETE /identity/v3/projects/2f9a503c7d7242b9ba5bcdc68d5dfb16 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:46.623399 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39038a1-e58c-4ba7-89b3-c8bc27d36f1b admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:46.626354 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-a39038a1-e58c-4ba7-89b3-c8bc27d36f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:46.744131 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:46.799525 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39038a1-e58c-4ba7-89b3-c8bc27d36f1b admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:46.814645 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583bd3f-c062-485f-a453-5c93e870fd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:46.814645 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583bd3f-c062-485f-a453-5c93e870fd7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:46.814645 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583bd3f-c062-485f-a453-5c93e870fd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:46.814645 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583bd3f-c062-485f-a453-5c93e870fd7b admin admin] PATH_INFO: `/v3/users/e94f1e530f084d1abdfe39d27e2eb334` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:46.815168 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583bd3f-c062-485f-a453-5c93e870fd7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e94f1e530f084d1abdfe39d27e2eb334)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:46.816114 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583bd3f-c062-485f-a453-5c93e870fd7b admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:46.896185 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c532c94-3d78-48e5-89d9-9f2ac1fde762 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:46.897010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c532c94-3d78-48e5-89d9-9f2ac1fde762 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:46.897573 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c532c94-3d78-48e5-89d9-9f2ac1fde762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:46.905091 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-b583bd3f-c062-485f-a453-5c93e870fd7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e94f1e530f084d1abdfe39d27e2eb334'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:46.905785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-b583bd3f-c062-485f-a453-5c93e870fd7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e94f1e530f084d1abdfe39d27e2eb334'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:46.917005 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-b583bd3f-c062-485f-a453-5c93e870fd7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e94f1e530f084d1abdfe39d27e2eb334'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:46.928600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-b583bd3f-c062-485f-a453-5c93e870fd7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e94f1e530f084d1abdfe39d27e2eb334'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:46.942324 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1c532c94-3d78-48e5-89d9-9f2ac1fde762 None None] MFA Rules not processed for user `f2d3d11f92e3400c9ec8f35677a44198`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:46.942987 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-b583bd3f-c062-485f-a453-5c93e870fd7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e94f1e530f084d1abdfe39d27e2eb334'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:46.946354 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1c532c94-3d78-48e5-89d9-9f2ac1fde762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:46.951271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1367/2720] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:49:46 2022] DELETE /identity/v3/users/e94f1e530f084d1abdfe39d27e2eb334 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:47.005811 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:47.080778 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1354/2721] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:47.082210 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583bd3f-c062-485f-a453-5c93e870fd7b admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:47.083705 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b583bd3f-c062-485f-a453-5c93e870fd7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:47.189288 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583bd3f-c062-485f-a453-5c93e870fd7b admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:47.197230 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fafca1-21c5-4068-ada6-6bf10a77aac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:47.198312 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fafca1-21c5-4068-ada6-6bf10a77aac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:47.198649 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fafca1-21c5-4068-ada6-6bf10a77aac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:47.198952 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fafca1-21c5-4068-ada6-6bf10a77aac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:47.199736 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fafca1-21c5-4068-ada6-6bf10a77aac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:47.202197 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fafca1-21c5-4068-ada6-6bf10a77aac1 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:47.234773 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1368/2722] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:49:47 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:47.239411 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c532c94-3d78-48e5-89d9-9f2ac1fde762 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:47.257245 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c532c94-3d78-48e5-89d9-9f2ac1fde762 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:47.325250 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59955615-dfd1-4da2-9bd5-31311b79881c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:47.326044 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59955615-dfd1-4da2-9bd5-31311b79881c admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:47.326340 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59955615-dfd1-4da2-9bd5-31311b79881c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:47.326625 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59955615-dfd1-4da2-9bd5-31311b79881c admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:47.327329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59955615-dfd1-4da2-9bd5-31311b79881c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:47.329369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59955615-dfd1-4da2-9bd5-31311b79881c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:47.353263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1355/2723] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:49:47 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:47.357399 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fafca1-21c5-4068-ada6-6bf10a77aac1 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:47.369500 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fafca1-21c5-4068-ada6-6bf10a77aac1 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:47.374651 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5be81-8cea-4f79-a0ac-bd3f725dc509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:47.375342 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5be81-8cea-4f79-a0ac-bd3f725dc509 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:47.375632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5be81-8cea-4f79-a0ac-bd3f725dc509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:47.375916 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5be81-8cea-4f79-a0ac-bd3f725dc509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:47.377358 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5be81-8cea-4f79-a0ac-bd3f725dc509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:47.379023 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5be81-8cea-4f79-a0ac-bd3f725dc509 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:47.401180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1369/2724] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:49:47.402427 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59955615-dfd1-4da2-9bd5-31311b79881c admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:47.417089 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59955615-dfd1-4da2-9bd5-31311b79881c admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:47.423683 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1323c-8b17-480e-996d-abd875dfc47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:47.425449 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1323c-8b17-480e-996d-abd875dfc47c admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:47.425876 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1323c-8b17-480e-996d-abd875dfc47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:47.426423 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1323c-8b17-480e-996d-abd875dfc47c admin admin] PATH_INFO: `/v3/projects/250ad71f12a94d9a8d3afba8048014f5/users/744c2f3c6a374b93844b82d60cf45128/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:47.446707 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1323c-8b17-480e-996d-abd875dfc47c admin admin] RBAC: Authorizing `identity:create_grant(project_id=250ad71f12a94d9a8d3afba8048014f5, user_id=744c2f3c6a374b93844b82d60cf45128, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:47.450415 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1323c-8b17-480e-996d-abd875dfc47c admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:47.478616 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1356/2725] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:49:47 2022] PUT /identity/v3/projects/250ad71f12a94d9a8d3afba8048014f5/users/744c2f3c6a374b93844b82d60cf45128/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:47.480194 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5be81-8cea-4f79-a0ac-bd3f725dc509 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:47.500196 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5be81-8cea-4f79-a0ac-bd3f725dc509 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:47.528222 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:47.585019 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1323c-8b17-480e-996d-abd875dfc47c admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:47.588352 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-29f1323c-8b17-480e-996d-abd875dfc47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:47.598305 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e650526-1179-4927-98b2-76c7422ce260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:47.605782 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e650526-1179-4927-98b2-76c7422ce260 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:47.606243 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e650526-1179-4927-98b2-76c7422ce260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:47.606616 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e650526-1179-4927-98b2-76c7422ce260 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:47.607517 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e650526-1179-4927-98b2-76c7422ce260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:47.609273 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e650526-1179-4927-98b2-76c7422ce260 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:47.627839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1370/2726] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:47 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:49:47.628878 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e650526-1179-4927-98b2-76c7422ce260 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:47.643788 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e650526-1179-4927-98b2-76c7422ce260 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:47.646215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1323c-8b17-480e-996d-abd875dfc47c admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:47.653131 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0a801-5168-48a3-8f0c-6427f83d7666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:47.653916 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34aaba-b36f-4ff4-815c-c6beb01b754c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:47.654929 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34aaba-b36f-4ff4-815c-c6beb01b754c admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:47.655160 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34aaba-b36f-4ff4-815c-c6beb01b754c admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:47.655492 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34aaba-b36f-4ff4-815c-c6beb01b754c admin admin] PATH_INFO: `/v3/projects/250ad71f12a94d9a8d3afba8048014f5/users/744c2f3c6a374b93844b82d60cf45128/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:47.658000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34aaba-b36f-4ff4-815c-c6beb01b754c admin admin] RBAC: Authorizing `identity:create_grant(project_id=250ad71f12a94d9a8d3afba8048014f5, user_id=744c2f3c6a374b93844b82d60cf45128, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:47.662330 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0a801-5168-48a3-8f0c-6427f83d7666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:47.662653 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0a801-5168-48a3-8f0c-6427f83d7666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:47.664484 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0a801-5168-48a3-8f0c-6427f83d7666 admin admin] PATH_INFO: `/v3/projects/02515a946d244b77b731e14fa0982b4f` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:47.664620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34aaba-b36f-4ff4-815c-c6beb01b754c admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:47.673628 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0a801-5168-48a3-8f0c-6427f83d7666 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02515a946d244b77b731e14fa0982b4f)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:47.676499 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1371/2727] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:49:47 2022] PUT /identity/v3/projects/250ad71f12a94d9a8d3afba8048014f5/users/744c2f3c6a374b93844b82d60cf45128/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:47.677357 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0a801-5168-48a3-8f0c-6427f83d7666 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:47.848271 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-19b0a801-5168-48a3-8f0c-6427f83d7666 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02515a946d244b77b731e14fa0982b4f', 'request_id': 'req-19b0a801-5168-48a3-8f0c-6427f83d7666'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:47.866895 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-19b0a801-5168-48a3-8f0c-6427f83d7666 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02515a946d244b77b731e14fa0982b4f', 'request_id': 'req-19b0a801-5168-48a3-8f0c-6427f83d7666'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:47.884080 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-19b0a801-5168-48a3-8f0c-6427f83d7666 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02515a946d244b77b731e14fa0982b4f', 'request_id': 'req-19b0a801-5168-48a3-8f0c-6427f83d7666'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:47.926599 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-19b0a801-5168-48a3-8f0c-6427f83d7666 admin admin] The token cache is being invalidate because project 02515a946d244b77b731e14fa0982b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:49:47.927076 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-19b0a801-5168-48a3-8f0c-6427f83d7666 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:47.928421 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-19b0a801-5168-48a3-8f0c-6427f83d7666 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:47.932190 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1357/2728] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:49:47 2022] DELETE /identity/v3/projects/02515a946d244b77b731e14fa0982b4f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:47.938193 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6898f3-9f2e-4b95-af9f-697790511e97 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:47.938740 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6898f3-9f2e-4b95-af9f-697790511e97 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:47.938990 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6898f3-9f2e-4b95-af9f-697790511e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:47.989968 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-fe6898f3-9f2e-4b95-af9f-697790511e97 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:47.991237 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-fe6898f3-9f2e-4b95-af9f-697790511e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:48.141430 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1372/2729] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:48.148860 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1076e-eaa4-42b1-b775-6a80d96e688f None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:48.149467 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1076e-eaa4-42b1-b775-6a80d96e688f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:48.150111 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a1076e-eaa4-42b1-b775-6a80d96e688f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:48.173818 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6898f3-9f2e-4b95-af9f-697790511e97 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:48.175348 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-fe6898f3-9f2e-4b95-af9f-697790511e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:48.199926 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6898f3-9f2e-4b95-af9f-697790511e97 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:48.205576 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b0a1076e-eaa4-42b1-b775-6a80d96e688f None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:48.206851 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b0a1076e-eaa4-42b1-b775-6a80d96e688f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:48.220989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed945bb-12ff-4680-ab3a-8c71b8f77214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:48.221868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed945bb-12ff-4680-ab3a-8c71b8f77214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:48.222210 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed945bb-12ff-4680-ab3a-8c71b8f77214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:48.222494 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed945bb-12ff-4680-ab3a-8c71b8f77214 admin admin] PATH_INFO: `/v3/projects/a533dac529c94ceda3f9c8a097cb6459` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:48.227332 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed945bb-12ff-4680-ab3a-8c71b8f77214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a533dac529c94ceda3f9c8a097cb6459)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:48.229186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed945bb-12ff-4680-ab3a-8c71b8f77214 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:48.237760 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1358/2730] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:48.241600 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1076e-eaa4-42b1-b775-6a80d96e688f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:48.260557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a1076e-eaa4-42b1-b775-6a80d96e688f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:48.274943 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca562d-5ed6-44f3-b203-1c16533cc831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:48.275626 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca562d-5ed6-44f3-b203-1c16533cc831 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:48.276109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca562d-5ed6-44f3-b203-1c16533cc831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:48.276382 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca562d-5ed6-44f3-b203-1c16533cc831 admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:48.277130 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca562d-5ed6-44f3-b203-1c16533cc831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:49:48.277468 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca562d-5ed6-44f3-b203-1c16533cc831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:48.279097 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca562d-5ed6-44f3-b203-1c16533cc831 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:48.319324 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1359/2731] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:49:48.338955 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca562d-5ed6-44f3-b203-1c16533cc831 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:48.355243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca562d-5ed6-44f3-b203-1c16533cc831 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:48.361095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:48.376233 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eed945bb-12ff-4680-ab3a-8c71b8f77214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a533dac529c94ceda3f9c8a097cb6459', 'request_id': 'req-eed945bb-12ff-4680-ab3a-8c71b8f77214'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:48.397936 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eed945bb-12ff-4680-ab3a-8c71b8f77214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a533dac529c94ceda3f9c8a097cb6459', 'request_id': 'req-eed945bb-12ff-4680-ab3a-8c71b8f77214'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:48.416466 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eed945bb-12ff-4680-ab3a-8c71b8f77214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a533dac529c94ceda3f9c8a097cb6459', 'request_id': 'req-eed945bb-12ff-4680-ab3a-8c71b8f77214'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:48.440932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eed945bb-12ff-4680-ab3a-8c71b8f77214 admin admin] The token cache is being invalidate because project a533dac529c94ceda3f9c8a097cb6459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:49:48.441204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eed945bb-12ff-4680-ab3a-8c71b8f77214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:48.447351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-eed945bb-12ff-4680-ab3a-8c71b8f77214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:48.449216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1373/2732] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:49:48 2022] DELETE /identity/v3/projects/a533dac529c94ceda3f9c8a097cb6459 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:49:48.494953 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184edf22-62e7-454d-aab8-ddc1fe59992d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:48.496075 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184edf22-62e7-454d-aab8-ddc1fe59992d admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:48.496866 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184edf22-62e7-454d-aab8-ddc1fe59992d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:48.497639 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184edf22-62e7-454d-aab8-ddc1fe59992d admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:48.498618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184edf22-62e7-454d-aab8-ddc1fe59992d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:48.507374 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184edf22-62e7-454d-aab8-ddc1fe59992d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:48.603789 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed945bb-12ff-4680-ab3a-8c71b8f77214 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:48.604277 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1360/2733] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:49:48 2022] POST /identity/v3/projects => generated 367 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:48.606192 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-eed945bb-12ff-4680-ab3a-8c71b8f77214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:48.631570 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed945bb-12ff-4680-ab3a-8c71b8f77214 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:48.720329 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:48.817011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f43ef-d281-47b0-8bc4-1b2634227bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:48.818374 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f43ef-d281-47b0-8bc4-1b2634227bbe admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:48.818667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f43ef-d281-47b0-8bc4-1b2634227bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:48.838862 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f43ef-d281-47b0-8bc4-1b2634227bbe admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:48.841795 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f43ef-d281-47b0-8bc4-1b2634227bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:48.844226 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82f43ef-d281-47b0-8bc4-1b2634227bbe admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:48.914721 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1374/2734] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:49:48 2022] POST /identity/v3/users => generated 284 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:48.919909 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184edf22-62e7-454d-aab8-ddc1fe59992d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:48.937600 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184edf22-62e7-454d-aab8-ddc1fe59992d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:48.952075 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1ab7a-a5b3-4566-8755-3ba6ff0a2462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:48.952977 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1ab7a-a5b3-4566-8755-3ba6ff0a2462 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:48.953330 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1ab7a-a5b3-4566-8755-3ba6ff0a2462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:48.953734 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1ab7a-a5b3-4566-8755-3ba6ff0a2462 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:48.954969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1ab7a-a5b3-4566-8755-3ba6ff0a2462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:48.968224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1ab7a-a5b3-4566-8755-3ba6ff0a2462 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:48.993290 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1361/2735] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:49:48.997398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f43ef-d281-47b0-8bc4-1b2634227bbe admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:49.026658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82f43ef-d281-47b0-8bc4-1b2634227bbe admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:49.040848 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339cba0-b123-4e21-87ad-1ca5eb9715d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:49.042222 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339cba0-b123-4e21-87ad-1ca5eb9715d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:49.042733 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339cba0-b123-4e21-87ad-1ca5eb9715d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:49.043197 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339cba0-b123-4e21-87ad-1ca5eb9715d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:49.044186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339cba0-b123-4e21-87ad-1ca5eb9715d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:49.047601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339cba0-b123-4e21-87ad-1ca5eb9715d3 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:49.070038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1375/2736] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:49:49.070597 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1ab7a-a5b3-4566-8755-3ba6ff0a2462 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:49.085220 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1ab7a-a5b3-4566-8755-3ba6ff0a2462 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:49.090900 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2040a-5676-43ff-8324-06226c3119cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:49.096719 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2040a-5676-43ff-8324-06226c3119cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:49.097034 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2040a-5676-43ff-8324-06226c3119cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:49.097294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2040a-5676-43ff-8324-06226c3119cf admin admin] PATH_INFO: `/v3/projects/58d160871aa949439bad37a5c0b7bd39/users/a256f29c0b2f4c00b6e0480cf1aa4f17/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:49.116380 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2040a-5676-43ff-8324-06226c3119cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d160871aa949439bad37a5c0b7bd39, user_id=a256f29c0b2f4c00b6e0480cf1aa4f17, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:49.119331 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2040a-5676-43ff-8324-06226c3119cf admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:49.134150 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1362/2737] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:49:49 2022] PUT /identity/v3/projects/58d160871aa949439bad37a5c0b7bd39/users/a256f29c0b2f4c00b6e0480cf1aa4f17/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:49.145680 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ac897-e8d0-48f3-99f0-78398f48d4ae None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:49.146038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ac897-e8d0-48f3-99f0-78398f48d4ae None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:49.146264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ac897-e8d0-48f3-99f0-78398f48d4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:49.174271 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-cf1ac897-e8d0-48f3-99f0-78398f48d4ae None None] MFA Rules not processed for user `a256f29c0b2f4c00b6e0480cf1aa4f17`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:49.175496 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-cf1ac897-e8d0-48f3-99f0-78398f48d4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:49.244799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1376/2738] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:49.249094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2040a-5676-43ff-8324-06226c3119cf admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:49.345544 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2040a-5676-43ff-8324-06226c3119cf admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:49.352980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54031d-cdb5-4ec2-b984-980d6a05fa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:49.353943 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54031d-cdb5-4ec2-b984-980d6a05fa58 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:49.354316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54031d-cdb5-4ec2-b984-980d6a05fa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:49.357529 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b54031d-cdb5-4ec2-b984-980d6a05fa58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:49.358363 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54031d-cdb5-4ec2-b984-980d6a05fa58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:49.360497 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b54031d-cdb5-4ec2-b984-980d6a05fa58 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:49.398203 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1363/2739] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:49:49 2022] POST /identity/v3/projects => generated 367 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:49:49.399696 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ac897-e8d0-48f3-99f0-78398f48d4ae None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:49.420143 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ac897-e8d0-48f3-99f0-78398f48d4ae None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:49.527712 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060edd4-d2cf-47ab-9ac5-23738fe0fd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:49.528350 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060edd4-d2cf-47ab-9ac5-23738fe0fd2d admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:49.528651 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060edd4-d2cf-47ab-9ac5-23738fe0fd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:49.528989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7060edd4-d2cf-47ab-9ac5-23738fe0fd2d admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:49.529730 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060edd4-d2cf-47ab-9ac5-23738fe0fd2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:49.532452 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7060edd4-d2cf-47ab-9ac5-23738fe0fd2d admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:49.575683 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1377/2740] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:49:49 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:49.581345 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54031d-cdb5-4ec2-b984-980d6a05fa58 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:49.601302 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b54031d-cdb5-4ec2-b984-980d6a05fa58 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:49.607511 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca651f02-f89f-4e98-9cc9-bddc4b3d674f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:49.608183 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca651f02-f89f-4e98-9cc9-bddc4b3d674f admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:49.608464 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca651f02-f89f-4e98-9cc9-bddc4b3d674f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:49.608861 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca651f02-f89f-4e98-9cc9-bddc4b3d674f admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:49.609558 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca651f02-f89f-4e98-9cc9-bddc4b3d674f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:49.611160 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca651f02-f89f-4e98-9cc9-bddc4b3d674f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:49.623917 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1364/2741] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:49:49.629214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060edd4-d2cf-47ab-9ac5-23738fe0fd2d admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:49.643718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7060edd4-d2cf-47ab-9ac5-23738fe0fd2d admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:49.651986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdbca0-bb21-47c0-8cda-d2e9e52b7806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:49.651986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdbca0-bb21-47c0-8cda-d2e9e52b7806 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:49.651986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdbca0-bb21-47c0-8cda-d2e9e52b7806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:49.651986 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdbca0-bb21-47c0-8cda-d2e9e52b7806 admin admin] PATH_INFO: `/v3/projects/ebd212e8224641bd9cdb90d951dd10dc/users/fd5a05a2e3a042739f944c9250a42228/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:49.675570 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdbca0-bb21-47c0-8cda-d2e9e52b7806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd212e8224641bd9cdb90d951dd10dc, user_id=fd5a05a2e3a042739f944c9250a42228, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:49.679813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdbca0-bb21-47c0-8cda-d2e9e52b7806 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:49.701004 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1378/2742] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:49:49 2022] PUT /identity/v3/projects/ebd212e8224641bd9cdb90d951dd10dc/users/fd5a05a2e3a042739f944c9250a42228/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:49.706154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca651f02-f89f-4e98-9cc9-bddc4b3d674f admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:49.722906 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca651f02-f89f-4e98-9cc9-bddc4b3d674f admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:49.781643 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:49.828060 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff8cb5-86de-4406-b2c4-42cbb13ef484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:49.829110 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff8cb5-86de-4406-b2c4-42cbb13ef484 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:49.830076 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff8cb5-86de-4406-b2c4-42cbb13ef484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:49.830430 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff8cb5-86de-4406-b2c4-42cbb13ef484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:49.831833 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff8cb5-86de-4406-b2c4-42cbb13ef484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:49.835470 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff8cb5-86de-4406-b2c4-42cbb13ef484 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:49.849609 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1365/2743] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:49:49.851729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdbca0-bb21-47c0-8cda-d2e9e52b7806 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:49.862457 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:49.870679 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdbca0-bb21-47c0-8cda-d2e9e52b7806 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:49.882531 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1242f-8119-4d6c-b254-5158031ca973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:49.884011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1242f-8119-4d6c-b254-5158031ca973 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:49.884528 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1242f-8119-4d6c-b254-5158031ca973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:49.885040 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1242f-8119-4d6c-b254-5158031ca973 admin admin] PATH_INFO: `/v3/projects/ebd212e8224641bd9cdb90d951dd10dc/users/fd5a05a2e3a042739f944c9250a42228/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:49.889021 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1242f-8119-4d6c-b254-5158031ca973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd212e8224641bd9cdb90d951dd10dc, user_id=fd5a05a2e3a042739f944c9250a42228, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:49.892797 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1242f-8119-4d6c-b254-5158031ca973 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:49.923478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1379/2744] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:49:49 2022] PUT /identity/v3/projects/ebd212e8224641bd9cdb90d951dd10dc/users/fd5a05a2e3a042739f944c9250a42228/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:49.937369 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a2e0c-97cc-4182-829f-0de2abef8068 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:49.937780 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a2e0c-97cc-4182-829f-0de2abef8068 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:49.938187 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a2e0c-97cc-4182-829f-0de2abef8068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:49.986490 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-586a2e0c-97cc-4182-829f-0de2abef8068 None None] MFA Rules not processed for user `fd5a05a2e3a042739f944c9250a42228`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:49.988582 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-586a2e0c-97cc-4182-829f-0de2abef8068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:50.018102 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1242f-8119-4d6c-b254-5158031ca973 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:50.020197 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-42a1242f-8119-4d6c-b254-5158031ca973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:50.149504 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1366/2745] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:49 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:50.163823 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a2e0c-97cc-4182-829f-0de2abef8068 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:50.166345 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-586a2e0c-97cc-4182-829f-0de2abef8068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:50.202208 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1242f-8119-4d6c-b254-5158031ca973 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:50.232776 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fe94d-242a-4d0f-b641-ba85f9694983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:50.234731 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fe94d-242a-4d0f-b641-ba85f9694983 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:50.235025 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fe94d-242a-4d0f-b641-ba85f9694983 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:50.235306 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fe94d-242a-4d0f-b641-ba85f9694983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:50.240582 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-354fe94d-242a-4d0f-b641-ba85f9694983 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:50.320696 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a2e0c-97cc-4182-829f-0de2abef8068 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:50.340574 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701e5ee-8f5e-449a-a24f-a0e3224d83f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:50.342933 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701e5ee-8f5e-449a-a24f-a0e3224d83f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:50.343869 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701e5ee-8f5e-449a-a24f-a0e3224d83f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:50.343869 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701e5ee-8f5e-449a-a24f-a0e3224d83f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:50.368186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701e5ee-8f5e-449a-a24f-a0e3224d83f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:50.369831 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1701e5ee-8f5e-449a-a24f-a0e3224d83f9 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:50.388282 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1367/2746] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:49:50.401927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fe94d-242a-4d0f-b641-ba85f9694983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:50.403989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fe94d-242a-4d0f-b641-ba85f9694983 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:50.427809 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1380/2747] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:49:50.531812 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701e5ee-8f5e-449a-a24f-a0e3224d83f9 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:50.552884 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701e5ee-8f5e-449a-a24f-a0e3224d83f9 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:50.557172 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff854d3-d68a-485b-aed4-778bf9b6ca1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:50.557907 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff854d3-d68a-485b-aed4-778bf9b6ca1c service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:50.558198 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff854d3-d68a-485b-aed4-778bf9b6ca1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:50.558516 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff854d3-d68a-485b-aed4-778bf9b6ca1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:50.687741 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:50.695958 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff854d3-d68a-485b-aed4-778bf9b6ca1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:50.698539 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff854d3-d68a-485b-aed4-778bf9b6ca1c service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:50.712460 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1368/2748] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:49:55.311150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e16945-2250-46f4-813a-ec9c5f0f2dc4 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:55.311723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e16945-2250-46f4-813a-ec9c5f0f2dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:55.311723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e16945-2250-46f4-813a-ec9c5f0f2dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:55.392419 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-a9e16945-2250-46f4-813a-ec9c5f0f2dc4 None None] MFA Rules not processed for user `744c2f3c6a374b93844b82d60cf45128`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:55.395265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-a9e16945-2250-46f4-813a-ec9c5f0f2dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:55.550816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1381/2749] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:49:55.560064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff854d3-d68a-485b-aed4-778bf9b6ca1c service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:55.562720 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-eff854d3-d68a-485b-aed4-778bf9b6ca1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:55.652115 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff854d3-d68a-485b-aed4-778bf9b6ca1c service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:55.661346 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e6116-06f8-4e31-96a8-93289c12bdd0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa134b748854fb3b4de54b04390eec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:55.662791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e6116-06f8-4e31-96a8-93289c12bdd0 service glance] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:55.663176 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e6116-06f8-4e31-96a8-93289c12bdd0 service glance] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:55.663552 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e6116-06f8-4e31-96a8-93289c12bdd0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:55.665756 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-692e6116-06f8-4e31-96a8-93289c12bdd0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:55.751286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e6116-06f8-4e31-96a8-93289c12bdd0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:55.752939 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e6116-06f8-4e31-96a8-93289c12bdd0 service glance] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:55.775898 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1369/2750] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:49:55.944944 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e875f-912b-4af2-96ef-7414a3234c02 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:55.945235 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e875f-912b-4af2-96ef-7414a3234c02 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:55.945560 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e875f-912b-4af2-96ef-7414a3234c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:55.971891 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-bb0e875f-912b-4af2-96ef-7414a3234c02 None None] MFA Rules not processed for user `d16be8774cb842199cfb9e3b9965bd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:55.973209 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-bb0e875f-912b-4af2-96ef-7414a3234c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:56.012401 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:56.059607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1382/2751] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jun 14 19:49:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:56.134395 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e6116-06f8-4e31-96a8-93289c12bdd0 service glance] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:56.136039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-692e6116-06f8-4e31-96a8-93289c12bdd0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:56.265770 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e6116-06f8-4e31-96a8-93289c12bdd0 service glance] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:56.272196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0a3ba-e7dd-48a7-8f53-c377db67bd85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fff5414195f4873bcc8752c914b6b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:56.272874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0a3ba-e7dd-48a7-8f53-c377db67bd85 service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:56.273154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0a3ba-e7dd-48a7-8f53-c377db67bd85 service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:56.273473 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0a3ba-e7dd-48a7-8f53-c377db67bd85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:56.284125 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0a3ba-e7dd-48a7-8f53-c377db67bd85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:56.284924 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0a3ba-e7dd-48a7-8f53-c377db67bd85 service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:56.296109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1370/2752] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jun 14 19:49:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 19:49:56.843962 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e875f-912b-4af2-96ef-7414a3234c02 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:56.872573 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e875f-912b-4af2-96ef-7414a3234c02 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:56.880000 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0e243-0bbb-475b-aaf8-3371a0544fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:56.881358 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0e243-0bbb-475b-aaf8-3371a0544fb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:56.881692 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0e243-0bbb-475b-aaf8-3371a0544fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:56.882142 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0e243-0bbb-475b-aaf8-3371a0544fb0 admin admin] PATH_INFO: `/v3/users/a256f29c0b2f4c00b6e0480cf1aa4f17` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:56.885645 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0e243-0bbb-475b-aaf8-3371a0544fb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a256f29c0b2f4c00b6e0480cf1aa4f17)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:56.891086 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0e243-0bbb-475b-aaf8-3371a0544fb0 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:57.012358 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-bcd0e243-0bbb-475b-aaf8-3371a0544fb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a256f29c0b2f4c00b6e0480cf1aa4f17'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:57.013394 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-bcd0e243-0bbb-475b-aaf8-3371a0544fb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a256f29c0b2f4c00b6e0480cf1aa4f17'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:57.031856 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-bcd0e243-0bbb-475b-aaf8-3371a0544fb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a256f29c0b2f4c00b6e0480cf1aa4f17'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:57.055575 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-bcd0e243-0bbb-475b-aaf8-3371a0544fb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a256f29c0b2f4c00b6e0480cf1aa4f17'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:57.110268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-bcd0e243-0bbb-475b-aaf8-3371a0544fb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a256f29c0b2f4c00b6e0480cf1aa4f17'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:57.123797 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1383/2753] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:49:56 2022] DELETE /identity/v3/users/a256f29c0b2f4c00b6e0480cf1aa4f17 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:57.128142 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c77b6e-1c92-4c7c-8839-e96ef7b4e050 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:57.128669 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c77b6e-1c92-4c7c-8839-e96ef7b4e050 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:57.128803 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c77b6e-1c92-4c7c-8839-e96ef7b4e050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:57.166343 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-72c77b6e-1c92-4c7c-8839-e96ef7b4e050 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:57.167576 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-72c77b6e-1c92-4c7c-8839-e96ef7b4e050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:57.211507 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:57.250665 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1371/2754] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:57.258188 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0e243-0bbb-475b-aaf8-3371a0544fb0 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:57.259719 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-bcd0e243-0bbb-475b-aaf8-3371a0544fb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:57.366187 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0e243-0bbb-475b-aaf8-3371a0544fb0 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:57.382181 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80d6e2-aa7d-4b62-9f08-0528a629e147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:57.383316 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80d6e2-aa7d-4b62-9f08-0528a629e147 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:57.383765 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80d6e2-aa7d-4b62-9f08-0528a629e147 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:57.384757 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80d6e2-aa7d-4b62-9f08-0528a629e147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:57.402036 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80d6e2-aa7d-4b62-9f08-0528a629e147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:57.403715 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80d6e2-aa7d-4b62-9f08-0528a629e147 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:57.415690 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1384/2755] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:49:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:49:57.920212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c77b6e-1c92-4c7c-8839-e96ef7b4e050 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:57.921765 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-72c77b6e-1c92-4c7c-8839-e96ef7b4e050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:57.935710 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c77b6e-1c92-4c7c-8839-e96ef7b4e050 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:57.942053 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c642f-e144-4343-8d99-b1a6a1f46aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:57.942947 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c642f-e144-4343-8d99-b1a6a1f46aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:57.943230 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c642f-e144-4343-8d99-b1a6a1f46aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:57.943508 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c642f-e144-4343-8d99-b1a6a1f46aa6 admin admin] PATH_INFO: `/v3/projects/58d160871aa949439bad37a5c0b7bd39` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:57.945065 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c642f-e144-4343-8d99-b1a6a1f46aa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58d160871aa949439bad37a5c0b7bd39)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:57.947043 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c642f-e144-4343-8d99-b1a6a1f46aa6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:58.010722 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-424c642f-e144-4343-8d99-b1a6a1f46aa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58d160871aa949439bad37a5c0b7bd39', 'request_id': 'req-424c642f-e144-4343-8d99-b1a6a1f46aa6'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:58.023424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-424c642f-e144-4343-8d99-b1a6a1f46aa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58d160871aa949439bad37a5c0b7bd39', 'request_id': 'req-424c642f-e144-4343-8d99-b1a6a1f46aa6'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:58.034679 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-424c642f-e144-4343-8d99-b1a6a1f46aa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58d160871aa949439bad37a5c0b7bd39', 'request_id': 'req-424c642f-e144-4343-8d99-b1a6a1f46aa6'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:58.047793 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-424c642f-e144-4343-8d99-b1a6a1f46aa6 admin admin] The token cache is being invalidate because project 58d160871aa949439bad37a5c0b7bd39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:49:58.048127 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-424c642f-e144-4343-8d99-b1a6a1f46aa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:58.048783 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-424c642f-e144-4343-8d99-b1a6a1f46aa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:58.054100 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1372/2756] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:49:57 2022] DELETE /identity/v3/projects/58d160871aa949439bad37a5c0b7bd39 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:58.055660 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80d6e2-aa7d-4b62-9f08-0528a629e147 service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:58.066317 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80d6e2-aa7d-4b62-9f08-0528a629e147 service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:58.130117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:58.161711 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0bd02-c497-4775-8df3-6267c8fe2007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:58.163087 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0bd02-c497-4775-8df3-6267c8fe2007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:58.163551 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0bd02-c497-4775-8df3-6267c8fe2007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:58.164064 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0bd02-c497-4775-8df3-6267c8fe2007 admin admin] PATH_INFO: `/v3/users/fd5a05a2e3a042739f944c9250a42228` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:58.165489 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0bd02-c497-4775-8df3-6267c8fe2007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd5a05a2e3a042739f944c9250a42228)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:58.167485 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0bd02-c497-4775-8df3-6267c8fe2007 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:58.313419 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-39b0bd02-c497-4775-8df3-6267c8fe2007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd5a05a2e3a042739f944c9250a42228'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:58.313419 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-39b0bd02-c497-4775-8df3-6267c8fe2007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd5a05a2e3a042739f944c9250a42228'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:58.332409 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-39b0bd02-c497-4775-8df3-6267c8fe2007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd5a05a2e3a042739f944c9250a42228'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:58.344457 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-39b0bd02-c497-4775-8df3-6267c8fe2007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd5a05a2e3a042739f944c9250a42228'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:58.363747 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-39b0bd02-c497-4775-8df3-6267c8fe2007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd5a05a2e3a042739f944c9250a42228'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:58.375027 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1385/2757] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:49:58 2022] DELETE /identity/v3/users/fd5a05a2e3a042739f944c9250a42228 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:58.998260 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c642f-e144-4343-8d99-b1a6a1f46aa6 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:59.000321 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-424c642f-e144-4343-8d99-b1a6a1f46aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:59.024091 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c642f-e144-4343-8d99-b1a6a1f46aa6 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:59.156911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfefcc2-8362-4601-987c-5749dd8231d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:59.158094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfefcc2-8362-4601-987c-5749dd8231d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:59.158531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfefcc2-8362-4601-987c-5749dd8231d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:59.158956 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfefcc2-8362-4601-987c-5749dd8231d5 admin admin] PATH_INFO: `/v3/projects/ebd212e8224641bd9cdb90d951dd10dc` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:59.164857 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfefcc2-8362-4601-987c-5749dd8231d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebd212e8224641bd9cdb90d951dd10dc)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:59.167390 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfefcc2-8362-4601-987c-5749dd8231d5 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:59.255821 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dcfefcc2-8362-4601-987c-5749dd8231d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd212e8224641bd9cdb90d951dd10dc', 'request_id': 'req-dcfefcc2-8362-4601-987c-5749dd8231d5'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:59.268684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dcfefcc2-8362-4601-987c-5749dd8231d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd212e8224641bd9cdb90d951dd10dc', 'request_id': 'req-dcfefcc2-8362-4601-987c-5749dd8231d5'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:59.280931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:59.293633 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dcfefcc2-8362-4601-987c-5749dd8231d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd212e8224641bd9cdb90d951dd10dc', 'request_id': 'req-dcfefcc2-8362-4601-987c-5749dd8231d5'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:59.331135 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dcfefcc2-8362-4601-987c-5749dd8231d5 admin admin] The token cache is being invalidate because project ebd212e8224641bd9cdb90d951dd10dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:49:59.331893 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dcfefcc2-8362-4601-987c-5749dd8231d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:59.333157 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-dcfefcc2-8362-4601-987c-5749dd8231d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:49:59.336286 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1373/2758] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:49:58 2022] DELETE /identity/v3/projects/ebd212e8224641bd9cdb90d951dd10dc => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:49:59.340427 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a915b-a91e-458d-bda2-1043aca6ce5e None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:59.340905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a915b-a91e-458d-bda2-1043aca6ce5e None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:59.340991 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a915b-a91e-458d-bda2-1043aca6ce5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:59.377213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-b55a915b-a91e-458d-bda2-1043aca6ce5e None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:59.378712 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b55a915b-a91e-458d-bda2-1043aca6ce5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:59.486193 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1386/2759] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:59.493648 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f569c-bea1-42e9-937f-fd9f767ef5c4 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:59.494003 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f569c-bea1-42e9-937f-fd9f767ef5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:59.494373 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f569c-bea1-42e9-937f-fd9f767ef5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:59.513998 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-821f569c-bea1-42e9-937f-fd9f767ef5c4 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:49:59.515389 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-821f569c-bea1-42e9-937f-fd9f767ef5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:49:59.530015 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1374/2760] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:49:59.531530 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a915b-a91e-458d-bda2-1043aca6ce5e None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:59.543788 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a915b-a91e-458d-bda2-1043aca6ce5e None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:59.549343 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce7faa-6a96-4a5e-9e6c-c8d18f149223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:59.550303 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce7faa-6a96-4a5e-9e6c-c8d18f149223 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:59.550889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce7faa-6a96-4a5e-9e6c-c8d18f149223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:59.551839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce7faa-6a96-4a5e-9e6c-c8d18f149223 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:59.552734 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce7faa-6a96-4a5e-9e6c-c8d18f149223 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:49:59.553207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce7faa-6a96-4a5e-9e6c-c8d18f149223 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:59.555085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce7faa-6a96-4a5e-9e6c-c8d18f149223 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:59.601840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1387/2761] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:49:59.606077 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f569c-bea1-42e9-937f-fd9f767ef5c4 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:59.620390 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f569c-bea1-42e9-937f-fd9f767ef5c4 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:59.640497 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd31752-e05f-4d0b-ad47-5b1e73f55547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:59.641186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd31752-e05f-4d0b-ad47-5b1e73f55547 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:59.641508 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd31752-e05f-4d0b-ad47-5b1e73f55547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:59.641797 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd31752-e05f-4d0b-ad47-5b1e73f55547 admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:59.642588 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd31752-e05f-4d0b-ad47-5b1e73f55547 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:59.646786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd31752-e05f-4d0b-ad47-5b1e73f55547 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:59.715158 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1375/2762] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:49:59 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:49:59.720691 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce7faa-6a96-4a5e-9e6c-c8d18f149223 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:59.739637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce7faa-6a96-4a5e-9e6c-c8d18f149223 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:59.829092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:49:59.854078 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23e5b3-b8ea-4293-ba8b-cf5668270c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:59.856421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23e5b3-b8ea-4293-ba8b-cf5668270c16 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:59.856922 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23e5b3-b8ea-4293-ba8b-cf5668270c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:59.858338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23e5b3-b8ea-4293-ba8b-cf5668270c16 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:59.860041 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23e5b3-b8ea-4293-ba8b-cf5668270c16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:59.863385 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23e5b3-b8ea-4293-ba8b-cf5668270c16 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:59.933838 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1388/2763] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:49:59 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:49:59.935122 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd31752-e05f-4d0b-ad47-5b1e73f55547 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:49:59.957145 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd31752-e05f-4d0b-ad47-5b1e73f55547 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:49:59.966293 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec04e3e-dfbf-43a5-a0ff-ee8b0a309061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:49:59.967761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec04e3e-dfbf-43a5-a0ff-ee8b0a309061 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:49:59.968237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec04e3e-dfbf-43a5-a0ff-ee8b0a309061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:49:59.968667 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec04e3e-dfbf-43a5-a0ff-ee8b0a309061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:49:59.969615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec04e3e-dfbf-43a5-a0ff-ee8b0a309061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:49:59.971397 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec04e3e-dfbf-43a5-a0ff-ee8b0a309061 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:49:59.990785 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23e5b3-b8ea-4293-ba8b-cf5668270c16 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:00.002022 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1376/2764] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:50:00.007749 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23e5b3-b8ea-4293-ba8b-cf5668270c16 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:00.013793 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272390b6-43d7-43f1-8ef7-b8af085d6fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:00.015248 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272390b6-43d7-43f1-8ef7-b8af085d6fdd admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:00.016372 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272390b6-43d7-43f1-8ef7-b8af085d6fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:00.017030 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272390b6-43d7-43f1-8ef7-b8af085d6fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:00.018774 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272390b6-43d7-43f1-8ef7-b8af085d6fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:00.023282 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272390b6-43d7-43f1-8ef7-b8af085d6fdd admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:00.063019 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1389/2765] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:50:00.068339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec04e3e-dfbf-43a5-a0ff-ee8b0a309061 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:00.087057 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec04e3e-dfbf-43a5-a0ff-ee8b0a309061 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:00.097294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357dcf0-0d37-474d-9793-32824399d915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:00.099639 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357dcf0-0d37-474d-9793-32824399d915 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:00.100166 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357dcf0-0d37-474d-9793-32824399d915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:00.101743 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b357dcf0-0d37-474d-9793-32824399d915 admin admin] PATH_INFO: `/v3/projects/8b5dc3684c084d35b74bd3a547282e6d/users/60664b9c8e8c48b486dadaeb2eb52a1b/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:00.131973 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357dcf0-0d37-474d-9793-32824399d915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5dc3684c084d35b74bd3a547282e6d, user_id=60664b9c8e8c48b486dadaeb2eb52a1b, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:00.137008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b357dcf0-0d37-474d-9793-32824399d915 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:00.186480 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1377/2766] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:50:00 2022] PUT /identity/v3/projects/8b5dc3684c084d35b74bd3a547282e6d/users/60664b9c8e8c48b486dadaeb2eb52a1b/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:50:00.204872 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15198fee-e90a-422e-8155-ae14df0dd718 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:00.205214 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15198fee-e90a-422e-8155-ae14df0dd718 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:00.205537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15198fee-e90a-422e-8155-ae14df0dd718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:00.263044 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-15198fee-e90a-422e-8155-ae14df0dd718 None None] MFA Rules not processed for user `60664b9c8e8c48b486dadaeb2eb52a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:00.267415 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-15198fee-e90a-422e-8155-ae14df0dd718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:00.469250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1390/2767] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:50:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:50:00.475317 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357dcf0-0d37-474d-9793-32824399d915 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:00.655146 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b357dcf0-0d37-474d-9793-32824399d915 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:00.688332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d2c76-2cac-4e54-a8c4-f87746932aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:00.689272 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d2c76-2cac-4e54-a8c4-f87746932aaa admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:00.689969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d2c76-2cac-4e54-a8c4-f87746932aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:00.690419 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371d2c76-2cac-4e54-a8c4-f87746932aaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:00.691284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d2c76-2cac-4e54-a8c4-f87746932aaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:00.694972 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371d2c76-2cac-4e54-a8c4-f87746932aaa admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:00.764050 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1378/2768] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:50:00 2022] POST /identity/v3/projects => generated 385 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:50:00.768668 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15198fee-e90a-422e-8155-ae14df0dd718 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:00.788951 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15198fee-e90a-422e-8155-ae14df0dd718 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:00.948469 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed492d16-ea55-48b9-9d92-d6f8ebf37acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:00.949171 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed492d16-ea55-48b9-9d92-d6f8ebf37acd admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:00.949478 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed492d16-ea55-48b9-9d92-d6f8ebf37acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:00.949758 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed492d16-ea55-48b9-9d92-d6f8ebf37acd admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:00.950470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed492d16-ea55-48b9-9d92-d6f8ebf37acd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:00.952424 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed492d16-ea55-48b9-9d92-d6f8ebf37acd admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:00.992542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1391/2769] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:50:00 2022] POST /identity/v3/users => generated 299 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:50:00.996674 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d2c76-2cac-4e54-a8c4-f87746932aaa admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:01.018136 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371d2c76-2cac-4e54-a8c4-f87746932aaa admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:01.032689 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf917d0-12c2-4a50-9d94-a66227912fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:01.044399 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf917d0-12c2-4a50-9d94-a66227912fce admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:01.044887 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf917d0-12c2-4a50-9d94-a66227912fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:01.045356 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf917d0-12c2-4a50-9d94-a66227912fce admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:01.046308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf917d0-12c2-4a50-9d94-a66227912fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:01.049195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf917d0-12c2-4a50-9d94-a66227912fce admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:01.070744 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1379/2770] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:50:01.074722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed492d16-ea55-48b9-9d92-d6f8ebf37acd admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:01.102820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed492d16-ea55-48b9-9d92-d6f8ebf37acd admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:01.111101 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43cc20-fcec-42eb-84a8-5c4ce0456af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:01.112054 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43cc20-fcec-42eb-84a8-5c4ce0456af1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:01.112301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43cc20-fcec-42eb-84a8-5c4ce0456af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:01.112608 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43cc20-fcec-42eb-84a8-5c4ce0456af1 admin admin] PATH_INFO: `/v3/projects/7687cc198143435aaeeb9498b62eb453/users/f4e8fe8a46b842dc936a256a6101c673/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:01.133787 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43cc20-fcec-42eb-84a8-5c4ce0456af1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7687cc198143435aaeeb9498b62eb453, user_id=f4e8fe8a46b842dc936a256a6101c673, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:01.138682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43cc20-fcec-42eb-84a8-5c4ce0456af1 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:01.183716 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1392/2771] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:50:01 2022] PUT /identity/v3/projects/7687cc198143435aaeeb9498b62eb453/users/f4e8fe8a46b842dc936a256a6101c673/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:50:01.187506 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf917d0-12c2-4a50-9d94-a66227912fce admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:01.214889 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf917d0-12c2-4a50-9d94-a66227912fce admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:01.396635 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c4f8c-393c-451d-a7b6-11210e37e122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:01.397341 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c4f8c-393c-451d-a7b6-11210e37e122 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:01.397683 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c4f8c-393c-451d-a7b6-11210e37e122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:01.398561 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c4f8c-393c-451d-a7b6-11210e37e122 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:01.398746 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c4f8c-393c-451d-a7b6-11210e37e122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:01.400374 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c4f8c-393c-451d-a7b6-11210e37e122 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:01.403189 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:01.427056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1380/2772] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:50:01.428588 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43cc20-fcec-42eb-84a8-5c4ce0456af1 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:01.439912 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43cc20-fcec-42eb-84a8-5c4ce0456af1 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:01.451331 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823605dd-3f64-4201-b3c1-f5dde1b9356c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:01.454696 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823605dd-3f64-4201-b3c1-f5dde1b9356c admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:01.455207 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823605dd-3f64-4201-b3c1-f5dde1b9356c admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:01.455638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823605dd-3f64-4201-b3c1-f5dde1b9356c admin admin] PATH_INFO: `/v3/projects/7687cc198143435aaeeb9498b62eb453/users/f4e8fe8a46b842dc936a256a6101c673/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:01.458947 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823605dd-3f64-4201-b3c1-f5dde1b9356c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7687cc198143435aaeeb9498b62eb453, user_id=f4e8fe8a46b842dc936a256a6101c673, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:01.464948 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823605dd-3f64-4201-b3c1-f5dde1b9356c admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:01.496022 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1393/2773] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:50:01 2022] PUT /identity/v3/projects/7687cc198143435aaeeb9498b62eb453/users/f4e8fe8a46b842dc936a256a6101c673/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:50:01.511052 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ac564-8453-439a-934a-1bcce84682ec None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:01.511658 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ac564-8453-439a-934a-1bcce84682ec None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:01.512042 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ac564-8453-439a-934a-1bcce84682ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:01.580848 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ba1ac564-8453-439a-934a-1bcce84682ec None None] MFA Rules not processed for user `f4e8fe8a46b842dc936a256a6101c673`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:01.583396 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ba1ac564-8453-439a-934a-1bcce84682ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:01.750287 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1381/2774] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:50:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:50:01.752578 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823605dd-3f64-4201-b3c1-f5dde1b9356c admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:01.755802 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-823605dd-3f64-4201-b3c1-f5dde1b9356c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:01.762653 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ac564-8453-439a-934a-1bcce84682ec None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:01.766415 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ba1ac564-8453-439a-934a-1bcce84682ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:01.784435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:01.879964 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ac564-8453-439a-934a-1bcce84682ec None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:01.884195 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31d161-e777-45a4-8ea7-26bfa201c2d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:01.885074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31d161-e777-45a4-8ea7-26bfa201c2d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:01.885550 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31d161-e777-45a4-8ea7-26bfa201c2d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:01.885989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31d161-e777-45a4-8ea7-26bfa201c2d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:01.896367 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823605dd-3f64-4201-b3c1-f5dde1b9356c admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:01.900963 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31d161-e777-45a4-8ea7-26bfa201c2d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:01.901831 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398d083-10c6-46ab-b374-326ced0a4033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:01.902581 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31d161-e777-45a4-8ea7-26bfa201c2d0 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:01.902700 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398d083-10c6-46ab-b374-326ced0a4033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:01.903325 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398d083-10c6-46ab-b374-326ced0a4033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:01.903660 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398d083-10c6-46ab-b374-326ced0a4033 admin admin] PATH_INFO: `/v3/users/7a5fb1cff46d4e3e8e23f9a788cec9ed` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:01.905577 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398d083-10c6-46ab-b374-326ced0a4033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a5fb1cff46d4e3e8e23f9a788cec9ed)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:01.907783 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398d083-10c6-46ab-b374-326ced0a4033 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:01.915355 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1382/2775] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:50:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:50:02.029919 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2398d083-10c6-46ab-b374-326ced0a4033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a5fb1cff46d4e3e8e23f9a788cec9ed'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:02.029919 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2398d083-10c6-46ab-b374-326ced0a4033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a5fb1cff46d4e3e8e23f9a788cec9ed'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:02.042315 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2398d083-10c6-46ab-b374-326ced0a4033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a5fb1cff46d4e3e8e23f9a788cec9ed'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:02.060607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2398d083-10c6-46ab-b374-326ced0a4033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a5fb1cff46d4e3e8e23f9a788cec9ed'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:02.099352 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2398d083-10c6-46ab-b374-326ced0a4033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a5fb1cff46d4e3e8e23f9a788cec9ed'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:02.115825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1394/2776] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:50:01 2022] DELETE /identity/v3/users/7a5fb1cff46d4e3e8e23f9a788cec9ed => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:50:02.486294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31d161-e777-45a4-8ea7-26bfa201c2d0 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:02.505157 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31d161-e777-45a4-8ea7-26bfa201c2d0 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:02.677161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ffd51-f293-4e22-be4e-d07446ab7c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:02.678441 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ffd51-f293-4e22-be4e-d07446ab7c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:02.678963 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ffd51-f293-4e22-be4e-d07446ab7c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:02.679478 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ffd51-f293-4e22-be4e-d07446ab7c80 admin admin] PATH_INFO: `/v3/projects/780be61f7cb0429fbd97488f41a6b644` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:02.681994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ffd51-f293-4e22-be4e-d07446ab7c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=780be61f7cb0429fbd97488f41a6b644)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:02.684291 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ffd51-f293-4e22-be4e-d07446ab7c80 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:02.770366 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:02.808186 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9b9ffd51-f293-4e22-be4e-d07446ab7c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '780be61f7cb0429fbd97488f41a6b644', 'request_id': 'req-9b9ffd51-f293-4e22-be4e-d07446ab7c80'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:02.822483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9b9ffd51-f293-4e22-be4e-d07446ab7c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '780be61f7cb0429fbd97488f41a6b644', 'request_id': 'req-9b9ffd51-f293-4e22-be4e-d07446ab7c80'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:02.838663 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9b9ffd51-f293-4e22-be4e-d07446ab7c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '780be61f7cb0429fbd97488f41a6b644', 'request_id': 'req-9b9ffd51-f293-4e22-be4e-d07446ab7c80'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:02.841543 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398d083-10c6-46ab-b374-326ced0a4033 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:02.842957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-2398d083-10c6-46ab-b374-326ced0a4033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:02.858670 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9b9ffd51-f293-4e22-be4e-d07446ab7c80 admin admin] The token cache is being invalidate because project 780be61f7cb0429fbd97488f41a6b644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:50:02.859054 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9b9ffd51-f293-4e22-be4e-d07446ab7c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:02.859774 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-9b9ffd51-f293-4e22-be4e-d07446ab7c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:02.860702 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398d083-10c6-46ab-b374-326ced0a4033 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:02.861733 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1383/2777] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:50:02 2022] DELETE /identity/v3/projects/780be61f7cb0429fbd97488f41a6b644 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:50:02.865726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ffd51-f293-4e22-be4e-d07446ab7c80 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:02.867445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9b9ffd51-f293-4e22-be4e-d07446ab7c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:02.941290 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0d08a-fe0c-480c-9e89-9f4efacaabc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:02.942811 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0d08a-fe0c-480c-9e89-9f4efacaabc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:02.943164 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0d08a-fe0c-480c-9e89-9f4efacaabc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:02.943507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0d08a-fe0c-480c-9e89-9f4efacaabc9 admin admin] PATH_INFO: `/v3/users/60664b9c8e8c48b486dadaeb2eb52a1b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:02.944784 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0d08a-fe0c-480c-9e89-9f4efacaabc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60664b9c8e8c48b486dadaeb2eb52a1b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:02.945135 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ffd51-f293-4e22-be4e-d07446ab7c80 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:02.947239 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0d08a-fe0c-480c-9e89-9f4efacaabc9 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:02.950481 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4a4c7-5ed2-40b7-8c50-3946e60e5568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:02.951655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4a4c7-5ed2-40b7-8c50-3946e60e5568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:02.951912 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4a4c7-5ed2-40b7-8c50-3946e60e5568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:02.952405 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4a4c7-5ed2-40b7-8c50-3946e60e5568 admin admin] PATH_INFO: `/v3/users/94effda373784e2d90eadd72cad14155` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:02.953731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4a4c7-5ed2-40b7-8c50-3946e60e5568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94effda373784e2d90eadd72cad14155)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:02.955826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4a4c7-5ed2-40b7-8c50-3946e60e5568 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:02.996067 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:03.015412 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ebd0d08a-fe0c-480c-9e89-9f4efacaabc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60664b9c8e8c48b486dadaeb2eb52a1b'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:03.016300 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ebd0d08a-fe0c-480c-9e89-9f4efacaabc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60664b9c8e8c48b486dadaeb2eb52a1b'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:03.026384 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-35e4a4c7-5ed2-40b7-8c50-3946e60e5568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94effda373784e2d90eadd72cad14155'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:03.027670 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-35e4a4c7-5ed2-40b7-8c50-3946e60e5568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94effda373784e2d90eadd72cad14155'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:03.030073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ebd0d08a-fe0c-480c-9e89-9f4efacaabc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60664b9c8e8c48b486dadaeb2eb52a1b'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:03.051864 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ebd0d08a-fe0c-480c-9e89-9f4efacaabc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60664b9c8e8c48b486dadaeb2eb52a1b'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:03.055726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-35e4a4c7-5ed2-40b7-8c50-3946e60e5568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94effda373784e2d90eadd72cad14155'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:03.071903 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-35e4a4c7-5ed2-40b7-8c50-3946e60e5568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94effda373784e2d90eadd72cad14155'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:03.086057 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-ebd0d08a-fe0c-480c-9e89-9f4efacaabc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60664b9c8e8c48b486dadaeb2eb52a1b'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:03.094564 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1395/2778] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:50:02 2022] DELETE /identity/v3/users/60664b9c8e8c48b486dadaeb2eb52a1b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:50:03.094757 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-35e4a4c7-5ed2-40b7-8c50-3946e60e5568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94effda373784e2d90eadd72cad14155'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:03.099915 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30856cf-763e-4518-83ba-539f8d6b73fb None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:03.100322 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30856cf-763e-4518-83ba-539f8d6b73fb None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:03.100839 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30856cf-763e-4518-83ba-539f8d6b73fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:03.105206 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1384/2779] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:50:02 2022] DELETE /identity/v3/users/94effda373784e2d90eadd72cad14155 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:50:03.133748 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-e30856cf-763e-4518-83ba-539f8d6b73fb None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:03.135162 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e30856cf-763e-4518-83ba-539f8d6b73fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:03.246997 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1396/2780] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:50:03.257416 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4a4c7-5ed2-40b7-8c50-3946e60e5568 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:03.259048 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-35e4a4c7-5ed2-40b7-8c50-3946e60e5568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:03.316023 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:03.354023 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4a4c7-5ed2-40b7-8c50-3946e60e5568 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:03.358718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30856cf-763e-4518-83ba-539f8d6b73fb None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:03.362910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e30856cf-763e-4518-83ba-539f8d6b73fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:03.364710 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf94a1-9bb2-4092-9726-15a0294ecef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:03.366799 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf94a1-9bb2-4092-9726-15a0294ecef0 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:03.367087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf94a1-9bb2-4092-9726-15a0294ecef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:03.367941 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf94a1-9bb2-4092-9726-15a0294ecef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:03.384177 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30856cf-763e-4518-83ba-539f8d6b73fb None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:03.387939 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf94a1-9bb2-4092-9726-15a0294ecef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:03.403404 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed70853-4648-48ad-b18f-ff14bbe4adc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:03.404524 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed70853-4648-48ad-b18f-ff14bbe4adc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:03.404731 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf94a1-9bb2-4092-9726-15a0294ecef0 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:03.405012 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed70853-4648-48ad-b18f-ff14bbe4adc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:03.405433 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed70853-4648-48ad-b18f-ff14bbe4adc3 admin admin] PATH_INFO: `/v3/projects/b551dd9a7f3d4b26bc3651e197591b72` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:03.407123 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed70853-4648-48ad-b18f-ff14bbe4adc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b551dd9a7f3d4b26bc3651e197591b72)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:03.409150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed70853-4648-48ad-b18f-ff14bbe4adc3 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:03.421620 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1385/2781] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:50:03.497764 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-fed70853-4648-48ad-b18f-ff14bbe4adc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b551dd9a7f3d4b26bc3651e197591b72', 'request_id': 'req-fed70853-4648-48ad-b18f-ff14bbe4adc3'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:03.506156 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-fed70853-4648-48ad-b18f-ff14bbe4adc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b551dd9a7f3d4b26bc3651e197591b72', 'request_id': 'req-fed70853-4648-48ad-b18f-ff14bbe4adc3'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:03.515711 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-fed70853-4648-48ad-b18f-ff14bbe4adc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b551dd9a7f3d4b26bc3651e197591b72', 'request_id': 'req-fed70853-4648-48ad-b18f-ff14bbe4adc3'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:03.543586 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-fed70853-4648-48ad-b18f-ff14bbe4adc3 admin admin] The token cache is being invalidate because project b551dd9a7f3d4b26bc3651e197591b72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:50:03.544632 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-fed70853-4648-48ad-b18f-ff14bbe4adc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:03.546848 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-fed70853-4648-48ad-b18f-ff14bbe4adc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:03.549027 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1397/2782] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:50:03 2022] DELETE /identity/v3/projects/b551dd9a7f3d4b26bc3651e197591b72 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:50:03.555655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66f83b-b8cf-44ba-8fe3-545dc32eb1fc None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:03.556196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66f83b-b8cf-44ba-8fe3-545dc32eb1fc None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:03.556662 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66f83b-b8cf-44ba-8fe3-545dc32eb1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:03.599203 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9d66f83b-b8cf-44ba-8fe3-545dc32eb1fc None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:03.600726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9d66f83b-b8cf-44ba-8fe3-545dc32eb1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:03.797457 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1386/2783] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:50:03.805814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5df9e-8d95-4931-b8ea-0959663db2e8 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:03.806117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5df9e-8d95-4931-b8ea-0959663db2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:03.806385 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5df9e-8d95-4931-b8ea-0959663db2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:03.837575 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-16b5df9e-8d95-4931-b8ea-0959663db2e8 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:03.839955 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-16b5df9e-8d95-4931-b8ea-0959663db2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:03.855477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1398/2784] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:50:03.858607 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66f83b-b8cf-44ba-8fe3-545dc32eb1fc None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:03.869602 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66f83b-b8cf-44ba-8fe3-545dc32eb1fc None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:03.874424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cff6c8-e9b2-4a3d-afcf-c39499e96daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:03.875237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cff6c8-e9b2-4a3d-afcf-c39499e96daa admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:03.875529 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cff6c8-e9b2-4a3d-afcf-c39499e96daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:03.875810 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cff6c8-e9b2-4a3d-afcf-c39499e96daa admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:03.876698 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cff6c8-e9b2-4a3d-afcf-c39499e96daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:50:03.876831 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cff6c8-e9b2-4a3d-afcf-c39499e96daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:03.878510 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cff6c8-e9b2-4a3d-afcf-c39499e96daa admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:03.894241 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1387/2785] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:50:03.897695 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5df9e-8d95-4931-b8ea-0959663db2e8 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:03.914020 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5df9e-8d95-4931-b8ea-0959663db2e8 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:03.921873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1738a2-4e3a-4920-b790-3d8ba65f8a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:03.923036 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1738a2-4e3a-4920-b790-3d8ba65f8a38 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:03.923657 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1738a2-4e3a-4920-b790-3d8ba65f8a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:03.924164 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1738a2-4e3a-4920-b790-3d8ba65f8a38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:03.938255 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1738a2-4e3a-4920-b790-3d8ba65f8a38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:03.941923 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1738a2-4e3a-4920-b790-3d8ba65f8a38 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:03.962214 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cff6c8-e9b2-4a3d-afcf-c39499e96daa admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:03.964187 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d0cff6c8-e9b2-4a3d-afcf-c39499e96daa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:03.993480 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cff6c8-e9b2-4a3d-afcf-c39499e96daa admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:04.007093 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8d53b-f624-44aa-8714-6ff123b8742d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:04.008503 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8d53b-f624-44aa-8714-6ff123b8742d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:04.008660 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8d53b-f624-44aa-8714-6ff123b8742d admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:04.008920 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8d53b-f624-44aa-8714-6ff123b8742d admin admin] PATH_INFO: `/v3/projects/8b5dc3684c084d35b74bd3a547282e6d` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:04.010280 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8d53b-f624-44aa-8714-6ff123b8742d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5dc3684c084d35b74bd3a547282e6d)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:04.024313 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8d53b-f624-44aa-8714-6ff123b8742d admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:04.033735 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1399/2786] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:50:03 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:50:04.035599 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1738a2-4e3a-4920-b790-3d8ba65f8a38 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:04.058464 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:04.152403 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-27e8d53b-f624-44aa-8714-6ff123b8742d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5dc3684c084d35b74bd3a547282e6d', 'request_id': 'req-27e8d53b-f624-44aa-8714-6ff123b8742d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:04.177483 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-27e8d53b-f624-44aa-8714-6ff123b8742d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5dc3684c084d35b74bd3a547282e6d', 'request_id': 'req-27e8d53b-f624-44aa-8714-6ff123b8742d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:04.184363 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1738a2-4e3a-4920-b790-3d8ba65f8a38 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:04.201128 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-27e8d53b-f624-44aa-8714-6ff123b8742d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5dc3684c084d35b74bd3a547282e6d', 'request_id': 'req-27e8d53b-f624-44aa-8714-6ff123b8742d'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:04.227208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-27e8d53b-f624-44aa-8714-6ff123b8742d admin admin] The token cache is being invalidate because project 8b5dc3684c084d35b74bd3a547282e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:50:04.228010 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-27e8d53b-f624-44aa-8714-6ff123b8742d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:04.228683 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-27e8d53b-f624-44aa-8714-6ff123b8742d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:04.230934 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1388/2787] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:50:03 2022] DELETE /identity/v3/projects/8b5dc3684c084d35b74bd3a547282e6d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:50:04.234206 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8d53b-f624-44aa-8714-6ff123b8742d admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:04.235712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-27e8d53b-f624-44aa-8714-6ff123b8742d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:04.302081 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9ad48-88f7-47b0-b452-28765365546b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:04.302956 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9ad48-88f7-47b0-b452-28765365546b admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:04.303344 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9ad48-88f7-47b0-b452-28765365546b admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:04.303725 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9ad48-88f7-47b0-b452-28765365546b admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:04.304529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9ad48-88f7-47b0-b452-28765365546b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:04.306628 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9ad48-88f7-47b0-b452-28765365546b admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:04.324352 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:04.341231 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1400/2788] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:50:04 2022] POST /identity/v3/users => generated 289 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:50:04.342182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9ad48-88f7-47b0-b452-28765365546b admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:04.344913 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-89d9ad48-88f7-47b0-b452-28765365546b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:04.355243 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8d53b-f624-44aa-8714-6ff123b8742d admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:04.360099 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9ad48-88f7-47b0-b452-28765365546b admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:04.363248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bac59-e29c-4d4f-93f9-b97df81a99b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:04.365080 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91589828-461c-427f-a204-3a982d7ee785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:04.365780 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91589828-461c-427f-a204-3a982d7ee785 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:04.366068 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91589828-461c-427f-a204-3a982d7ee785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:04.366351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91589828-461c-427f-a204-3a982d7ee785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:04.367219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91589828-461c-427f-a204-3a982d7ee785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:04.367579 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bac59-e29c-4d4f-93f9-b97df81a99b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:04.368076 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bac59-e29c-4d4f-93f9-b97df81a99b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:04.368563 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bac59-e29c-4d4f-93f9-b97df81a99b9 admin admin] PATH_INFO: `/v3/users/f4e8fe8a46b842dc936a256a6101c673` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:04.368823 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91589828-461c-427f-a204-3a982d7ee785 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:04.370548 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bac59-e29c-4d4f-93f9-b97df81a99b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4e8fe8a46b842dc936a256a6101c673)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:04.373440 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bac59-e29c-4d4f-93f9-b97df81a99b9 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:04.384147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1401/2789] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:50:04.390369 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91589828-461c-427f-a204-3a982d7ee785 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:04.407941 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91589828-461c-427f-a204-3a982d7ee785 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:04.414571 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc92a9-ae36-4392-acee-af5dcca413ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:04.415330 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc92a9-ae36-4392-acee-af5dcca413ac admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:04.415685 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc92a9-ae36-4392-acee-af5dcca413ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:04.416036 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc92a9-ae36-4392-acee-af5dcca413ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:04.416860 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc92a9-ae36-4392-acee-af5dcca413ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:04.418638 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc92a9-ae36-4392-acee-af5dcca413ac admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:04.430247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1402/2790] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:50:04.434403 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc92a9-ae36-4392-acee-af5dcca413ac admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:04.436994 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8f8bac59-e29c-4d4f-93f9-b97df81a99b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4e8fe8a46b842dc936a256a6101c673'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:04.438008 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8f8bac59-e29c-4d4f-93f9-b97df81a99b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4e8fe8a46b842dc936a256a6101c673'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:04.448715 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc92a9-ae36-4392-acee-af5dcca413ac admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:04.453858 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8f8bac59-e29c-4d4f-93f9-b97df81a99b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4e8fe8a46b842dc936a256a6101c673'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:04.454003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e49f2-79f7-44f2-9d65-1d4a62e9a498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:04.455051 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e49f2-79f7-44f2-9d65-1d4a62e9a498 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:04.455479 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e49f2-79f7-44f2-9d65-1d4a62e9a498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:04.455848 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e49f2-79f7-44f2-9d65-1d4a62e9a498 admin admin] PATH_INFO: `/v3/projects/b0b8f372dfc54511a3f8c77baaa4f39a/users/10f209080b9745d0a13f60ce5e1ca7df/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:04.469316 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8f8bac59-e29c-4d4f-93f9-b97df81a99b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4e8fe8a46b842dc936a256a6101c673'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:04.474331 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e49f2-79f7-44f2-9d65-1d4a62e9a498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0b8f372dfc54511a3f8c77baaa4f39a, user_id=10f209080b9745d0a13f60ce5e1ca7df, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:04.477099 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e49f2-79f7-44f2-9d65-1d4a62e9a498 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:04.493237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-8f8bac59-e29c-4d4f-93f9-b97df81a99b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4e8fe8a46b842dc936a256a6101c673'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:04.497440 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1403/2791] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:50:04 2022] PUT /identity/v3/projects/b0b8f372dfc54511a3f8c77baaa4f39a/users/10f209080b9745d0a13f60ce5e1ca7df/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:50:04.500318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fc086-9f2f-4f5d-a8da-323015ecafe0 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:04.500752 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fc086-9f2f-4f5d-a8da-323015ecafe0 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:04.501109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330fc086-9f2f-4f5d-a8da-323015ecafe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:04.508513 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1389/2792] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:50:04 2022] DELETE /identity/v3/users/f4e8fe8a46b842dc936a256a6101c673 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:50:04.524079 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-330fc086-9f2f-4f5d-a8da-323015ecafe0 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:04.526154 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-330fc086-9f2f-4f5d-a8da-323015ecafe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:04.606518 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:04.624652 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1404/2793] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:50:04.635606 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bac59-e29c-4d4f-93f9-b97df81a99b9 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:04.637697 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8f8bac59-e29c-4d4f-93f9-b97df81a99b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:04.721822 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bac59-e29c-4d4f-93f9-b97df81a99b9 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:04.728349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1f584-e97c-415d-850b-0bbff04c53f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:04.729573 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1f584-e97c-415d-850b-0bbff04c53f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:04.730163 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1f584-e97c-415d-850b-0bbff04c53f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:04.730592 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1f584-e97c-415d-850b-0bbff04c53f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:04.742874 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1f584-e97c-415d-850b-0bbff04c53f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:04.744834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1f584-e97c-415d-850b-0bbff04c53f5 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:04.756775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1390/2794] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:50:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:50:04.960615 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fc086-9f2f-4f5d-a8da-323015ecafe0 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:04.963649 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-330fc086-9f2f-4f5d-a8da-323015ecafe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:04.986921 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330fc086-9f2f-4f5d-a8da-323015ecafe0 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:04.993706 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42543733-812c-469e-8821-0c34a8276d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:05.002810 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42543733-812c-469e-8821-0c34a8276d3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:05.003111 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42543733-812c-469e-8821-0c34a8276d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:05.003402 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42543733-812c-469e-8821-0c34a8276d3b admin admin] PATH_INFO: `/v3/projects/7687cc198143435aaeeb9498b62eb453` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:05.005851 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42543733-812c-469e-8821-0c34a8276d3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7687cc198143435aaeeb9498b62eb453)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:05.008388 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42543733-812c-469e-8821-0c34a8276d3b admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:05.097128 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-42543733-812c-469e-8821-0c34a8276d3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7687cc198143435aaeeb9498b62eb453', 'request_id': 'req-42543733-812c-469e-8821-0c34a8276d3b'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:05.110073 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-42543733-812c-469e-8821-0c34a8276d3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7687cc198143435aaeeb9498b62eb453', 'request_id': 'req-42543733-812c-469e-8821-0c34a8276d3b'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:05.123442 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-42543733-812c-469e-8821-0c34a8276d3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7687cc198143435aaeeb9498b62eb453', 'request_id': 'req-42543733-812c-469e-8821-0c34a8276d3b'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:05.138805 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-42543733-812c-469e-8821-0c34a8276d3b admin admin] The token cache is being invalidate because project 7687cc198143435aaeeb9498b62eb453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:50:05.139261 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-42543733-812c-469e-8821-0c34a8276d3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:05.140052 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-42543733-812c-469e-8821-0c34a8276d3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:05.142286 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1405/2795] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:50:04 2022] DELETE /identity/v3/projects/7687cc198143435aaeeb9498b62eb453 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:50:05.148357 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1c6db-9c58-4f83-9ecf-3f65c5df0467 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:05.148765 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1c6db-9c58-4f83-9ecf-3f65c5df0467 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:05.149074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1c6db-9c58-4f83-9ecf-3f65c5df0467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:05.173762 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-62a1c6db-9c58-4f83-9ecf-3f65c5df0467 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:05.175030 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-62a1c6db-9c58-4f83-9ecf-3f65c5df0467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:05.268376 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1391/2796] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:50:05.277026 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a32b8f-59b5-4297-96ad-82b23c2f1e03 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:05.277650 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a32b8f-59b5-4297-96ad-82b23c2f1e03 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:05.278082 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a32b8f-59b5-4297-96ad-82b23c2f1e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:05.310987 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-85a32b8f-59b5-4297-96ad-82b23c2f1e03 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:05.317248 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-85a32b8f-59b5-4297-96ad-82b23c2f1e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:05.340649 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1406/2797] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:50:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:50:05.344806 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1c6db-9c58-4f83-9ecf-3f65c5df0467 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:05.373254 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a1c6db-9c58-4f83-9ecf-3f65c5df0467 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:05.383378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdedd6c-70cb-472d-9f32-39fd554696da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:05.384863 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdedd6c-70cb-472d-9f32-39fd554696da admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:05.385310 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdedd6c-70cb-472d-9f32-39fd554696da admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:05.387154 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdedd6c-70cb-472d-9f32-39fd554696da admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:05.392409 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdedd6c-70cb-472d-9f32-39fd554696da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:50:05.396669 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdedd6c-70cb-472d-9f32-39fd554696da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:05.404044 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdedd6c-70cb-472d-9f32-39fd554696da admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:05.416661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:05.429987 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1392/2798] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:50:05.430770 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a32b8f-59b5-4297-96ad-82b23c2f1e03 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:05.454917 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdedd6c-70cb-472d-9f32-39fd554696da admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:05.458506 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a32b8f-59b5-4297-96ad-82b23c2f1e03 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:05.461792 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6cdedd6c-70cb-472d-9f32-39fd554696da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:05.468989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d4f33-fc96-45b6-8dd3-3f7e9150f2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:05.470285 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d4f33-fc96-45b6-8dd3-3f7e9150f2fc admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:05.470580 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d4f33-fc96-45b6-8dd3-3f7e9150f2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:05.471011 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d4f33-fc96-45b6-8dd3-3f7e9150f2fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:05.471825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d4f33-fc96-45b6-8dd3-3f7e9150f2fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:05.474241 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d4f33-fc96-45b6-8dd3-3f7e9150f2fc admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:05.553021 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1407/2799] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:50:05 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:50:05.554043 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d4f33-fc96-45b6-8dd3-3f7e9150f2fc admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:05.596220 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdedd6c-70cb-472d-9f32-39fd554696da admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:05.655228 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d4f33-fc96-45b6-8dd3-3f7e9150f2fc admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:05.662596 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ee86c-fb40-4bc3-b847-34f97ea884e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:05.663357 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ee86c-fb40-4bc3-b847-34f97ea884e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:05.663656 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ee86c-fb40-4bc3-b847-34f97ea884e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:05.664253 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ee86c-fb40-4bc3-b847-34f97ea884e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:05.665526 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ee86c-fb40-4bc3-b847-34f97ea884e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:05.667251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929ee86c-fb40-4bc3-b847-34f97ea884e7 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:05.714809 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ca460-761d-4a6f-a1b0-632d6ab2cdfb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98915513674460485413c2dbee87fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:05.722270 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ca460-761d-4a6f-a1b0-632d6ab2cdfb service placement] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:05.723638 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ca460-761d-4a6f-a1b0-632d6ab2cdfb service placement] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:05.724087 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ca460-761d-4a6f-a1b0-632d6ab2cdfb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:05.729695 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1408/2800] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:50:05 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:50:05.731451 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b22ca460-761d-4a6f-a1b0-632d6ab2cdfb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:05.734344 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ee86c-fb40-4bc3-b847-34f97ea884e7 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:05.748602 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ee86c-fb40-4bc3-b847-34f97ea884e7 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:05.755090 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09341630-bc61-4aeb-a23a-a9f6151352b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:05.755936 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09341630-bc61-4aeb-a23a-a9f6151352b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:05.757434 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09341630-bc61-4aeb-a23a-a9f6151352b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:05.757434 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09341630-bc61-4aeb-a23a-a9f6151352b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:05.758717 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09341630-bc61-4aeb-a23a-a9f6151352b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:05.759769 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09341630-bc61-4aeb-a23a-a9f6151352b1 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:05.761474 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ca460-761d-4a6f-a1b0-632d6ab2cdfb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:05.763597 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ca460-761d-4a6f-a1b0-632d6ab2cdfb service placement] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:05.774822 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1409/2801] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:50:05.781299 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09341630-bc61-4aeb-a23a-a9f6151352b1 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:05.782364 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1393/2802] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:50:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:50:05.831541 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09341630-bc61-4aeb-a23a-a9f6151352b1 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:05.839389 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f9ccf-c373-48c0-b707-5b899dbb3936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:05.840779 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f9ccf-c373-48c0-b707-5b899dbb3936 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:05.840914 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f9ccf-c373-48c0-b707-5b899dbb3936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:05.841181 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f9ccf-c373-48c0-b707-5b899dbb3936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:05.842034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f9ccf-c373-48c0-b707-5b899dbb3936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:05.844054 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f9ccf-c373-48c0-b707-5b899dbb3936 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:05.869485 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1410/2803] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:50:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:50:05.871184 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ca460-761d-4a6f-a1b0-632d6ab2cdfb service placement] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:05.887886 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ca460-761d-4a6f-a1b0-632d6ab2cdfb service placement] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:05.894321 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52d204-4be2-4c30-8ad1-30e6849cbcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:05.896161 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52d204-4be2-4c30-8ad1-30e6849cbcf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:05.896761 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52d204-4be2-4c30-8ad1-30e6849cbcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:05.897315 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52d204-4be2-4c30-8ad1-30e6849cbcf9 admin admin] PATH_INFO: `/v3/projects/ec2cde8006e949c190d6be6a0c894de4/users/bc641ccda7f44a009800434f07d96854/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:05.919762 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52d204-4be2-4c30-8ad1-30e6849cbcf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec2cde8006e949c190d6be6a0c894de4, user_id=bc641ccda7f44a009800434f07d96854, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:05.923263 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52d204-4be2-4c30-8ad1-30e6849cbcf9 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:05.966224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1394/2804] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:50:05 2022] PUT /identity/v3/projects/ec2cde8006e949c190d6be6a0c894de4/users/bc641ccda7f44a009800434f07d96854/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:50:05.979216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728dba4-4186-4cc0-8f96-12f0c9b2ae75 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:05.979759 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728dba4-4186-4cc0-8f96-12f0c9b2ae75 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:05.979759 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728dba4-4186-4cc0-8f96-12f0c9b2ae75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:06.015866 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-2728dba4-4186-4cc0-8f96-12f0c9b2ae75 None None] MFA Rules not processed for user `bc641ccda7f44a009800434f07d96854`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:06.017484 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-2728dba4-4186-4cc0-8f96-12f0c9b2ae75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:06.034652 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:06.156688 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1411/2805] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:50:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:50:06.157715 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52d204-4be2-4c30-8ad1-30e6849cbcf9 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:06.160720 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0b52d204-4be2-4c30-8ad1-30e6849cbcf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:06.233680 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52d204-4be2-4c30-8ad1-30e6849cbcf9 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:06.238058 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bbf056-4a80-4cd8-965e-2e93980596c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:06.239242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbf056-4a80-4cd8-965e-2e93980596c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:06.239513 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbf056-4a80-4cd8-965e-2e93980596c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:06.240426 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bbf056-4a80-4cd8-965e-2e93980596c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:06.266773 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bbf056-4a80-4cd8-965e-2e93980596c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:06.269802 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bbf056-4a80-4cd8-965e-2e93980596c1 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:06.301469 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1395/2806] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:50:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:50:10.753896 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8cce8-e58d-411c-a3e6-6c32a22f1fd7 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:10.754435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8cce8-e58d-411c-a3e6-6c32a22f1fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:10.754537 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8cce8-e58d-411c-a3e6-6c32a22f1fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:10.794470 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-86d8cce8-e58d-411c-a3e6-6c32a22f1fd7 None None] MFA Rules not processed for user `10f209080b9745d0a13f60ce5e1ca7df`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:10.795817 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-86d8cce8-e58d-411c-a3e6-6c32a22f1fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:10.909562 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1412/2807] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:50:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:50:10.911630 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bbf056-4a80-4cd8-965e-2e93980596c1 service cinder] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:10.913135 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-06bbf056-4a80-4cd8-965e-2e93980596c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:10.926208 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:10.995628 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bbf056-4a80-4cd8-965e-2e93980596c1 service cinder] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:11.000242 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f2463-c67e-43f4-b577-3ab1447aeade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:11.001326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f2463-c67e-43f4-b577-3ab1447aeade admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:11.001809 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f2463-c67e-43f4-b577-3ab1447aeade admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:11.002095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f2463-c67e-43f4-b577-3ab1447aeade admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:11.002922 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f2463-c67e-43f4-b577-3ab1447aeade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:11.005550 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f2463-c67e-43f4-b577-3ab1447aeade admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:11.046332 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1396/2808] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:50:10 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:50:11.047957 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8cce8-e58d-411c-a3e6-6c32a22f1fd7 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:11.064010 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8cce8-e58d-411c-a3e6-6c32a22f1fd7 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:11.145421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f841a-4cd0-4b7d-9796-565854e90063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:11.146156 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f841a-4cd0-4b7d-9796-565854e90063 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:11.146414 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f841a-4cd0-4b7d-9796-565854e90063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:11.146697 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f841a-4cd0-4b7d-9796-565854e90063 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:11.147422 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f841a-4cd0-4b7d-9796-565854e90063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:11.149587 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f841a-4cd0-4b7d-9796-565854e90063 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:11.180812 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1413/2809] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:50:11 2022] POST /identity/v3/users => generated 296 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:50:11.193515 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f2463-c67e-43f4-b577-3ab1447aeade admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:11.205044 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f2463-c67e-43f4-b577-3ab1447aeade admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:11.215344 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781575f-d505-4eec-ab80-587fd3951f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:11.216119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781575f-d505-4eec-ab80-587fd3951f81 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:11.216536 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781575f-d505-4eec-ab80-587fd3951f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:11.216853 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781575f-d505-4eec-ab80-587fd3951f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:11.217727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781575f-d505-4eec-ab80-587fd3951f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:11.219634 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781575f-d505-4eec-ab80-587fd3951f81 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:11.243420 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1397/2810] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:50:11.247968 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f841a-4cd0-4b7d-9796-565854e90063 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:11.259889 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f841a-4cd0-4b7d-9796-565854e90063 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:11.265318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4e255-5cd0-4042-ba23-e490eb55057a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:11.266476 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4e255-5cd0-4042-ba23-e490eb55057a admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:11.268251 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4e255-5cd0-4042-ba23-e490eb55057a admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:11.268984 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4e255-5cd0-4042-ba23-e490eb55057a admin admin] PATH_INFO: `/v3/projects/da8d971bf3d14d33807025d13fc90e12/users/8dd474c209054a32bcdedaa0b30bdb98/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:11.289232 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4e255-5cd0-4042-ba23-e490eb55057a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da8d971bf3d14d33807025d13fc90e12, user_id=8dd474c209054a32bcdedaa0b30bdb98, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:11.292705 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c4e255-5cd0-4042-ba23-e490eb55057a admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:11.303393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bfbd2-2dd9-4335-b000-a8c5afe5c57b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:11.303832 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bfbd2-2dd9-4335-b000-a8c5afe5c57b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:11.304056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bfbd2-2dd9-4335-b000-a8c5afe5c57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:11.319828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1414/2811] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:50:11 2022] PUT /identity/v3/projects/da8d971bf3d14d33807025d13fc90e12/users/8dd474c209054a32bcdedaa0b30bdb98/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:50:11.324247 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4e255-5cd0-4042-ba23-e490eb55057a admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:11.329133 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-bb2bfbd2-2dd9-4335-b000-a8c5afe5c57b None None] MFA Rules not processed for user `f2d3d11f92e3400c9ec8f35677a44198`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:11.330374 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bb2bfbd2-2dd9-4335-b000-a8c5afe5c57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:11.330662 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:11.406717 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1398/2812] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:50:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:50:11.411841 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4e255-5cd0-4042-ba23-e490eb55057a admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:11.418003 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8e0d9-c5c3-41ad-a780-29a806fe8444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:11.418655 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8e0d9-c5c3-41ad-a780-29a806fe8444 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:11.418909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8e0d9-c5c3-41ad-a780-29a806fe8444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:11.419194 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8e0d9-c5c3-41ad-a780-29a806fe8444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:11.419937 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8e0d9-c5c3-41ad-a780-29a806fe8444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:11.421596 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8e0d9-c5c3-41ad-a780-29a806fe8444 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:11.433495 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1415/2813] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:50:11.437459 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bfbd2-2dd9-4335-b000-a8c5afe5c57b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:11.451427 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bfbd2-2dd9-4335-b000-a8c5afe5c57b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:11.457878 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3b93d-afd3-47d7-81ba-6e1728637647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:11.458700 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3b93d-afd3-47d7-81ba-6e1728637647 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:11.458928 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3b93d-afd3-47d7-81ba-6e1728637647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:11.459235 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3b93d-afd3-47d7-81ba-6e1728637647 admin admin] PATH_INFO: `/v3/projects/da8d971bf3d14d33807025d13fc90e12/users/8dd474c209054a32bcdedaa0b30bdb98/roles/1e2bb0d759694428ada2b52285de933b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:11.461669 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3b93d-afd3-47d7-81ba-6e1728637647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da8d971bf3d14d33807025d13fc90e12, user_id=8dd474c209054a32bcdedaa0b30bdb98, role_id=1e2bb0d759694428ada2b52285de933b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:11.464540 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3b93d-afd3-47d7-81ba-6e1728637647 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:11.476883 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1399/2814] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:50:11 2022] PUT /identity/v3/projects/da8d971bf3d14d33807025d13fc90e12/users/8dd474c209054a32bcdedaa0b30bdb98/roles/1e2bb0d759694428ada2b52285de933b => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:50:15.703651 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabe13e-9842-4c3c-8727-419e04fe300b None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:15.704150 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabe13e-9842-4c3c-8727-419e04fe300b None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:15.704314 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabe13e-9842-4c3c-8727-419e04fe300b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:15.749018 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-6eabe13e-9842-4c3c-8727-419e04fe300b None None] MFA Rules not processed for user `d16be8774cb842199cfb9e3b9965bd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:15.758774 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-6eabe13e-9842-4c3c-8727-419e04fe300b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:15.947499 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1416/2815] 10.222.0.44 () {58 vars in 1009 bytes} [Tue Jun 14 19:50:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:50:15.962122 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3b93d-afd3-47d7-81ba-6e1728637647 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:15.964004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8dc3b93d-afd3-47d7-81ba-6e1728637647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:16.115039 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3b93d-afd3-47d7-81ba-6e1728637647 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:16.135975 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bfb3c-31ef-4ce4-b4af-f5130f5cfa90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fff5414195f4873bcc8752c914b6b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:16.137064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bfb3c-31ef-4ce4-b4af-f5130f5cfa90 service swift] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:16.137694 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bfb3c-31ef-4ce4-b4af-f5130f5cfa90 service swift] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:16.138079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bfb3c-31ef-4ce4-b4af-f5130f5cfa90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:16.157781 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2bfb3c-31ef-4ce4-b4af-f5130f5cfa90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:16.161526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2bfb3c-31ef-4ce4-b4af-f5130f5cfa90 service swift] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:16.184047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1400/2816] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jun 14 19:50:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 19:50:17.653879 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8830d-9fff-4753-9ab3-9eea0e2cec49 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:17.654956 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8830d-9fff-4753-9ab3-9eea0e2cec49 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:17.655996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe8830d-9fff-4753-9ab3-9eea0e2cec49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:17.708625 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-5fe8830d-9fff-4753-9ab3-9eea0e2cec49 None None] MFA Rules not processed for user `8dd474c209054a32bcdedaa0b30bdb98`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:17.710604 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-5fe8830d-9fff-4753-9ab3-9eea0e2cec49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:17.909514 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1417/2817] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:50:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:50:17.920531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bfb3c-31ef-4ce4-b4af-f5130f5cfa90 service swift] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:17.922069 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1e2bfb3c-31ef-4ce4-b4af-f5130f5cfa90 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:17.935355 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:18.122727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bfb3c-31ef-4ce4-b4af-f5130f5cfa90 service swift] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:18.138851 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23b28e-dde6-44da-a554-3e8a93cb3d72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:18.139793 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23b28e-dde6-44da-a554-3e8a93cb3d72 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:18.140138 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23b28e-dde6-44da-a554-3e8a93cb3d72 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:18.140446 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23b28e-dde6-44da-a554-3e8a93cb3d72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:18.320993 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23b28e-dde6-44da-a554-3e8a93cb3d72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:18.327840 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23b28e-dde6-44da-a554-3e8a93cb3d72 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:18.364081 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1401/2818] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:50:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:50:20.339811 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8830d-9fff-4753-9ab3-9eea0e2cec49 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:20.342729 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-5fe8830d-9fff-4753-9ab3-9eea0e2cec49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:20.425873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=100 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:20.483182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe8830d-9fff-4753-9ab3-9eea0e2cec49 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:20.491112 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120eb66-8be9-4835-8d4c-27e4d5a1e583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:20.495783 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120eb66-8be9-4835-8d4c-27e4d5a1e583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:20.496085 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120eb66-8be9-4835-8d4c-27e4d5a1e583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:20.496370 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120eb66-8be9-4835-8d4c-27e4d5a1e583 admin admin] PATH_INFO: `/v3/users/2900dfb691734898a5fd1ac12207cebf` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:20.497825 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120eb66-8be9-4835-8d4c-27e4d5a1e583 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2900dfb691734898a5fd1ac12207cebf)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:20.502937 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120eb66-8be9-4835-8d4c-27e4d5a1e583 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:20.607087 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-d120eb66-8be9-4835-8d4c-27e4d5a1e583 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2900dfb691734898a5fd1ac12207cebf'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:20.607789 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-d120eb66-8be9-4835-8d4c-27e4d5a1e583 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2900dfb691734898a5fd1ac12207cebf'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:20.622434 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-d120eb66-8be9-4835-8d4c-27e4d5a1e583 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2900dfb691734898a5fd1ac12207cebf'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:20.638868 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-d120eb66-8be9-4835-8d4c-27e4d5a1e583 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2900dfb691734898a5fd1ac12207cebf'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:20.668667 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-d120eb66-8be9-4835-8d4c-27e4d5a1e583 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2900dfb691734898a5fd1ac12207cebf'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:20.684963 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1418/2819] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:50:20 2022] DELETE /identity/v3/users/2900dfb691734898a5fd1ac12207cebf => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:50:21.008931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23b28e-dde6-44da-a554-3e8a93cb3d72 service nova] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:21.042728 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23b28e-dde6-44da-a554-3e8a93cb3d72 service nova] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:21.181588 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b34a3-f9c7-4278-afb9-9275d23a6f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:21.182636 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b34a3-f9c7-4278-afb9-9275d23a6f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:21.183073 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b34a3-f9c7-4278-afb9-9275d23a6f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:21.183500 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b34a3-f9c7-4278-afb9-9275d23a6f83 admin admin] PATH_INFO: `/v3/projects/35a27fefe9ec41c09c01d67ec3d75683` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:21.184883 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b34a3-f9c7-4278-afb9-9275d23a6f83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35a27fefe9ec41c09c01d67ec3d75683)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:21.187319 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b34a3-f9c7-4278-afb9-9275d23a6f83 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:21.303408 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:21.314611 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-510b34a3-f9c7-4278-afb9-9275d23a6f83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35a27fefe9ec41c09c01d67ec3d75683', 'request_id': 'req-510b34a3-f9c7-4278-afb9-9275d23a6f83'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:21.330732 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-510b34a3-f9c7-4278-afb9-9275d23a6f83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35a27fefe9ec41c09c01d67ec3d75683', 'request_id': 'req-510b34a3-f9c7-4278-afb9-9275d23a6f83'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:21.342640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-510b34a3-f9c7-4278-afb9-9275d23a6f83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35a27fefe9ec41c09c01d67ec3d75683', 'request_id': 'req-510b34a3-f9c7-4278-afb9-9275d23a6f83'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:21.369481 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-510b34a3-f9c7-4278-afb9-9275d23a6f83 admin admin] The token cache is being invalidate because project 35a27fefe9ec41c09c01d67ec3d75683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:50:21.369864 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-510b34a3-f9c7-4278-afb9-9275d23a6f83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:21.370603 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-510b34a3-f9c7-4278-afb9-9275d23a6f83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:21.372460 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1402/2820] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:50:21 2022] DELETE /identity/v3/projects/35a27fefe9ec41c09c01d67ec3d75683 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:50:21.377626 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaff849-d860-4b78-8c63-8bbfb7749562 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:21.379053 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaff849-d860-4b78-8c63-8bbfb7749562 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:21.379371 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaff849-d860-4b78-8c63-8bbfb7749562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:21.405429 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-7aaff849-d860-4b78-8c63-8bbfb7749562 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:21.406982 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7aaff849-d860-4b78-8c63-8bbfb7749562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:21.510961 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1419/2821] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:50:21.521272 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc863b-9c17-4a8f-9076-32f10d93f9b2 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:21.521864 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc863b-9c17-4a8f-9076-32f10d93f9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:21.522232 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc863b-9c17-4a8f-9076-32f10d93f9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:21.560173 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-03bc863b-9c17-4a8f-9076-32f10d93f9b2 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:21.561669 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-03bc863b-9c17-4a8f-9076-32f10d93f9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:21.596737 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1403/2822] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:50:21.598875 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaff849-d860-4b78-8c63-8bbfb7749562 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:21.613344 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaff849-d860-4b78-8c63-8bbfb7749562 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:21.629614 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca7d73-a67e-4a63-b238-23f79f852f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:21.630357 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca7d73-a67e-4a63-b238-23f79f852f57 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:21.630594 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca7d73-a67e-4a63-b238-23f79f852f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:21.630961 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca7d73-a67e-4a63-b238-23f79f852f57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:21.631597 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca7d73-a67e-4a63-b238-23f79f852f57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:50:21.631906 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca7d73-a67e-4a63-b238-23f79f852f57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:21.633549 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca7d73-a67e-4a63-b238-23f79f852f57 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:21.673284 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc863b-9c17-4a8f-9076-32f10d93f9b2 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:21.675176 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1420/2823] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:50:21.688713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc863b-9c17-4a8f-9076-32f10d93f9b2 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:21.704355 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038b030-8ee1-475e-b094-ac892176faff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:21.706942 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038b030-8ee1-475e-b094-ac892176faff admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:21.709572 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038b030-8ee1-475e-b094-ac892176faff admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:21.709972 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038b030-8ee1-475e-b094-ac892176faff admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:21.714044 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038b030-8ee1-475e-b094-ac892176faff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:21.717660 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038b030-8ee1-475e-b094-ac892176faff admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:21.805686 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1404/2824] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:50:21 2022] POST /identity/v3/projects => generated 399 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 14 19:50:21.806835 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca7d73-a67e-4a63-b238-23f79f852f57 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:21.823814 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca7d73-a67e-4a63-b238-23f79f852f57 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:21.914699 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:21.949832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6ce6a-56a2-4656-b717-cc6c6218b0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:21.950530 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6ce6a-56a2-4656-b717-cc6c6218b0ec admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:21.950878 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6ce6a-56a2-4656-b717-cc6c6218b0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:21.951170 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6ce6a-56a2-4656-b717-cc6c6218b0ec admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:21.951876 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6ce6a-56a2-4656-b717-cc6c6218b0ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:21.954203 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b6ce6a-56a2-4656-b717-cc6c6218b0ec admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:21.997106 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1421/2825] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:50:21 2022] POST /identity/v3/users => generated 300 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:50:22.001168 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038b030-8ee1-475e-b094-ac892176faff admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:22.016337 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038b030-8ee1-475e-b094-ac892176faff admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:22.025224 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc945db-140b-4a70-ae38-ea6f375ed457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:22.026258 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc945db-140b-4a70-ae38-ea6f375ed457 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:22.026736 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc945db-140b-4a70-ae38-ea6f375ed457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:22.027196 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc945db-140b-4a70-ae38-ea6f375ed457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:22.028233 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc945db-140b-4a70-ae38-ea6f375ed457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:22.031105 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc945db-140b-4a70-ae38-ea6f375ed457 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:22.048836 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1405/2826] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:50:22.051813 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6ce6a-56a2-4656-b717-cc6c6218b0ec admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:22.068840 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6ce6a-56a2-4656-b717-cc6c6218b0ec admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:22.077020 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a09850-ae8e-422d-bfc8-b022f0fe2bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:22.078005 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a09850-ae8e-422d-bfc8-b022f0fe2bef admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:22.078603 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a09850-ae8e-422d-bfc8-b022f0fe2bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:22.079080 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a09850-ae8e-422d-bfc8-b022f0fe2bef admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:22.080307 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a09850-ae8e-422d-bfc8-b022f0fe2bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:22.083154 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a09850-ae8e-422d-bfc8-b022f0fe2bef admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:22.112804 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1422/2827] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:50:22.114824 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc945db-140b-4a70-ae38-ea6f375ed457 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:22.138134 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc945db-140b-4a70-ae38-ea6f375ed457 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:22.165754 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c80c9-1bd6-4ac9-9a54-dffa61ce18fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:22.171627 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c80c9-1bd6-4ac9-9a54-dffa61ce18fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:22.174074 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c80c9-1bd6-4ac9-9a54-dffa61ce18fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:22.175121 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c80c9-1bd6-4ac9-9a54-dffa61ce18fa admin admin] PATH_INFO: `/v3/projects/6972b7e19f7e4193ab53840d3e28a046/users/031c95e6c7a04abb81070115fbf71c16/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:22.227197 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c80c9-1bd6-4ac9-9a54-dffa61ce18fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6972b7e19f7e4193ab53840d3e28a046, user_id=031c95e6c7a04abb81070115fbf71c16, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:22.235786 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c80c9-1bd6-4ac9-9a54-dffa61ce18fa admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:22.289830 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0682d-5e4d-401b-bf04-52a384466493 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:22.290197 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0682d-5e4d-401b-bf04-52a384466493 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:22.290545 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0682d-5e4d-401b-bf04-52a384466493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:22.292400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1406/2828] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:50:22 2022] PUT /identity/v3/projects/6972b7e19f7e4193ab53840d3e28a046/users/031c95e6c7a04abb81070115fbf71c16/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:50:22.352361 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-7ef0682d-5e4d-401b-bf04-52a384466493 None None] MFA Rules not processed for user `031c95e6c7a04abb81070115fbf71c16`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:22.355398 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7ef0682d-5e4d-401b-bf04-52a384466493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:22.510002 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1423/2829] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:50:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:50:22.531320 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c80c9-1bd6-4ac9-9a54-dffa61ce18fa admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:22.534344 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-957c80c9-1bd6-4ac9-9a54-dffa61ce18fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:22.651482 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c80c9-1bd6-4ac9-9a54-dffa61ce18fa admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:22.656075 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f66ff5-bb8b-48ff-9ff7-ae41a4d41149 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e5c2502cf1a14203bec13879a47f47ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:22.657032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f66ff5-bb8b-48ff-9ff7-ae41a4d41149 service cinder] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:22.657501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f66ff5-bb8b-48ff-9ff7-ae41a4d41149 service cinder] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:22.657817 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f66ff5-bb8b-48ff-9ff7-ae41a4d41149 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:22.669439 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f66ff5-bb8b-48ff-9ff7-ae41a4d41149 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:22.670805 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f66ff5-bb8b-48ff-9ff7-ae41a4d41149 service cinder] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:22.682349 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1407/2830] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:50:22 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:50:29.595965 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0682d-5e4d-401b-bf04-52a384466493 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:29.597480 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7ef0682d-5e4d-401b-bf04-52a384466493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:29.670101 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0682d-5e4d-401b-bf04-52a384466493 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:29.674724 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666e66c-2f00-4430-a6b5-8be675525fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:29.675601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666e66c-2f00-4430-a6b5-8be675525fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:29.675895 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666e66c-2f00-4430-a6b5-8be675525fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:29.676179 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666e66c-2f00-4430-a6b5-8be675525fbe admin admin] PATH_INFO: `/v3/users/bc641ccda7f44a009800434f07d96854` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:29.677768 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666e66c-2f00-4430-a6b5-8be675525fbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc641ccda7f44a009800434f07d96854)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:29.679723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666e66c-2f00-4430-a6b5-8be675525fbe admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:29.730076 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-5666e66c-2f00-4430-a6b5-8be675525fbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc641ccda7f44a009800434f07d96854'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:29.731047 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-5666e66c-2f00-4430-a6b5-8be675525fbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc641ccda7f44a009800434f07d96854'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:29.732831 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:29.739829 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-5666e66c-2f00-4430-a6b5-8be675525fbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc641ccda7f44a009800434f07d96854'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:29.747682 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-5666e66c-2f00-4430-a6b5-8be675525fbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc641ccda7f44a009800434f07d96854'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:29.760006 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-5666e66c-2f00-4430-a6b5-8be675525fbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc641ccda7f44a009800434f07d96854'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:29.765885 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1424/2831] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:50:29 2022] DELETE /identity/v3/users/bc641ccda7f44a009800434f07d96854 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:50:29.771541 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3ff2b-b042-4014-b23c-3f1e1d9d3efb None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:29.772089 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3ff2b-b042-4014-b23c-3f1e1d9d3efb None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:29.772089 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3ff2b-b042-4014-b23c-3f1e1d9d3efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:29.790969 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-38c3ff2b-b042-4014-b23c-3f1e1d9d3efb None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:29.792183 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-38c3ff2b-b042-4014-b23c-3f1e1d9d3efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:29.854623 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1408/2832] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:50:29.864259 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666e66c-2f00-4430-a6b5-8be675525fbe admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:29.865873 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-5666e66c-2f00-4430-a6b5-8be675525fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:29.924599 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666e66c-2f00-4430-a6b5-8be675525fbe admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:29.928292 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53499b-cfa4-48bb-ba0e-0c2c9a7384c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:29.928932 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53499b-cfa4-48bb-ba0e-0c2c9a7384c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:29.929213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53499b-cfa4-48bb-ba0e-0c2c9a7384c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:29.929527 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53499b-cfa4-48bb-ba0e-0c2c9a7384c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:29.938542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53499b-cfa4-48bb-ba0e-0c2c9a7384c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:29.940010 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e53499b-cfa4-48bb-ba0e-0c2c9a7384c3 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:29.950190 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1425/2833] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:50:30.224123 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3ff2b-b042-4014-b23c-3f1e1d9d3efb None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:30.225538 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-38c3ff2b-b042-4014-b23c-3f1e1d9d3efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:30.237705 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3ff2b-b042-4014-b23c-3f1e1d9d3efb None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:30.243174 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dad402-32c3-4aa2-a88a-58333a994831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:30.244095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad402-32c3-4aa2-a88a-58333a994831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:30.244382 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad402-32c3-4aa2-a88a-58333a994831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:30.244661 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dad402-32c3-4aa2-a88a-58333a994831 admin admin] PATH_INFO: `/v3/projects/ec2cde8006e949c190d6be6a0c894de4` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:30.245880 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dad402-32c3-4aa2-a88a-58333a994831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec2cde8006e949c190d6be6a0c894de4)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:30.247931 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dad402-32c3-4aa2-a88a-58333a994831 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:30.256449 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:30.310120 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-53dad402-32c3-4aa2-a88a-58333a994831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec2cde8006e949c190d6be6a0c894de4', 'request_id': 'req-53dad402-32c3-4aa2-a88a-58333a994831'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:30.315578 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-53dad402-32c3-4aa2-a88a-58333a994831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec2cde8006e949c190d6be6a0c894de4', 'request_id': 'req-53dad402-32c3-4aa2-a88a-58333a994831'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:30.324391 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-53dad402-32c3-4aa2-a88a-58333a994831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec2cde8006e949c190d6be6a0c894de4', 'request_id': 'req-53dad402-32c3-4aa2-a88a-58333a994831'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:30.337684 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-53dad402-32c3-4aa2-a88a-58333a994831 admin admin] The token cache is being invalidate because project ec2cde8006e949c190d6be6a0c894de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:50:30.338055 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-53dad402-32c3-4aa2-a88a-58333a994831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:30.338855 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-53dad402-32c3-4aa2-a88a-58333a994831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:30.340466 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1409/2834] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:50:30 2022] DELETE /identity/v3/projects/ec2cde8006e949c190d6be6a0c894de4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:50:30.347216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe70d8-63f8-4bca-a5a2-57e7324f0003 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:30.347581 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe70d8-63f8-4bca-a5a2-57e7324f0003 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:30.347869 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fe70d8-63f8-4bca-a5a2-57e7324f0003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:30.369190 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-e0fe70d8-63f8-4bca-a5a2-57e7324f0003 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:30.370557 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-e0fe70d8-63f8-4bca-a5a2-57e7324f0003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:30.443842 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1426/2835] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:50:30.451590 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa271fbd-8fd1-4af3-83ad-c323e575a35c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:30.451883 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa271fbd-8fd1-4af3-83ad-c323e575a35c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:30.452166 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa271fbd-8fd1-4af3-83ad-c323e575a35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:30.471431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-fa271fbd-8fd1-4af3-83ad-c323e575a35c None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:30.472648 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-fa271fbd-8fd1-4af3-83ad-c323e575a35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:30.481308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1410/2836] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:50:30.485616 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe70d8-63f8-4bca-a5a2-57e7324f0003 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:30.496958 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fe70d8-63f8-4bca-a5a2-57e7324f0003 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:30.501646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2503c6-4e5b-4e66-b051-e15035309c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:30.502317 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2503c6-4e5b-4e66-b051-e15035309c36 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:30.502601 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2503c6-4e5b-4e66-b051-e15035309c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:30.502878 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2503c6-4e5b-4e66-b051-e15035309c36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:30.503620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2503c6-4e5b-4e66-b051-e15035309c36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:50:30.503928 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2503c6-4e5b-4e66-b051-e15035309c36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:30.506201 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2503c6-4e5b-4e66-b051-e15035309c36 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:30.519435 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1427/2837] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:50:30.524355 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa271fbd-8fd1-4af3-83ad-c323e575a35c None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:30.537412 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa271fbd-8fd1-4af3-83ad-c323e575a35c None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:30.545655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48594623-f2c9-4086-995d-a16511d80dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:30.546380 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48594623-f2c9-4086-995d-a16511d80dff admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:30.546671 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48594623-f2c9-4086-995d-a16511d80dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:30.546951 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48594623-f2c9-4086-995d-a16511d80dff admin admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:30.547653 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48594623-f2c9-4086-995d-a16511d80dff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:30.549616 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48594623-f2c9-4086-995d-a16511d80dff admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:30.580681 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1411/2838] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:50:30 2022] POST /identity/v3/projects => generated 367 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:50:30.581812 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2503c6-4e5b-4e66-b051-e15035309c36 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:30.591826 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2503c6-4e5b-4e66-b051-e15035309c36 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:30.655275 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:30.669246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76ed4f-45a4-4e16-9679-099d2f6cad07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:30.669990 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76ed4f-45a4-4e16-9679-099d2f6cad07 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:30.670288 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76ed4f-45a4-4e16-9679-099d2f6cad07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:30.670567 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76ed4f-45a4-4e16-9679-099d2f6cad07 admin admin] PATH_INFO: `/v3/users` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:30.671246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76ed4f-45a4-4e16-9679-099d2f6cad07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:30.673268 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76ed4f-45a4-4e16-9679-099d2f6cad07 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:30.700910 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1428/2839] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:50:30 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:50:30.702025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48594623-f2c9-4086-995d-a16511d80dff admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:30.714655 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48594623-f2c9-4086-995d-a16511d80dff admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:30.720033 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa072ab7-b07d-464c-8a04-4514547d63e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:30.720712 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa072ab7-b07d-464c-8a04-4514547d63e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:30.721004 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa072ab7-b07d-464c-8a04-4514547d63e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:30.721288 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa072ab7-b07d-464c-8a04-4514547d63e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:30.722061 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa072ab7-b07d-464c-8a04-4514547d63e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:30.725339 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa072ab7-b07d-464c-8a04-4514547d63e8 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:30.738255 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1412/2840] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:50:30.743309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76ed4f-45a4-4e16-9679-099d2f6cad07 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:30.754783 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76ed4f-45a4-4e16-9679-099d2f6cad07 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:30.761092 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181b770-8ec9-46ce-9b44-0b79a680851f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:30.761771 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181b770-8ec9-46ce-9b44-0b79a680851f admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:30.762057 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181b770-8ec9-46ce-9b44-0b79a680851f admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:30.762882 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181b770-8ec9-46ce-9b44-0b79a680851f admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:30.763065 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181b770-8ec9-46ce-9b44-0b79a680851f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:30.764673 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181b770-8ec9-46ce-9b44-0b79a680851f admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:30.777313 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1429/2841] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:50:30.781642 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa072ab7-b07d-464c-8a04-4514547d63e8 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:30.791922 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa072ab7-b07d-464c-8a04-4514547d63e8 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:30.796524 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3460395-fa81-45ca-bc2d-847530e575a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:30.797429 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3460395-fa81-45ca-bc2d-847530e575a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:30.797713 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3460395-fa81-45ca-bc2d-847530e575a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:30.797989 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3460395-fa81-45ca-bc2d-847530e575a6 admin admin] PATH_INFO: `/v3/projects/df9298be15454aa1b9ecf67360fd6ea8/users/1994081ce0a04d44ae9ed523494a1410/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:30.814167 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3460395-fa81-45ca-bc2d-847530e575a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9298be15454aa1b9ecf67360fd6ea8, user_id=1994081ce0a04d44ae9ed523494a1410, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:30.817236 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3460395-fa81-45ca-bc2d-847530e575a6 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:30.832566 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1413/2842] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:50:30 2022] PUT /identity/v3/projects/df9298be15454aa1b9ecf67360fd6ea8/users/1994081ce0a04d44ae9ed523494a1410/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:50:30.843173 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4be88-195e-4778-ac8f-ddc2a5ed0d88 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:30.843658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4be88-195e-4778-ac8f-ddc2a5ed0d88 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:30.843816 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4be88-195e-4778-ac8f-ddc2a5ed0d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:30.871172 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-b5f4be88-195e-4778-ac8f-ddc2a5ed0d88 None None] MFA Rules not processed for user `1994081ce0a04d44ae9ed523494a1410`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:30.872382 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b5f4be88-195e-4778-ac8f-ddc2a5ed0d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:30.946063 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1430/2843] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:50:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:50:30.957805 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3460395-fa81-45ca-bc2d-847530e575a6 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:30.960219 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c3460395-fa81-45ca-bc2d-847530e575a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:31.027400 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3460395-fa81-45ca-bc2d-847530e575a6 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:31.031067 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8af64-1708-4347-aeda-cc33c72719bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa134b748854fb3b4de54b04390eec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:31.031716 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8af64-1708-4347-aeda-cc33c72719bf service glance] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:31.031999 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8af64-1708-4347-aeda-cc33c72719bf service glance] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:31.032277 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8af64-1708-4347-aeda-cc33c72719bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:31.041941 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8af64-1708-4347-aeda-cc33c72719bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:31.043379 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8af64-1708-4347-aeda-cc33c72719bf service glance] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:31.053692 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1414/2844] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:50:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:50:31.433037 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4be88-195e-4778-ac8f-ddc2a5ed0d88 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:31.434787 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b5f4be88-195e-4778-ac8f-ddc2a5ed0d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:31.528723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4be88-195e-4778-ac8f-ddc2a5ed0d88 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:31.534221 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe6fd6-0998-42c9-9444-8b6d736258da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:31.535148 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe6fd6-0998-42c9-9444-8b6d736258da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:31.535437 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe6fd6-0998-42c9-9444-8b6d736258da admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:31.535720 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe6fd6-0998-42c9-9444-8b6d736258da admin admin] PATH_INFO: `/v3/users/031c95e6c7a04abb81070115fbf71c16` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:31.538539 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe6fd6-0998-42c9-9444-8b6d736258da admin admin] RBAC: Authorizing `identity:delete_user(user_id=031c95e6c7a04abb81070115fbf71c16)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:31.540884 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbe6fd6-0998-42c9-9444-8b6d736258da admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:31.587621 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-abbe6fd6-0998-42c9-9444-8b6d736258da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '031c95e6c7a04abb81070115fbf71c16'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:31.588264 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-abbe6fd6-0998-42c9-9444-8b6d736258da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '031c95e6c7a04abb81070115fbf71c16'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:31.595052 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-abbe6fd6-0998-42c9-9444-8b6d736258da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '031c95e6c7a04abb81070115fbf71c16'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:31.602908 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-abbe6fd6-0998-42c9-9444-8b6d736258da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '031c95e6c7a04abb81070115fbf71c16'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:31.604798 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:31.617186 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-abbe6fd6-0998-42c9-9444-8b6d736258da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '031c95e6c7a04abb81070115fbf71c16'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:31.623592 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1431/2845] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:50:31 2022] DELETE /identity/v3/users/031c95e6c7a04abb81070115fbf71c16 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:50:31.628212 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6338a-7d82-45d2-a02b-aaba0d951e1b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:31.628509 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6338a-7d82-45d2-a02b-aaba0d951e1b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:31.628795 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6338a-7d82-45d2-a02b-aaba0d951e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:31.647892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c3f6338a-7d82-45d2-a02b-aaba0d951e1b None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:31.649089 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c3f6338a-7d82-45d2-a02b-aaba0d951e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:31.680063 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:31.720215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1415/2846] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:50:31.730509 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe6fd6-0998-42c9-9444-8b6d736258da admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:31.731927 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-abbe6fd6-0998-42c9-9444-8b6d736258da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:31.794997 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe6fd6-0998-42c9-9444-8b6d736258da admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:31.798683 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475c1f0-b7d6-402c-965c-c3f3be2779fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:31.799341 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475c1f0-b7d6-402c-965c-c3f3be2779fc service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:31.799646 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475c1f0-b7d6-402c-965c-c3f3be2779fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:31.799912 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475c1f0-b7d6-402c-965c-c3f3be2779fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:31.810421 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475c1f0-b7d6-402c-965c-c3f3be2779fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:31.811987 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475c1f0-b7d6-402c-965c-c3f3be2779fc service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:31.830775 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1432/2847] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:50:32.194007 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6338a-7d82-45d2-a02b-aaba0d951e1b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:32.195486 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c3f6338a-7d82-45d2-a02b-aaba0d951e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:32.211379 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6338a-7d82-45d2-a02b-aaba0d951e1b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:32.219330 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152de71-8c69-475c-9506-b458b1fc84bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:32.220265 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152de71-8c69-475c-9506-b458b1fc84bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:32.220581 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152de71-8c69-475c-9506-b458b1fc84bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:32.220801 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152de71-8c69-475c-9506-b458b1fc84bd admin admin] PATH_INFO: `/v3/projects/6972b7e19f7e4193ab53840d3e28a046` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:32.222126 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152de71-8c69-475c-9506-b458b1fc84bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6972b7e19f7e4193ab53840d3e28a046)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:32.225357 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152de71-8c69-475c-9506-b458b1fc84bd admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:32.278809 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2152de71-8c69-475c-9506-b458b1fc84bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6972b7e19f7e4193ab53840d3e28a046', 'request_id': 'req-2152de71-8c69-475c-9506-b458b1fc84bd'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:32.285751 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2152de71-8c69-475c-9506-b458b1fc84bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6972b7e19f7e4193ab53840d3e28a046', 'request_id': 'req-2152de71-8c69-475c-9506-b458b1fc84bd'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:32.295329 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2152de71-8c69-475c-9506-b458b1fc84bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6972b7e19f7e4193ab53840d3e28a046', 'request_id': 'req-2152de71-8c69-475c-9506-b458b1fc84bd'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:32.307139 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2152de71-8c69-475c-9506-b458b1fc84bd admin admin] The token cache is being invalidate because project 6972b7e19f7e4193ab53840d3e28a046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:50:32.307424 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2152de71-8c69-475c-9506-b458b1fc84bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:32.308048 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-2152de71-8c69-475c-9506-b458b1fc84bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:50:32.309645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1416/2848] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:50:32 2022] DELETE /identity/v3/projects/6972b7e19f7e4193ab53840d3e28a046 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:50:38.998402 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee810c6-8a49-44fc-bbc8-b2db95710334 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:38.998963 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee810c6-8a49-44fc-bbc8-b2db95710334 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:38.998963 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee810c6-8a49-44fc-bbc8-b2db95710334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:39.016361 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-0ee810c6-8a49-44fc-bbc8-b2db95710334 None None] MFA Rules not processed for user `10f209080b9745d0a13f60ce5e1ca7df`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:50:39.017607 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-0ee810c6-8a49-44fc-bbc8-b2db95710334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:39.073747 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1433/2849] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:50:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:50:42.304101 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=39,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:44.545007 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152de71-8c69-475c-9506-b458b1fc84bd admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:44.546471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2152de71-8c69-475c-9506-b458b1fc84bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:44.609727 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152de71-8c69-475c-9506-b458b1fc84bd admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:44.613262 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef1969-2383-417e-8716-324d300a310c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:44.613971 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef1969-2383-417e-8716-324d300a310c service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:44.614256 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef1969-2383-417e-8716-324d300a310c service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:44.614531 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef1969-2383-417e-8716-324d300a310c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:44.616306 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8aef1969-2383-417e-8716-324d300a310c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:44.682454 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef1969-2383-417e-8716-324d300a310c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:44.684124 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef1969-2383-417e-8716-324d300a310c service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:44.695226 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1417/2850] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:50:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:50:49.066570 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=57,keystone:DELETE=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:54.689952 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=50 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:50:58.096723 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee810c6-8a49-44fc-bbc8-b2db95710334 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:50:58.106368 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee810c6-8a49-44fc-bbc8-b2db95710334 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:50:58.109857 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ce409-b1fb-4d0d-bef5-45630191e63d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:50:58.110524 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ce409-b1fb-4d0d-bef5-45630191e63d service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:50:58.110807 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ce409-b1fb-4d0d-bef5-45630191e63d service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:50:58.111082 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ce409-b1fb-4d0d-bef5-45630191e63d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:50:58.112837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-c94ce409-b1fb-4d0d-bef5-45630191e63d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:50:58.178211 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ce409-b1fb-4d0d-bef5-45630191e63d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:50:58.179635 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ce409-b1fb-4d0d-bef5-45630191e63d service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:50:58.189507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1434/2851] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:50:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:51:03.375283 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef1969-2383-417e-8716-324d300a310c service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:51:03.376720 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8aef1969-2383-417e-8716-324d300a310c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:51:03.443471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef1969-2383-417e-8716-324d300a310c service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:51:03.447974 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb662be-4e0f-46ef-a90f-881f214c734a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:51:03.448838 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb662be-4e0f-46ef-a90f-881f214c734a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:51:03.449118 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb662be-4e0f-46ef-a90f-881f214c734a admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:51:03.449466 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb662be-4e0f-46ef-a90f-881f214c734a admin admin] PATH_INFO: `/v3/users/1994081ce0a04d44ae9ed523494a1410` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:51:03.450594 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb662be-4e0f-46ef-a90f-881f214c734a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1994081ce0a04d44ae9ed523494a1410)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:51:03.452516 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb662be-4e0f-46ef-a90f-881f214c734a admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:51:03.500025 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-bbb662be-4e0f-46ef-a90f-881f214c734a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1994081ce0a04d44ae9ed523494a1410'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:51:03.500740 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-bbb662be-4e0f-46ef-a90f-881f214c734a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1994081ce0a04d44ae9ed523494a1410'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:51:03.508735 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-bbb662be-4e0f-46ef-a90f-881f214c734a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1994081ce0a04d44ae9ed523494a1410'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:51:03.516215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-bbb662be-4e0f-46ef-a90f-881f214c734a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1994081ce0a04d44ae9ed523494a1410'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:51:03.529106 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-bbb662be-4e0f-46ef-a90f-881f214c734a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1994081ce0a04d44ae9ed523494a1410'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:51:03.535188 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1418/2852] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:51:03 2022] DELETE /identity/v3/users/1994081ce0a04d44ae9ed523494a1410 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:51:03.539649 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ca030-9ae1-418c-a613-adbdce08f75b None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:51:03.540125 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ca030-9ae1-418c-a613-adbdce08f75b None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:51:03.540233 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ca030-9ae1-418c-a613-adbdce08f75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:51:03.558117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-547ca030-9ae1-418c-a613-adbdce08f75b None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:51:03.559905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-547ca030-9ae1-418c-a613-adbdce08f75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:51:03.621809 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1435/2853] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 14 19:51:03.631646 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb662be-4e0f-46ef-a90f-881f214c734a admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:51:03.633199 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bbb662be-4e0f-46ef-a90f-881f214c734a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:51:03.695685 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb662be-4e0f-46ef-a90f-881f214c734a admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:51:03.700337 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a4c34-b7f8-4045-81e6-4e8faae3849e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:51:03.700983 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a4c34-b7f8-4045-81e6-4e8faae3849e service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:51:03.701264 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a4c34-b7f8-4045-81e6-4e8faae3849e service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:51:03.701565 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a4c34-b7f8-4045-81e6-4e8faae3849e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:51:03.711282 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a4c34-b7f8-4045-81e6-4e8faae3849e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:51:03.712692 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a4c34-b7f8-4045-81e6-4e8faae3849e service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:51:03.723571 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1419/2854] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 14 19:51:04.000918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ca030-9ae1-418c-a613-adbdce08f75b None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:51:04.002346 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-547ca030-9ae1-418c-a613-adbdce08f75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:51:04.018095 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ca030-9ae1-418c-a613-adbdce08f75b None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:51:04.023115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eebda1-6512-4e0d-b08a-8879140f687f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:51:04.024167 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eebda1-6512-4e0d-b08a-8879140f687f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:51:04.024456 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eebda1-6512-4e0d-b08a-8879140f687f admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:51:04.024788 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eebda1-6512-4e0d-b08a-8879140f687f admin admin] PATH_INFO: `/v3/projects/df9298be15454aa1b9ecf67360fd6ea8` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:51:04.025943 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eebda1-6512-4e0d-b08a-8879140f687f admin admin] RBAC: Authorizing `identity:delete_project(project_id=df9298be15454aa1b9ecf67360fd6ea8)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:51:04.028759 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eebda1-6512-4e0d-b08a-8879140f687f admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:51:04.075520 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a8eebda1-6512-4e0d-b08a-8879140f687f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df9298be15454aa1b9ecf67360fd6ea8', 'request_id': 'req-a8eebda1-6512-4e0d-b08a-8879140f687f'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:51:04.080953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a8eebda1-6512-4e0d-b08a-8879140f687f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df9298be15454aa1b9ecf67360fd6ea8', 'request_id': 'req-a8eebda1-6512-4e0d-b08a-8879140f687f'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:51:04.088301 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a8eebda1-6512-4e0d-b08a-8879140f687f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df9298be15454aa1b9ecf67360fd6ea8', 'request_id': 'req-a8eebda1-6512-4e0d-b08a-8879140f687f'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:51:04.099407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a8eebda1-6512-4e0d-b08a-8879140f687f admin admin] The token cache is being invalidate because project df9298be15454aa1b9ecf67360fd6ea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:51:04.099694 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a8eebda1-6512-4e0d-b08a-8879140f687f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:51:04.100320 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-a8eebda1-6512-4e0d-b08a-8879140f687f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:51:04.101894 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1436/2855] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:51:03 2022] DELETE /identity/v3/projects/df9298be15454aa1b9ecf67360fd6ea8 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:51:04.108217 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000135a-4ec9-4bac-a28e-a4e40f70c76f None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:51:04.108514 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000135a-4ec9-4bac-a28e-a4e40f70c76f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:51:04.108797 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000135a-4ec9-4bac-a28e-a4e40f70c76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:51:04.127862 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d000135a-4ec9-4bac-a28e-a4e40f70c76f None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:51:04.129064 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d000135a-4ec9-4bac-a28e-a4e40f70c76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:51:04.146410 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:51:04.190368 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1420/2856] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:51:04.197953 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a800c-865a-4f55-86d5-6172975a947a None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:51:04.198246 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a800c-865a-4f55-86d5-6172975a947a None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:51:04.198530 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a800c-865a-4f55-86d5-6172975a947a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:51:04.216783 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-0f5a800c-865a-4f55-86d5-6172975a947a None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:51:04.218036 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-0f5a800c-865a-4f55-86d5-6172975a947a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:51:04.226034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1437/2857] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:51:04.230569 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000135a-4ec9-4bac-a28e-a4e40f70c76f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:51:04.240223 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000135a-4ec9-4bac-a28e-a4e40f70c76f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:51:04.244834 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d211ca-cacb-472a-8b27-43ce7283d11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:51:04.245471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d211ca-cacb-472a-8b27-43ce7283d11b admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:51:04.246393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d211ca-cacb-472a-8b27-43ce7283d11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:51:04.246854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d211ca-cacb-472a-8b27-43ce7283d11b admin admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:51:04.247437 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d211ca-cacb-472a-8b27-43ce7283d11b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 14 19:51:04.247748 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d211ca-cacb-472a-8b27-43ce7283d11b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:51:04.249343 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d211ca-cacb-472a-8b27-43ce7283d11b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:51:04.260759 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1421/2858] 10.222.0.44 () {58 vars in 1152 bytes} [Tue Jun 14 19:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 14 19:51:04.264893 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a800c-865a-4f55-86d5-6172975a947a None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:51:04.274227 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a800c-865a-4f55-86d5-6172975a947a None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:51:04.279204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe7ebf-18fe-4831-9f30-3b9b30a0e0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:51:04.279852 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe7ebf-18fe-4831-9f30-3b9b30a0e0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:51:04.280132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe7ebf-18fe-4831-9f30-3b9b30a0e0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:51:04.280408 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe7ebf-18fe-4831-9f30-3b9b30a0e0a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:51:04.281095 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe7ebf-18fe-4831-9f30-3b9b30a0e0a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:51:04.283009 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe7ebf-18fe-4831-9f30-3b9b30a0e0a8 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:51:04.291208 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:51:04.317562 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1438/2859] 10.222.0.44 () {60 vars in 1152 bytes} [Tue Jun 14 19:51:04 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:51:04.318840 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d211ca-cacb-472a-8b27-43ce7283d11b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:51:04.329795 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d211ca-cacb-472a-8b27-43ce7283d11b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:51:04.388038 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6b0b8-50ae-44dc-bf6c-c27038818808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:51:04.388726 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6b0b8-50ae-44dc-bf6c-c27038818808 admin admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:51:04.388959 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6b0b8-50ae-44dc-bf6c-c27038818808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:51:04.389237 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6b0b8-50ae-44dc-bf6c-c27038818808 admin admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:51:04.390006 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6b0b8-50ae-44dc-bf6c-c27038818808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:51:04.392152 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6b0b8-50ae-44dc-bf6c-c27038818808 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:51:04.412135 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1422/2860] 10.222.0.44 () {60 vars in 1143 bytes} [Tue Jun 14 19:51:04 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 14 19:51:04.416180 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe7ebf-18fe-4831-9f30-3b9b30a0e0a8 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:51:04.427115 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe7ebf-18fe-4831-9f30-3b9b30a0e0a8 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:51:04.431732 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d797b-f85a-46ef-9431-bd96666cafc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:51:04.432383 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d797b-f85a-46ef-9431-bd96666cafc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:51:04.432665 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d797b-f85a-46ef-9431-bd96666cafc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:51:04.432944 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d797b-f85a-46ef-9431-bd96666cafc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:51:04.434318 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d797b-f85a-46ef-9431-bd96666cafc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:51:04.435895 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d797b-f85a-46ef-9431-bd96666cafc2 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:51:04.446143 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1439/2861] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 14 19:51:04.450145 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6b0b8-50ae-44dc-bf6c-c27038818808 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:51:04.460075 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6b0b8-50ae-44dc-bf6c-c27038818808 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:51:04.465431 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c1659-ccff-44bc-a428-063e0c309285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:51:04.466095 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c1659-ccff-44bc-a428-063e0c309285 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:51:04.466382 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c1659-ccff-44bc-a428-063e0c309285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:51:04.466662 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c1659-ccff-44bc-a428-063e0c309285 admin admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:51:04.467383 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c1659-ccff-44bc-a428-063e0c309285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:51:04.468981 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c1659-ccff-44bc-a428-063e0c309285 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:51:04.478702 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1423/2862] 10.222.0.44 () {58 vars in 1121 bytes} [Tue Jun 14 19:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 14 19:51:04.483238 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d797b-f85a-46ef-9431-bd96666cafc2 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:51:04.493096 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d797b-f85a-46ef-9431-bd96666cafc2 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:51:04.498213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd71b0-fd27-4d1f-9958-2e4c3e1a82a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:51:04.499076 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd71b0-fd27-4d1f-9958-2e4c3e1a82a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:51:04.499365 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd71b0-fd27-4d1f-9958-2e4c3e1a82a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:51:04.499645 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd71b0-fd27-4d1f-9958-2e4c3e1a82a1 admin admin] PATH_INFO: `/v3/projects/ea475188eef24b4d9e8c3115e8ede0a7/users/f9a6fee4a72a43338c2b377cc745d2f0/roles/bf1733d36314409c80cd50b2268834b1` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:51:04.515240 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd71b0-fd27-4d1f-9958-2e4c3e1a82a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea475188eef24b4d9e8c3115e8ede0a7, user_id=f9a6fee4a72a43338c2b377cc745d2f0, role_id=bf1733d36314409c80cd50b2268834b1)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:51:04.518184 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd71b0-fd27-4d1f-9958-2e4c3e1a82a1 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:51:04.531219 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1440/2863] 10.222.0.44 () {60 vars in 1482 bytes} [Tue Jun 14 19:51:04 2022] PUT /identity/v3/projects/ea475188eef24b4d9e8c3115e8ede0a7/users/f9a6fee4a72a43338c2b377cc745d2f0/roles/bf1733d36314409c80cd50b2268834b1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:51:04.541344 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72882c5-076d-4b7d-9c3e-adc6e00431ef None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:51:04.541668 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72882c5-076d-4b7d-9c3e-adc6e00431ef None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:51:04.541947 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72882c5-076d-4b7d-9c3e-adc6e00431ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:51:04.568335 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c72882c5-076d-4b7d-9c3e-adc6e00431ef None None] MFA Rules not processed for user `f9a6fee4a72a43338c2b377cc745d2f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:51:04.569568 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c72882c5-076d-4b7d-9c3e-adc6e00431ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:51:04.631752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1424/2864] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:51:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:51:04.643837 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd71b0-fd27-4d1f-9958-2e4c3e1a82a1 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:51:04.645640 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-bdfd71b0-fd27-4d1f-9958-2e4c3e1a82a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:51:04.703430 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd71b0-fd27-4d1f-9958-2e4c3e1a82a1 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:51:04.707152 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85b0aa-01ea-494a-8cd8-ddda83085215 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'caa134b748854fb3b4de54b04390eec9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:51:04.707799 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85b0aa-01ea-494a-8cd8-ddda83085215 service glance] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:51:04.708086 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85b0aa-01ea-494a-8cd8-ddda83085215 service glance] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:51:04.708367 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85b0aa-01ea-494a-8cd8-ddda83085215 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:51:04.717250 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85b0aa-01ea-494a-8cd8-ddda83085215 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:51:04.718715 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85b0aa-01ea-494a-8cd8-ddda83085215 service glance] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:51:04.727417 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1441/2865] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:51:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:51:14.628855 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:51:14.723482 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=45,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:51:31.274597 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72882c5-076d-4b7d-9c3e-adc6e00431ef None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:51:31.336895 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72882c5-076d-4b7d-9c3e-adc6e00431ef None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:51:31.341333 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d8268-e8d0-4bf5-a9bc-2e792f8e174f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:51:31.342215 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d8268-e8d0-4bf5-a9bc-2e792f8e174f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:51:31.342488 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d8268-e8d0-4bf5-a9bc-2e792f8e174f admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:51:31.342765 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d8268-e8d0-4bf5-a9bc-2e792f8e174f admin admin] PATH_INFO: `/v3/users/f9a6fee4a72a43338c2b377cc745d2f0` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:51:31.343928 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d8268-e8d0-4bf5-a9bc-2e792f8e174f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a6fee4a72a43338c2b377cc745d2f0)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:51:31.346360 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0d8268-e8d0-4bf5-a9bc-2e792f8e174f admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:51:31.390814 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4d0d8268-e8d0-4bf5-a9bc-2e792f8e174f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a6fee4a72a43338c2b377cc745d2f0'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:51:31.391728 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4d0d8268-e8d0-4bf5-a9bc-2e792f8e174f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a6fee4a72a43338c2b377cc745d2f0'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:51:31.399725 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4d0d8268-e8d0-4bf5-a9bc-2e792f8e174f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a6fee4a72a43338c2b377cc745d2f0'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:51:31.406563 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4d0d8268-e8d0-4bf5-a9bc-2e792f8e174f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a6fee4a72a43338c2b377cc745d2f0'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:51:31.418580 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-4d0d8268-e8d0-4bf5-a9bc-2e792f8e174f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a6fee4a72a43338c2b377cc745d2f0'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:51:31.424393 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1425/2866] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:51:31 2022] DELETE /identity/v3/users/f9a6fee4a72a43338c2b377cc745d2f0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:51:31.429032 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ae506-6b11-40d5-bdb7-f22cbd949a08 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:51:31.429637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ae506-6b11-40d5-bdb7-f22cbd949a08 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:51:31.429776 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ae506-6b11-40d5-bdb7-f22cbd949a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:51:31.447351 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-460ae506-6b11-40d5-bdb7-f22cbd949a08 None None] MFA Rules not processed for user `13cde894f1744031872e9c62485bd552`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:51:31.448552 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-460ae506-6b11-40d5-bdb7-f22cbd949a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:51:31.507553 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1442/2867] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:51:31.517248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d8268-e8d0-4bf5-a9bc-2e792f8e174f admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:51:31.519326 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4d0d8268-e8d0-4bf5-a9bc-2e792f8e174f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:51:31.577096 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d8268-e8d0-4bf5-a9bc-2e792f8e174f admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:51:31.581365 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb398d3-319d-4c3a-8d1a-fe955d78dd61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:51:31.582032 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb398d3-319d-4c3a-8d1a-fe955d78dd61 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:51:31.582341 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb398d3-319d-4c3a-8d1a-fe955d78dd61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:51:31.582618 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb398d3-319d-4c3a-8d1a-fe955d78dd61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:51:31.591489 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb398d3-319d-4c3a-8d1a-fe955d78dd61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:51:31.592910 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb398d3-319d-4c3a-8d1a-fe955d78dd61 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:51:31.602463 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1426/2868] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:51:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:51:31.878625 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ae506-6b11-40d5-bdb7-f22cbd949a08 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:51:31.880103 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-460ae506-6b11-40d5-bdb7-f22cbd949a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:51:31.892138 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ae506-6b11-40d5-bdb7-f22cbd949a08 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:51:31.898252 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac9b62-b252-4058-8e3f-8968ddc5f0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:51:31.899157 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac9b62-b252-4058-8e3f-8968ddc5f0cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:51:31.899443 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac9b62-b252-4058-8e3f-8968ddc5f0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:51:31.899722 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cac9b62-b252-4058-8e3f-8968ddc5f0cf admin admin] PATH_INFO: `/v3/projects/ea475188eef24b4d9e8c3115e8ede0a7` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:51:31.901013 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac9b62-b252-4058-8e3f-8968ddc5f0cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea475188eef24b4d9e8c3115e8ede0a7)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:51:31.905918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cac9b62-b252-4058-8e3f-8968ddc5f0cf admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:51:31.961812 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1cac9b62-b252-4058-8e3f-8968ddc5f0cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea475188eef24b4d9e8c3115e8ede0a7', 'request_id': 'req-1cac9b62-b252-4058-8e3f-8968ddc5f0cf'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:51:31.967122 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1cac9b62-b252-4058-8e3f-8968ddc5f0cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea475188eef24b4d9e8c3115e8ede0a7', 'request_id': 'req-1cac9b62-b252-4058-8e3f-8968ddc5f0cf'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:51:31.975617 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1cac9b62-b252-4058-8e3f-8968ddc5f0cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea475188eef24b4d9e8c3115e8ede0a7', 'request_id': 'req-1cac9b62-b252-4058-8e3f-8968ddc5f0cf'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:51:31.987216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1cac9b62-b252-4058-8e3f-8968ddc5f0cf admin admin] The token cache is being invalidate because project ea475188eef24b4d9e8c3115e8ede0a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:51:31.987503 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1cac9b62-b252-4058-8e3f-8968ddc5f0cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:51:31.988129 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-1cac9b62-b252-4058-8e3f-8968ddc5f0cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:51:31.989681 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1443/2869] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:51:31 2022] DELETE /identity/v3/projects/ea475188eef24b4d9e8c3115e8ede0a7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:51:41.598427 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:51:41.983600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:52:06.413579 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb398d3-319d-4c3a-8d1a-fe955d78dd61 service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:52:06.414970 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2cb398d3-319d-4c3a-8d1a-fe955d78dd61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:52:06.426941 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb398d3-319d-4c3a-8d1a-fe955d78dd61 service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:52:06.474964 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53c44b-c0a1-4c7f-b6f8-1a5f829c1640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:52:06.475605 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53c44b-c0a1-4c7f-b6f8-1a5f829c1640 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:52:06.475892 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53c44b-c0a1-4c7f-b6f8-1a5f829c1640 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:52:06.476170 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53c44b-c0a1-4c7f-b6f8-1a5f829c1640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:52:06.477980 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9f53c44b-c0a1-4c7f-b6f8-1a5f829c1640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:52:06.547491 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53c44b-c0a1-4c7f-b6f8-1a5f829c1640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:52:06.548927 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f53c44b-c0a1-4c7f-b6f8-1a5f829c1640 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:52:06.559970 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1427/2870] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:52:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:52:12.176900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac9b62-b252-4058-8e3f-8968ddc5f0cf admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:52:12.178400 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-1cac9b62-b252-4058-8e3f-8968ddc5f0cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:52:12.190967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cac9b62-b252-4058-8e3f-8968ddc5f0cf admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:52:12.194497 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cad00-e1a8-4e13-a67a-c9e69f6993bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:52:12.195132 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cad00-e1a8-4e13-a67a-c9e69f6993bf service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:52:12.195414 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cad00-e1a8-4e13-a67a-c9e69f6993bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:52:12.195688 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93cad00-e1a8-4e13-a67a-c9e69f6993bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:52:12.197445 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b93cad00-e1a8-4e13-a67a-c9e69f6993bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:52:12.211319 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cad00-e1a8-4e13-a67a-c9e69f6993bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:52:12.212727 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93cad00-e1a8-4e13-a67a-c9e69f6993bf service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:52:12.224407 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1444/2871] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:52:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:52:14.550367 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8fa01-7606-4131-9dc6-37e0420cdffb None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:52:14.550855 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8fa01-7606-4131-9dc6-37e0420cdffb None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:52:14.551011 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8fa01-7606-4131-9dc6-37e0420cdffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:52:14.568933 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e9f8fa01-7606-4131-9dc6-37e0420cdffb None None] MFA Rules not processed for user `d16be8774cb842199cfb9e3b9965bd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:52:14.570148 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e9f8fa01-7606-4131-9dc6-37e0420cdffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:52:14.623514 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1428/2872] 10.222.0.44 () {58 vars in 967 bytes} [Tue Jun 14 19:52:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:52:14.663637 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cad00-e1a8-4e13-a67a-c9e69f6993bf service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:52:14.665063 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-b93cad00-e1a8-4e13-a67a-c9e69f6993bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:52:14.734523 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93cad00-e1a8-4e13-a67a-c9e69f6993bf service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:52:14.740341 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a7348-0254-4670-aefb-8d651bc473cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fff5414195f4873bcc8752c914b6b49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:52:14.740989 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a7348-0254-4670-aefb-8d651bc473cf service swift] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:52:14.741277 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a7348-0254-4670-aefb-8d651bc473cf service swift] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:52:14.741590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a7348-0254-4670-aefb-8d651bc473cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:52:14.749674 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a7348-0254-4670-aefb-8d651bc473cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:52:14.751256 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a7348-0254-4670-aefb-8d651bc473cf service swift] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:52:14.759886 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1445/2873] 10.222.0.44 () {60 vars in 1384 bytes} [Tue Jun 14 19:52:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 14 19:52:21.046548 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8fa01-7606-4131-9dc6-37e0420cdffb None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:52:21.047970 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e9f8fa01-7606-4131-9dc6-37e0420cdffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:52:21.123237 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a7348-0254-4670-aefb-8d651bc473cf service swift] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:52:21.124703 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-347a7348-0254-4670-aefb-8d651bc473cf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:52:21.128779 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:52:21.158775 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8fa01-7606-4131-9dc6-37e0420cdffb None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:52:21.164047 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7fa2c-2b45-4489-9a49-c3f617268b1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98915513674460485413c2dbee87fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:52:21.164706 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7fa2c-2b45-4489-9a49-c3f617268b1f service placement] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:52:21.164995 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7fa2c-2b45-4489-9a49-c3f617268b1f service placement] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:52:21.165277 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7fa2c-2b45-4489-9a49-c3f617268b1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:52:21.167152 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-dbb7fa2c-2b45-4489-9a49-c3f617268b1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:52:21.180817 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7fa2c-2b45-4489-9a49-c3f617268b1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:52:21.182501 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7fa2c-2b45-4489-9a49-c3f617268b1f service placement] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:52:21.195310 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1429/2874] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:52:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:52:21.202315 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a7348-0254-4670-aefb-8d651bc473cf service swift] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:52:21.207741 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca62f1-46c3-4e7d-acc0-60c2f682f918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:52:21.208933 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca62f1-46c3-4e7d-acc0-60c2f682f918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:52:21.209216 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca62f1-46c3-4e7d-acc0-60c2f682f918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:52:21.209540 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca62f1-46c3-4e7d-acc0-60c2f682f918 admin admin] PATH_INFO: `/v3/users/f2d3d11f92e3400c9ec8f35677a44198` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:52:21.210771 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca62f1-46c3-4e7d-acc0-60c2f682f918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d3d11f92e3400c9ec8f35677a44198)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:52:21.212777 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca62f1-46c3-4e7d-acc0-60c2f682f918 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:52:21.260944 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-11ca62f1-46c3-4e7d-acc0-60c2f682f918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d3d11f92e3400c9ec8f35677a44198'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:52:21.261642 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-11ca62f1-46c3-4e7d-acc0-60c2f682f918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d3d11f92e3400c9ec8f35677a44198'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:52:21.268828 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-11ca62f1-46c3-4e7d-acc0-60c2f682f918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d3d11f92e3400c9ec8f35677a44198'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:52:21.275542 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-11ca62f1-46c3-4e7d-acc0-60c2f682f918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d3d11f92e3400c9ec8f35677a44198'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:52:21.286871 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:52:21.288196 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-11ca62f1-46c3-4e7d-acc0-60c2f682f918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d3d11f92e3400c9ec8f35677a44198'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:52:21.295476 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1446/2875] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:52:21 2022] DELETE /identity/v3/users/f2d3d11f92e3400c9ec8f35677a44198 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:52:21.465974 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7fa2c-2b45-4489-9a49-c3f617268b1f service placement] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:52:21.477945 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7fa2c-2b45-4489-9a49-c3f617268b1f service placement] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:52:21.537012 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f6b5e-0a4b-4cf6-a657-1c7c1576799b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:52:21.537905 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f6b5e-0a4b-4cf6-a657-1c7c1576799b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:52:21.538192 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f6b5e-0a4b-4cf6-a657-1c7c1576799b admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:52:21.538471 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f6b5e-0a4b-4cf6-a657-1c7c1576799b admin admin] PATH_INFO: `/v3/projects/a9af0b38d9fa4db0bfd12c0d1b51b12f` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:52:21.539632 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f6b5e-0a4b-4cf6-a657-1c7c1576799b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9af0b38d9fa4db0bfd12c0d1b51b12f)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:52:21.541645 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f6b5e-0a4b-4cf6-a657-1c7c1576799b admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:52:21.587149 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ae5f6b5e-0a4b-4cf6-a657-1c7c1576799b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'request_id': 'req-ae5f6b5e-0a4b-4cf6-a657-1c7c1576799b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:52:21.592603 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ae5f6b5e-0a4b-4cf6-a657-1c7c1576799b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'request_id': 'req-ae5f6b5e-0a4b-4cf6-a657-1c7c1576799b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:52:21.600041 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ae5f6b5e-0a4b-4cf6-a657-1c7c1576799b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9af0b38d9fa4db0bfd12c0d1b51b12f', 'request_id': 'req-ae5f6b5e-0a4b-4cf6-a657-1c7c1576799b'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:52:21.610911 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ae5f6b5e-0a4b-4cf6-a657-1c7c1576799b admin admin] The token cache is being invalidate because project a9af0b38d9fa4db0bfd12c0d1b51b12f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:52:21.611200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ae5f6b5e-0a4b-4cf6-a657-1c7c1576799b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:52:21.611890 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-ae5f6b5e-0a4b-4cf6-a657-1c7c1576799b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:52:21.613585 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1430/2876] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:52:21 2022] DELETE /identity/v3/projects/a9af0b38d9fa4db0bfd12c0d1b51b12f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:52:21.617659 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca62f1-46c3-4e7d-acc0-60c2f682f918 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:52:21.619190 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-11ca62f1-46c3-4e7d-acc0-60c2f682f918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:52:21.632652 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca62f1-46c3-4e7d-acc0-60c2f682f918 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:52:21.688679 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db16b9-492f-40ef-8452-b174faa45420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:52:21.689584 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db16b9-492f-40ef-8452-b174faa45420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:52:21.689877 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db16b9-492f-40ef-8452-b174faa45420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:52:21.690670 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db16b9-492f-40ef-8452-b174faa45420 admin admin] PATH_INFO: `/v3/users/744c2f3c6a374b93844b82d60cf45128` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:52:21.691862 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db16b9-492f-40ef-8452-b174faa45420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=744c2f3c6a374b93844b82d60cf45128)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:52:21.693820 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db16b9-492f-40ef-8452-b174faa45420 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:52:21.740054 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-35db16b9-492f-40ef-8452-b174faa45420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '744c2f3c6a374b93844b82d60cf45128'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:52:21.740698 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-35db16b9-492f-40ef-8452-b174faa45420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '744c2f3c6a374b93844b82d60cf45128'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:52:21.748900 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-35db16b9-492f-40ef-8452-b174faa45420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '744c2f3c6a374b93844b82d60cf45128'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:52:21.756487 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-35db16b9-492f-40ef-8452-b174faa45420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '744c2f3c6a374b93844b82d60cf45128'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:52:21.769151 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-35db16b9-492f-40ef-8452-b174faa45420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '744c2f3c6a374b93844b82d60cf45128'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:52:21.774861 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1447/2877] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:52:21 2022] DELETE /identity/v3/users/744c2f3c6a374b93844b82d60cf45128 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:52:21.949656 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f6b5e-0a4b-4cf6-a657-1c7c1576799b admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:52:21.951248 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ae5f6b5e-0a4b-4cf6-a657-1c7c1576799b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:52:21.968446 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f6b5e-0a4b-4cf6-a657-1c7c1576799b admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:52:22.027557 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4098d3b-405a-4c7c-9d10-ec6bb0abae83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:52:22.028414 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4098d3b-405a-4c7c-9d10-ec6bb0abae83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:52:22.028698 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4098d3b-405a-4c7c-9d10-ec6bb0abae83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:52:22.028966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4098d3b-405a-4c7c-9d10-ec6bb0abae83 admin admin] PATH_INFO: `/v3/projects/250ad71f12a94d9a8d3afba8048014f5` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:52:22.030158 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4098d3b-405a-4c7c-9d10-ec6bb0abae83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=250ad71f12a94d9a8d3afba8048014f5)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:52:22.032056 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4098d3b-405a-4c7c-9d10-ec6bb0abae83 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:52:22.039791 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:52:22.079026 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e4098d3b-405a-4c7c-9d10-ec6bb0abae83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '250ad71f12a94d9a8d3afba8048014f5', 'request_id': 'req-e4098d3b-405a-4c7c-9d10-ec6bb0abae83'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:52:22.084751 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e4098d3b-405a-4c7c-9d10-ec6bb0abae83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '250ad71f12a94d9a8d3afba8048014f5', 'request_id': 'req-e4098d3b-405a-4c7c-9d10-ec6bb0abae83'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:52:22.091478 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e4098d3b-405a-4c7c-9d10-ec6bb0abae83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '250ad71f12a94d9a8d3afba8048014f5', 'request_id': 'req-e4098d3b-405a-4c7c-9d10-ec6bb0abae83'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:52:22.102515 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e4098d3b-405a-4c7c-9d10-ec6bb0abae83 admin admin] The token cache is being invalidate because project 250ad71f12a94d9a8d3afba8048014f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80347) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:52:22.102802 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e4098d3b-405a-4c7c-9d10-ec6bb0abae83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:52:22.103434 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-e4098d3b-405a-4c7c-9d10-ec6bb0abae83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:52:22.104959 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1431/2878] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:52:21 2022] DELETE /identity/v3/projects/250ad71f12a94d9a8d3afba8048014f5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:52:31.771375 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:52:32.099644 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:53:07.036344 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db16b9-492f-40ef-8452-b174faa45420 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:53:07.037994 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-35db16b9-492f-40ef-8452-b174faa45420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:53:07.094905 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db16b9-492f-40ef-8452-b174faa45420 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:53:07.142778 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b30ac2-952b-4e16-a6ec-1e69a7370556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:53:07.143694 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b30ac2-952b-4e16-a6ec-1e69a7370556 service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:53:07.143987 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b30ac2-952b-4e16-a6ec-1e69a7370556 service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:53:07.144274 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b30ac2-952b-4e16-a6ec-1e69a7370556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:53:07.146065 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-52b30ac2-952b-4e16-a6ec-1e69a7370556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:53:07.155491 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b30ac2-952b-4e16-a6ec-1e69a7370556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:53:07.156909 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b30ac2-952b-4e16-a6ec-1e69a7370556 service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:53:07.164801 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1448/2879] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:53:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:53:14.510686 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4098d3b-405a-4c7c-9d10-ec6bb0abae83 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:53:14.512274 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e4098d3b-405a-4c7c-9d10-ec6bb0abae83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:53:14.600330 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4098d3b-405a-4c7c-9d10-ec6bb0abae83 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:53:14.605908 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17ff3d-93ed-43f7-860d-9a12d2337084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:53:14.606573 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17ff3d-93ed-43f7-860d-9a12d2337084 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:53:14.606869 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17ff3d-93ed-43f7-860d-9a12d2337084 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:53:14.607132 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17ff3d-93ed-43f7-860d-9a12d2337084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:53:14.608933 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9b17ff3d-93ed-43f7-860d-9a12d2337084 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:53:14.622967 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17ff3d-93ed-43f7-860d-9a12d2337084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:53:14.624631 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17ff3d-93ed-43f7-860d-9a12d2337084 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:53:14.637900 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1432/2880] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:53:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:53:15.522590 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb868bd3-9e52-4422-880c-fb8cb6dad9e6 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:53:15.523093 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb868bd3-9e52-4422-880c-fb8cb6dad9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:53:15.523204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb868bd3-9e52-4422-880c-fb8cb6dad9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:53:15.540593 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-cb868bd3-9e52-4422-880c-fb8cb6dad9e6 None None] MFA Rules not processed for user `10f209080b9745d0a13f60ce5e1ca7df`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:53:15.541812 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-cb868bd3-9e52-4422-880c-fb8cb6dad9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:53:15.598996 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1449/2881] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:53:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:53:16.354752 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17ff3d-93ed-43f7-860d-9a12d2337084 service nova] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:53:16.356152 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9b17ff3d-93ed-43f7-860d-9a12d2337084 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:53:16.427135 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17ff3d-93ed-43f7-860d-9a12d2337084 service nova] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:53:16.431947 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418eecfe-49ef-4b01-bc20-4f69f585ebd8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98915513674460485413c2dbee87fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:53:16.432585 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418eecfe-49ef-4b01-bc20-4f69f585ebd8 service placement] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:53:16.432867 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418eecfe-49ef-4b01-bc20-4f69f585ebd8 service placement] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:53:16.433142 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418eecfe-49ef-4b01-bc20-4f69f585ebd8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:53:16.435070 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-418eecfe-49ef-4b01-bc20-4f69f585ebd8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:53:16.446826 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418eecfe-49ef-4b01-bc20-4f69f585ebd8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:53:16.448492 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418eecfe-49ef-4b01-bc20-4f69f585ebd8 service placement] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:53:16.458651 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1433/2882] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:53:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:53:25.591409 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=71 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:53:26.454184 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=66 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:53:30.588405 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb868bd3-9e52-4422-880c-fb8cb6dad9e6 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:53:30.589974 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-cb868bd3-9e52-4422-880c-fb8cb6dad9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:53:30.607600 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb868bd3-9e52-4422-880c-fb8cb6dad9e6 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:53:30.613040 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212ab13-15d2-4bc4-a403-107c0b2e2fd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:53:30.614416 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212ab13-15d2-4bc4-a403-107c0b2e2fd3 service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:53:30.614836 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212ab13-15d2-4bc4-a403-107c0b2e2fd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:53:30.615309 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212ab13-15d2-4bc4-a403-107c0b2e2fd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:53:30.617114 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-8212ab13-15d2-4bc4-a403-107c0b2e2fd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:53:30.629475 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212ab13-15d2-4bc4-a403-107c0b2e2fd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:53:30.631669 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8212ab13-15d2-4bc4-a403-107c0b2e2fd3 service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:53:30.642876 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1450/2883] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:53:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:53:40.639045 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=6 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:55:07.808828 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418eecfe-49ef-4b01-bc20-4f69f585ebd8 service placement] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:55:07.810275 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-418eecfe-49ef-4b01-bc20-4f69f585ebd8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:55:07.894558 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418eecfe-49ef-4b01-bc20-4f69f585ebd8 service placement] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:55:07.900405 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65173d2f-3d6c-4666-a3da-abc21cd3ac15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98915513674460485413c2dbee87fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:55:07.901037 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65173d2f-3d6c-4666-a3da-abc21cd3ac15 service placement] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:55:07.901318 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65173d2f-3d6c-4666-a3da-abc21cd3ac15 service placement] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:55:07.901622 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65173d2f-3d6c-4666-a3da-abc21cd3ac15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:55:07.903389 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-65173d2f-3d6c-4666-a3da-abc21cd3ac15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:55:07.914596 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65173d2f-3d6c-4666-a3da-abc21cd3ac15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:55:07.916665 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65173d2f-3d6c-4666-a3da-abc21cd3ac15 service placement] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:55:07.926495 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1434/2884] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:55:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:55:08.686466 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c30da0-a2ec-4667-aa60-86edc6b30c93 None None] REQUEST_METHOD: `POST` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:55:08.686978 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c30da0-a2ec-4667-aa60-86edc6b30c93 None None] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:55:08.687093 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c30da0-a2ec-4667-aa60-86edc6b30c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:55:08.705969 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.auth.core [None req-d3c30da0-a2ec-4667-aa60-86edc6b30c93 None None] MFA Rules not processed for user `10f209080b9745d0a13f60ce5e1ca7df`. Rule list: `[]` (Enabled: `True`). {{(pid=80346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 14 19:55:08.707175 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-d3c30da0-a2ec-4667-aa60-86edc6b30c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:55:08.714718 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1451/2885] 10.222.0.44 () {58 vars in 957 bytes} [Tue Jun 14 19:55:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 14 19:55:09.030577 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65173d2f-3d6c-4666-a3da-abc21cd3ac15 service placement] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:55:09.031974 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-65173d2f-3d6c-4666-a3da-abc21cd3ac15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:55:09.064705 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65173d2f-3d6c-4666-a3da-abc21cd3ac15 service placement] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:55:09.068269 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc95e5-5eaf-4340-bb30-1806dfd5bf8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:55:09.068902 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc95e5-5eaf-4340-bb30-1806dfd5bf8c service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:55:09.069185 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc95e5-5eaf-4340-bb30-1806dfd5bf8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:55:09.069494 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc95e5-5eaf-4340-bb30-1806dfd5bf8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:55:09.071241 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-68dc95e5-5eaf-4340-bb30-1806dfd5bf8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:55:09.080714 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc95e5-5eaf-4340-bb30-1806dfd5bf8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:55:09.082165 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc95e5-5eaf-4340-bb30-1806dfd5bf8c service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:55:09.090709 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1435/2886] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:55:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:55:18.701078 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=3 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:55:18.796022 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c30da0-a2ec-4667-aa60-86edc6b30c93 None None] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:55:18.816155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c30da0-a2ec-4667-aa60-86edc6b30c93 None None] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:55:18.822182 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bb6bb-9c32-4c32-b18c-14b2433266a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:55:18.822836 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bb6bb-9c32-4c32-b18c-14b2433266a5 service nova] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:55:18.823117 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bb6bb-9c32-4c32-b18c-14b2433266a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:55:18.823394 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526bb6bb-9c32-4c32-b18c-14b2433266a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:55:18.825158 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-526bb6bb-9c32-4c32-b18c-14b2433266a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:55:18.835751 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bb6bb-9c32-4c32-b18c-14b2433266a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:55:18.837346 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526bb6bb-9c32-4c32-b18c-14b2433266a5 service nova] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:55:18.846080 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1452/2887] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:55:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:55:19.086460 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=52 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:55:26.783449 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc95e5-5eaf-4340-bb30-1806dfd5bf8c service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:55:26.797181 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc95e5-5eaf-4340-bb30-1806dfd5bf8c service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:55:26.802735 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20304bbe-dccd-486f-9e82-a50f40260f90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '37c521e20aea4cad9758568a4f082fbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:55:26.803378 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20304bbe-dccd-486f-9e82-a50f40260f90 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:55:26.803664 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20304bbe-dccd-486f-9e82-a50f40260f90 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:55:26.803942 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20304bbe-dccd-486f-9e82-a50f40260f90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:55:26.805757 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-20304bbe-dccd-486f-9e82-a50f40260f90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:55:26.824949 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20304bbe-dccd-486f-9e82-a50f40260f90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:55:26.826614 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20304bbe-dccd-486f-9e82-a50f40260f90 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:55:26.837563 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1436/2888] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:55:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:55:28.842056 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=9 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:55:36.832960 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=6 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:57:07.623510 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bb6bb-9c32-4c32-b18c-14b2433266a5 service nova] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:57:07.633038 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526bb6bb-9c32-4c32-b18c-14b2433266a5 service nova] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:57:07.637194 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c557861-e3fc-4333-8506-af43edf1dfbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:57:07.637967 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c557861-e3fc-4333-8506-af43edf1dfbf service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:57:07.638335 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c557861-e3fc-4333-8506-af43edf1dfbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:57:07.638671 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c557861-e3fc-4333-8506-af43edf1dfbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:57:07.640529 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-5c557861-e3fc-4333-8506-af43edf1dfbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:57:07.668419 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c557861-e3fc-4333-8506-af43edf1dfbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:57:07.669988 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c557861-e3fc-4333-8506-af43edf1dfbf service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:57:07.691763 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1453/2889] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:57:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:57:13.184598 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20304bbe-dccd-486f-9e82-a50f40260f90 service nova] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:57:13.186824 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-20304bbe-dccd-486f-9e82-a50f40260f90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:57:13.203540 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20304bbe-dccd-486f-9e82-a50f40260f90 service nova] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:57:13.207293 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123c87c-697d-4530-a09c-9422d7d1c6aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:57:13.207941 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123c87c-697d-4530-a09c-9422d7d1c6aa service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:57:13.208230 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123c87c-697d-4530-a09c-9422d7d1c6aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:57:13.208508 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123c87c-697d-4530-a09c-9422d7d1c6aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:57:13.210315 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5123c87c-697d-4530-a09c-9422d7d1c6aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:57:13.224206 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123c87c-697d-4530-a09c-9422d7d1c6aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:57:13.225667 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123c87c-697d-4530-a09c-9422d7d1c6aa service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:57:13.237829 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1437/2890] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:57:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:57:17.689311 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=15 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:57:18.538155 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c557861-e3fc-4333-8506-af43edf1dfbf service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:57:18.547507 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c557861-e3fc-4333-8506-af43edf1dfbf service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:57:18.551263 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b56eb-aa92-4965-9fac-1f70ed9793eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '791ed0f433834b4599d6bc825440279d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:57:18.551931 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b56eb-aa92-4965-9fac-1f70ed9793eb service neutron] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:57:18.552213 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b56eb-aa92-4965-9fac-1f70ed9793eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:57:18.552490 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b56eb-aa92-4965-9fac-1f70ed9793eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:57:18.554280 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-0d5b56eb-aa92-4965-9fac-1f70ed9793eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:57:18.640023 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b56eb-aa92-4965-9fac-1f70ed9793eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:57:18.641353 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b56eb-aa92-4965-9fac-1f70ed9793eb service neutron] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:57:18.660786 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1454/2891] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:57:21.741639 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123c87c-697d-4530-a09c-9422d7d1c6aa service neutron] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:57:21.752900 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123c87c-697d-4530-a09c-9422d7d1c6aa service neutron] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:57:21.758460 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1f7e6-6e7e-47a2-89b3-37c5bf5f282e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98915513674460485413c2dbee87fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:57:21.759157 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1f7e6-6e7e-47a2-89b3-37c5bf5f282e service placement] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:57:21.759445 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1f7e6-6e7e-47a2-89b3-37c5bf5f282e service placement] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:57:21.759728 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1f7e6-6e7e-47a2-89b3-37c5bf5f282e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:57:21.761600 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b7c1f7e6-6e7e-47a2-89b3-37c5bf5f282e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:57:21.774294 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1f7e6-6e7e-47a2-89b3-37c5bf5f282e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:57:21.776444 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1f7e6-6e7e-47a2-89b3-37c5bf5f282e service placement] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:57:21.788310 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1438/2892] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:57:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:57:24.853109 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b56eb-aa92-4965-9fac-1f70ed9793eb service neutron] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:57:24.886112 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b56eb-aa92-4965-9fac-1f70ed9793eb service neutron] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:57:24.892060 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e42d2-688d-4ef3-a47f-a6defb6b98b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98915513674460485413c2dbee87fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:57:24.892875 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e42d2-688d-4ef3-a47f-a6defb6b98b7 service placement] REQUEST_METHOD: `GET` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:57:24.893229 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e42d2-688d-4ef3-a47f-a6defb6b98b7 service placement] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:57:24.893609 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e42d2-688d-4ef3-a47f-a6defb6b98b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:57:24.895562 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-7c7e42d2-688d-4ef3-a47f-a6defb6b98b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:57:24.910714 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e42d2-688d-4ef3-a47f-a6defb6b98b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:57:24.912410 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e42d2-688d-4ef3-a47f-a6defb6b98b7 service placement] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:57:24.930147 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1455/2893] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 19:57:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 19:57:24.930615 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1f7e6-6e7e-47a2-89b3-37c5bf5f282e service placement] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:57:24.932129 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b7c1f7e6-6e7e-47a2-89b3-37c5bf5f282e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:57:24.953437 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1f7e6-6e7e-47a2-89b3-37c5bf5f282e service placement] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:57:24.959094 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9455cec-223c-44ff-8dfc-4b590a1965d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:57:24.959952 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9455cec-223c-44ff-8dfc-4b590a1965d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:57:24.960239 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9455cec-223c-44ff-8dfc-4b590a1965d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:57:24.960519 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9455cec-223c-44ff-8dfc-4b590a1965d2 admin admin] PATH_INFO: `/v3/users/10f209080b9745d0a13f60ce5e1ca7df` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:57:24.962119 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9455cec-223c-44ff-8dfc-4b590a1965d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f209080b9745d0a13f60ce5e1ca7df)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:57:24.964079 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9455cec-223c-44ff-8dfc-4b590a1965d2 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:57:25.023209 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a9455cec-223c-44ff-8dfc-4b590a1965d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f209080b9745d0a13f60ce5e1ca7df'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:57:25.023863 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a9455cec-223c-44ff-8dfc-4b590a1965d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f209080b9745d0a13f60ce5e1ca7df'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:57:25.031728 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a9455cec-223c-44ff-8dfc-4b590a1965d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f209080b9745d0a13f60ce5e1ca7df'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:57:25.038640 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a9455cec-223c-44ff-8dfc-4b590a1965d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f209080b9745d0a13f60ce5e1ca7df'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:57:25.050502 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-a9455cec-223c-44ff-8dfc-4b590a1965d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f209080b9745d0a13f60ce5e1ca7df'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:57:25.056321 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1439/2894] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:57:24 2022] DELETE /identity/v3/users/10f209080b9745d0a13f60ce5e1ca7df => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 14 19:57:25.237055 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e42d2-688d-4ef3-a47f-a6defb6b98b7 service placement] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:57:25.247753 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e42d2-688d-4ef3-a47f-a6defb6b98b7 service placement] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:57:25.305608 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d1e77-d3d8-4bdd-a064-8e3099fe3328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:57:25.306477 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d1e77-d3d8-4bdd-a064-8e3099fe3328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:57:25.306763 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d1e77-d3d8-4bdd-a064-8e3099fe3328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:57:25.307070 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d1e77-d3d8-4bdd-a064-8e3099fe3328 admin admin] PATH_INFO: `/v3/projects/b0b8f372dfc54511a3f8c77baaa4f39a` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:57:25.308276 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d1e77-d3d8-4bdd-a064-8e3099fe3328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0b8f372dfc54511a3f8c77baaa4f39a)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:57:25.310232 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9d1e77-d3d8-4bdd-a064-8e3099fe3328 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:57:25.356039 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2b9d1e77-d3d8-4bdd-a064-8e3099fe3328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'request_id': 'req-2b9d1e77-d3d8-4bdd-a064-8e3099fe3328'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:57:25.359999 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:57:25.362448 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2b9d1e77-d3d8-4bdd-a064-8e3099fe3328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'request_id': 'req-2b9d1e77-d3d8-4bdd-a064-8e3099fe3328'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:57:25.369693 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2b9d1e77-d3d8-4bdd-a064-8e3099fe3328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0b8f372dfc54511a3f8c77baaa4f39a', 'request_id': 'req-2b9d1e77-d3d8-4bdd-a064-8e3099fe3328'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:57:25.381100 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2b9d1e77-d3d8-4bdd-a064-8e3099fe3328 admin admin] The token cache is being invalidate because project b0b8f372dfc54511a3f8c77baaa4f39a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:57:25.381401 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2b9d1e77-d3d8-4bdd-a064-8e3099fe3328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:57:25.382034 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-2b9d1e77-d3d8-4bdd-a064-8e3099fe3328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:57:25.383571 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1456/2895] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:57:25 2022] DELETE /identity/v3/projects/b0b8f372dfc54511a3f8c77baaa4f39a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:57:25.388086 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9455cec-223c-44ff-8dfc-4b590a1965d2 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:57:25.389497 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a9455cec-223c-44ff-8dfc-4b590a1965d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:57:25.402863 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9455cec-223c-44ff-8dfc-4b590a1965d2 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:57:25.460200 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67546267-c670-41dc-b659-efa60590b432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:57:25.460990 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67546267-c670-41dc-b659-efa60590b432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:57:25.461277 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67546267-c670-41dc-b659-efa60590b432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:57:25.461586 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67546267-c670-41dc-b659-efa60590b432 admin admin] PATH_INFO: `/v3/users/8dd474c209054a32bcdedaa0b30bdb98` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:57:25.462785 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67546267-c670-41dc-b659-efa60590b432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dd474c209054a32bcdedaa0b30bdb98)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:57:25.464922 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67546267-c670-41dc-b659-efa60590b432 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:57:25.512124 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-67546267-c670-41dc-b659-efa60590b432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dd474c209054a32bcdedaa0b30bdb98'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:57:25.512784 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-67546267-c670-41dc-b659-efa60590b432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dd474c209054a32bcdedaa0b30bdb98'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:57:25.514510 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:57:25.521438 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-67546267-c670-41dc-b659-efa60590b432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dd474c209054a32bcdedaa0b30bdb98'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:57:25.530308 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-67546267-c670-41dc-b659-efa60590b432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dd474c209054a32bcdedaa0b30bdb98'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:57:25.541966 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.notifications [None req-67546267-c670-41dc-b659-efa60590b432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dd474c209054a32bcdedaa0b30bdb98'} {{(pid=80347) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:57:25.547857 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1440/2896] 10.222.0.44 () {58 vars in 1223 bytes} [Tue Jun 14 19:57:25 2022] DELETE /identity/v3/users/8dd474c209054a32bcdedaa0b30bdb98 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:57:25.722265 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d1e77-d3d8-4bdd-a064-8e3099fe3328 admin admin] Authenticating user token {{(pid=80346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 19:57:25.724144 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.fernet_utils [None req-2b9d1e77-d3d8-4bdd-a064-8e3099fe3328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 19:57:25.740302 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9d1e77-d3d8-4bdd-a064-8e3099fe3328 admin admin] Validating token access rules against request {{(pid=80346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 19:57:25.799185 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3869b1-0304-448e-b1e0-40d921eba505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13cde894f1744031872e9c62485bd552', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '782dbf52581f4a55b95487f939e373c1', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 19:57:25.800049 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3869b1-0304-448e-b1e0-40d921eba505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 19:57:25.800338 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3869b1-0304-448e-b1e0-40d921eba505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 19:57:25.800620 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3869b1-0304-448e-b1e0-40d921eba505 admin admin] PATH_INFO: `/v3/projects/da8d971bf3d14d33807025d13fc90e12` {{(pid=80346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 19:57:25.801821 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3869b1-0304-448e-b1e0-40d921eba505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da8d971bf3d14d33807025d13fc90e12)` {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 19:57:25.803716 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3869b1-0304-448e-b1e0-40d921eba505 admin admin] RBAC: Authorization granted {{(pid=80346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 19:57:25.849658 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-de3869b1-0304-448e-b1e0-40d921eba505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da8d971bf3d14d33807025d13fc90e12', 'request_id': 'req-de3869b1-0304-448e-b1e0-40d921eba505'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:57:25.855591 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-de3869b1-0304-448e-b1e0-40d921eba505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da8d971bf3d14d33807025d13fc90e12', 'request_id': 'req-de3869b1-0304-448e-b1e0-40d921eba505'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:57:25.862832 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-de3869b1-0304-448e-b1e0-40d921eba505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da8d971bf3d14d33807025d13fc90e12', 'request_id': 'req-de3869b1-0304-448e-b1e0-40d921eba505'} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:57:25.873918 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-de3869b1-0304-448e-b1e0-40d921eba505 admin admin] The token cache is being invalidate because project da8d971bf3d14d33807025d13fc90e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 14 19:57:25.874204 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-de3869b1-0304-448e-b1e0-40d921eba505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:57:25.874850 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG keystone.notifications [None req-de3869b1-0304-448e-b1e0-40d921eba505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 14 19:57:25.876377 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: [pid: 80346|app: 0|req: 1457/2897] 10.222.0.44 () {58 vars in 1232 bytes} [Tue Jun 14 19:57:25 2022] DELETE /identity/v3/projects/da8d971bf3d14d33807025d13fc90e12 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 14 19:57:35.544435 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=12 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 19:57:35.870817 dv-cinder-845806-1-iscsi devstack@keystone.service[80346]: DEBUG dbcounter [-] [80346] Writing DB stats keystone:DELETE=9,keystone:SELECT=56,keystone:INSERT=2 {{(pid=80346) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 14 20:00:12.779821 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67546267-c670-41dc-b659-efa60590b432 admin admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 14 20:00:12.781218 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-67546267-c670-41dc-b659-efa60590b432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 20:00:12.850961 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67546267-c670-41dc-b659-efa60590b432 admin admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 14 20:00:12.908863 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6f246-18ef-4c42-b4ea-dd09e9cd2300 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e98915513674460485413c2dbee87fb3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d3e177b11504cb3b19d25ed5850ef12', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 14 20:00:12.909517 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6f246-18ef-4c42-b4ea-dd09e9cd2300 service placement] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 14 20:00:12.909807 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6f246-18ef-4c42-b4ea-dd09e9cd2300 service placement] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 14 20:00:12.910086 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6f246-18ef-4c42-b4ea-dd09e9cd2300 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 14 20:00:12.911854 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4fc6f246-18ef-4c42-b4ea-dd09e9cd2300 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 14 20:00:12.922956 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6f246-18ef-4c42-b4ea-dd09e9cd2300 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 14 20:00:12.924526 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6f246-18ef-4c42-b4ea-dd09e9cd2300 service placement] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 14 20:00:12.934330 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1441/2898] 10.222.0.44 () {60 vars in 1365 bytes} [Tue Jun 14 20:00:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 14 20:00:22.930109 dv-cinder-845806-1-iscsi devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=58 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}